-- Logs begin at Mon 2022-07-18 09:41:51 UTC, end at Mon 2022-07-18 10:59:42 UTC. -- Jul 18 10:18:05.095531 dv-cinder-849498-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 18 10:18:05.104402 dv-cinder-849498-1-smb devstack@keystone.service[80324]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 18 10:18:05.106452 dv-cinder-849498-1-smb devstack@keystone.service[80324]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 10:18:05 2022] *** Jul 18 10:18:05.106452 dv-cinder-849498-1-smb devstack@keystone.service[80324]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 10:18:05.106452 dv-cinder-849498-1-smb devstack@keystone.service[80324]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 10:18:05.106452 dv-cinder-849498-1-smb devstack@keystone.service[80324]: nodename: dv-cinder-849498-1-smb Jul 18 10:18:05.106452 dv-cinder-849498-1-smb devstack@keystone.service[80324]: machine: x86_64 Jul 18 10:18:05.106452 dv-cinder-849498-1-smb devstack@keystone.service[80324]: clock source: unix Jul 18 10:18:05.106452 dv-cinder-849498-1-smb devstack@keystone.service[80324]: pcre jit disabled Jul 18 10:18:05.106452 dv-cinder-849498-1-smb devstack@keystone.service[80324]: detected number of CPU cores: 4 Jul 18 10:18:05.106452 dv-cinder-849498-1-smb devstack@keystone.service[80324]: current working directory: / Jul 18 10:18:05.106452 dv-cinder-849498-1-smb devstack@keystone.service[80324]: detected binary path: /usr/bin/uwsgi-core Jul 18 10:18:05.106452 dv-cinder-849498-1-smb devstack@keystone.service[80324]: your processes number limit is 47680 Jul 18 10:18:05.106452 dv-cinder-849498-1-smb devstack@keystone.service[80324]: your memory page size is 4096 bytes Jul 18 10:18:05.106452 dv-cinder-849498-1-smb devstack@keystone.service[80324]: detected max file descriptor number: 2048 Jul 18 10:18:05.106452 dv-cinder-849498-1-smb devstack@keystone.service[80324]: lock engine: pthread robust mutexes Jul 18 10:18:05.107914 dv-cinder-849498-1-smb devstack@keystone.service[80324]: thunder lock: enabled Jul 18 10:18:05.107914 dv-cinder-849498-1-smb devstack@keystone.service[80324]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 18 10:18:05.107914 dv-cinder-849498-1-smb devstack@keystone.service[80324]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 10:18:05.147931 dv-cinder-849498-1-smb devstack@keystone.service[80324]: Python main interpreter initialized at 0x565187f719c0 Jul 18 10:18:05.147931 dv-cinder-849498-1-smb devstack@keystone.service[80324]: python threads support enabled Jul 18 10:18:05.147931 dv-cinder-849498-1-smb devstack@keystone.service[80324]: your server socket listen backlog is limited to 100 connections Jul 18 10:18:05.147931 dv-cinder-849498-1-smb devstack@keystone.service[80324]: your mercy for graceful operations on workers is 90 seconds Jul 18 10:18:05.148331 dv-cinder-849498-1-smb devstack@keystone.service[80324]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 10:18:05.148404 dv-cinder-849498-1-smb devstack@keystone.service[80324]: *** Operational MODE: preforking *** Jul 18 10:18:05.148635 dv-cinder-849498-1-smb devstack@keystone.service[80324]: *** uWSGI is running in multiple interpreter mode *** Jul 18 10:18:05.148635 dv-cinder-849498-1-smb devstack@keystone.service[80324]: spawned uWSGI master process (pid: 80324) Jul 18 10:18:05.148843 dv-cinder-849498-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 18 10:18:05.152895 dv-cinder-849498-1-smb devstack@keystone.service[80324]: spawned uWSGI worker 1 (pid: 80335, cores: 1) Jul 18 10:18:05.152895 dv-cinder-849498-1-smb devstack@keystone.service[80324]: spawned uWSGI worker 2 (pid: 80336, cores: 1) Jul 18 10:18:05.152895 dv-cinder-849498-1-smb devstack@keystone.service[80324]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 10:18:10.653917 dv-cinder-849498-1-smb devstack@keystone.service[80336]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:18:10.653917 dv-cinder-849498-1-smb devstack@keystone.service[80336]: from cryptography.utils import int_from_bytes Jul 18 10:18:10.655358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:18:10.655358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: from cryptography.utils import int_from_bytes Jul 18 10:18:10.655358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:18:10.655358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: from cryptography.utils import int_from_bytes Jul 18 10:18:10.655879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:18:10.655879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: from cryptography.utils import int_from_bytes Jul 18 10:18:10.704187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:18:10.704381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:18:10.704553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] command line args: [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:18:10.704696 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:18:10.704828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:18:10.704913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:18:10.704994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ================================================================================ {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:18:10.705067 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] command line args: [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:18:10.705253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] admin_token = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.705340 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:18:10.705499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ================================================================================ {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:18:10.705584 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] config_dir = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.705687 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.705766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] admin_token = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.705878 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] config_source = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.705994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] config_dir = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.706079 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] debug = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.706184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.706264 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.706579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] config_source = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.706579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] debug = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.706779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.706880 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.707006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.707112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.707219 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.707321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.707416 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.707510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.707614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] list_limit = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.707721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.707817 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] log_config_append = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.707910 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.708008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] list_limit = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.708114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] log_dir = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.708211 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] log_config_append = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.708316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] log_file = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.708425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.708425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] log_dir = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.708630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.708750 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] log_file = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.708826 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.708954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.709036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.709112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.709234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.709319 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.709396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.709525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.709609 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.709682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.709802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.709884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.709964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.710081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.710205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.710285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.710384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.710496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.710618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.710734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.710855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.710970 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.711105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.711206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.711356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.711456 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.711637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.711716 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.711965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.712128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.712316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] publish_errors = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.712455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.712538 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.712641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] publish_errors = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.712771 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.712877 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.712954 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.713112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.713202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.713281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.713417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.713530 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.713657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] standard_threads = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.713766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.713891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.714005 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] standard_threads = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.714140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.714224 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.714306 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.714504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.714593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] use_journal = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.714666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] use_json = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.714735 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.714847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] use_stderr = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.715002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] use_journal = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.715002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] use_json = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.715144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] use_syslog = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.715215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] use_stderr = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.715283 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.715352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] use_syslog = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.715501 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.715581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:18:10.715747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.715830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.716020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.716098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.716268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.716347 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.716524 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.716602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.716769 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.716847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.717011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.717088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.717323 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.717890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.718060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.718144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.718409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.718502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.718580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.718651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.718829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.718927 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.719069 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.719149 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.719311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.719394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.719550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.719633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.719804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.719889 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.720046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.720123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.720286 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.720361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.720560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.720690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.720828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.720958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.721088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.721285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.721285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.721520 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.721646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.721770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.721894 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.722025 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.722150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.722274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.722274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.722536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.722536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.722781 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.722907 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.723031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.723154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.723277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.723401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.723533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.723655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.723779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.723909 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.724032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.724161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.724302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.724426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.724549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.724678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.724809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.724932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.725066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.725189 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.725312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.725442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.725595 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.725730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.725861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.726099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.726174 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.726242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.726307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.726419 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.726491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.726553 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.726610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.726668 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.726730 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.726791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.726918 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.727014 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.727278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.727426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.727549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.727669 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.727792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.727921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.728044 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.728164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.728290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.728423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.728551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.728680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.728802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.728920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.729049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.729170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.729294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.729428 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.729557 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.729677 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.729806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.729933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.730054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.730185 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.730307 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.730461 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.730584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.730706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.730845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.730977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.731099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.731222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.731344 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.731470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.731593 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.731746 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.731875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.732009 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.732136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.732270 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.732394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.732535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.732660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.732848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.733080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.733080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.733466 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.733680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.733807 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.733934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.734059 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.734180 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.734308 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.734476 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.734613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.734740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.734865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.734989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.735114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.735251 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.735384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.735520 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.735520 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.735756 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.735881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.736005 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.736078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.736216 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.736344 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.736478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.736624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.736745 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.736875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.737002 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.737128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.737259 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.737383 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.737509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.737641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.737765 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.737890 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.738015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.738154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.738280 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.738444 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.738566 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.738698 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.738829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.738954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.739080 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.739216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.739216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.739452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.739583 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.739709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.739709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.739960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.739960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.740196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.740196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.740430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.740430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.740679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.740803 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.740928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.741053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.741177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.741301 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.741437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.741571 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.741697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.741826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.741969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.742044 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.742211 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.742388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] auth.external = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.742511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.742638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.742764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.742889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.743026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.743151 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.743282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] auth.external = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.743441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] auth.password = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.743575 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.743701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] auth.token = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.743828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.743960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.744098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.744226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.744352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] auth.password = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.744477 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.744602 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] auth.token = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.744727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.744864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.744990 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.745126 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.745250 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.745376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.745502 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.745634 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.745767 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] credential.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.745894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.746026 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.746152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.746283 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.746434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.746562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.746689 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] credential.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.746815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.746951 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.747078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.747211 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.747339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.747466 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.747592 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.747717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.747843 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.747976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.748099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.748226 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.748358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.748455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.748634 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.748833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.748973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.749102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.749229 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.749356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.749483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.749483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.749729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.749856 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.749982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.750108 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.750234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.750317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.750439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.750500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.750650 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.750773 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.750900 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.751036 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.751164 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.751290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.751415 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.751540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.751673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.751802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.751921 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.752044 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.752180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.752306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.752439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.752565 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.752690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.752815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.752940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.753064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.753198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.753333 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.753457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.753582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.753707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.753848 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.753980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.754105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.754232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.754372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.754503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.754629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.754766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.754912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.755045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.755168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.755294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.755420 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.755562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.755693 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.755818 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.755943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.756069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.756194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.756327 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.756452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.756577 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.756702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.756827 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.756952 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.757085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.757208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.757342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.757342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.757580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.757580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.757823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.758197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.758348 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.758480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.758608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.758734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.758865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.758989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.759112 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.759247 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.759371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.759371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.759616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.759742 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.759867 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.759993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.760118 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.760242 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.760373 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.760373 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.760612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.760743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.760874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.761008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.761141 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.761266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.761391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.761516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.761642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.761780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.761904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.762034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.762162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.762288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.762396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.762523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.762647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.762784 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.762911 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.763037 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.763163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.763297 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.763429 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.763555 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.763680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.763807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.763933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.764557 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.764678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.764807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.764930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.765065 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.765192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.765325 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.765452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.765579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.765704 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.765830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.765956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.766115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.766199 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.766373 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.766499 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.766499 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.766749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.766749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.767000 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.767126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.767252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.767377 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.767502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.767635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.767762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.767889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.768020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.768146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.768271 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.768405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.768540 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.768667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.768793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.768918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.769045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.769206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.769333 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.769460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.769586 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.769712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.769837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.769971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.770096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.770229 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.770372 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.770495 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.770617 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.770760 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.770884 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.771007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.771135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.771262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.771389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.771523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.771649 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.771780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.771901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.772038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.772166 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.772303 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.772424 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.772546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.772673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.772800 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.772926 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.773059 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.773186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.773313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.773427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.773550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.773672 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.773878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.774008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.774131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.774254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.774429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.774551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.774688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.774814 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.774940 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.775066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.775191 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.775318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.775451 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.775592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.775718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.775844 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.775918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.775979 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.776048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.776110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.776169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.776312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.776430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.776557 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.776707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.776846 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.776976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.777109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.777238 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.777365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.777499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.777625 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.777751 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.777877 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.778003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.778137 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.778264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.778408 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.778531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] role.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.778657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.778783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] role.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.778928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.779055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.779181 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.779307 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.779434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.779560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.779745 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] role.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.780382 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.780507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] role.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.780635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.780762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.780887 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.781020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.781158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.781285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.781412 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.781538 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.781665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.781804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.781927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.782054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.782177 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.782300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.782448 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.782587 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.782715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.782842 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.782979 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.783106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.783106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.783352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.783352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.783590 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.783719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.783845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.783972 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.784106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.784233 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.784359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.784485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.784620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.784748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.784882 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.785009 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.785135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.785216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.785343 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.785474 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.785598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.785725 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.785851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.785977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.785977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.786224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.786366 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.786489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.786489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.786726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.786853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.786988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.787114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.787240 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.787366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.787491 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.787616 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.787748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.787884 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.788011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.788011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.788249 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.788249 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.788492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.788618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.788744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.788870 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.788996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.789122 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] token.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.789255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.789381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.789507 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.789642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.789766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.789891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.790025 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.790149 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.790276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.790414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.790540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.790674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.790808 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.790932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.791058 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.791217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.791298 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.791419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.791551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.791679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.791807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.791932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.792060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.792185 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.792317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.792444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.792570 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.connection = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.792707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.792840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.792967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.793103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.793237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.793364 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.793492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.793617 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.793617 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.793854 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.connection = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.793991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.794123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.794368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.794495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.794623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.794749 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.794875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.795011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.795148 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.795294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.795418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.795541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.795664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.795788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.795882 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.795998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.796159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.796287 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.796414 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.796540 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.796680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.796819 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.796946 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.797073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.797200 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.797326 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.797461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:18:10.797588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.797588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.797588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.797588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.797588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:18:10.797588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:18:10.824244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:10.824476 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:10.824607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:10.824735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:10.824876 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:10.825005 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:10.834243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:10.835629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:10.862862 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:10.863124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:10.863265 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:10.863497 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.006553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.006915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.056660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.056948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.057323 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.057565 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.122642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.122916 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.123065 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.123220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.123363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.124039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.124235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.124412 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.124570 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.124768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.124976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.124976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.149622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.149848 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.149993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.150120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.150261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.150424 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.150551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.150676 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.150800 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.150923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.151054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.151178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.151311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.151436 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.162815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.163002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.176324 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.176517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.176647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.176773 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.176913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.177040 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.177165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.177304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.177429 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.177554 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.177686 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.177811 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.177936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.178061 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:18:11.194775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.194990 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 10:18:11.195337 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.195462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.195599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 10:18:11.195726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 10:18:11.195858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.195983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.196106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.196230 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 10:18:11.196353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.196476 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.196607 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.196731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.196885 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.197144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.207890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.208120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.208391 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.208520 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.208670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.208796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.208927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.209199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.216862 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.217955 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.220941 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.221221 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.221361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.221511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.221638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.221794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.221920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.222176 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.222301 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.222452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.222580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.222717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.222846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.222983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.223115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.223243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.223371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.223493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.223623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.223751 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.223878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.224012 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.251580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.251796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.253221 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.253359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.253491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.253620 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.259092 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.259258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.259386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.259512 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.259650 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.259779 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.267047 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.267194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.267323 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.267455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.271965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.272127 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.272259 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.272387 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.272512 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.272649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.272780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.272919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.273049 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.273178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.273307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.273438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.273562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.273647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.273833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.273917 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.293294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.293485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.293569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.293678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.298734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.299046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.302783 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.302886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.303083 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.303168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.308127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.308214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.311876 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.311967 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.315678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.315765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.315982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.316079 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.316274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.316366 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.316552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.316643 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.316847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.316930 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.317129 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.317212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.336364 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.336539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.336742 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.336915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.336999 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.337185 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.337270 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.337467 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.345821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.345975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.347578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.347733 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.347857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.348007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.350949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.351110 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.351231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.351400 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.351527 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.351700 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.351810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.351983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.352096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.352269 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.366267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.366583 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.366676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.366867 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.366952 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.367164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.367253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.367429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.367522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.367713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.367796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.367984 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.368065 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.368265 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.387801 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.388210 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.391740 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.392148 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.395103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.395522 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.396727 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.397147 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.398421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.398701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.398824 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.398991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.399107 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.399372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.407177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.407525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.408803 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.409172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.412103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.412394 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.412676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.412804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.412949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.413096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.413380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.413656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.422360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.422653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.422935 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.423048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.423337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.423618 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.430880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.431158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.431438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.431630 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:18:11.431718 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.431908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.431992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.432188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.432327 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.432463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.432595 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.432742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.432826 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.433034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.433132 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.433318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.433432 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.433636 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.433719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.433876 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.433964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.434096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.434316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.434423 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.434567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.434730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.434913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.435255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:18:11.473600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x565187f719c0 pid: 80335 (default app) Jul 18 10:18:11.474778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x565187f719c0 pid: 80336 (default app) Jul 18 10:18:11.477054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6222fd-a801-440e-8a85-10f1d4265dda None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:11.477351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6222fd-a801-440e-8a85-10f1d4265dda None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:11.477633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6222fd-a801-440e-8a85-10f1d4265dda None None] PATH_INFO: `/v3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:11.481883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Mon Jul 18 10:18:11 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:20.215689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a0d2e-7272-4f26-b4ba-3197c4f603a7 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:20.216222 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a0d2e-7272-4f26-b4ba-3197c4f603a7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:20.216222 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a0d2e-7272-4f26-b4ba-3197c4f603a7 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:20.221042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:20.226978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12943706-828b-434c-83c4-3baa3652f9a1 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:20.227450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12943706-828b-434c-83c4-3baa3652f9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:20.227544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12943706-828b-434c-83c4-3baa3652f9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:20.297071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: INFO dbcounter [None req-12943706-828b-434c-83c4-3baa3652f9a1 None None] Registered counter for database keystone Jul 18 10:18:20.318432 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG oslo_db.sqlalchemy.engines [None req-12943706-828b-434c-83c4-3baa3652f9a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:18:20.324729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writer thread running {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:18:20.505665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG passlib.handlers.bcrypt [None req-12943706-828b-434c-83c4-3baa3652f9a1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80335) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 10:18:20.506075 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG passlib.handlers.bcrypt [None req-12943706-828b-434c-83c4-3baa3652f9a1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80335) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 10:18:20.563187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-12943706-828b-434c-83c4-3baa3652f9a1 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:20.564814 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-12943706-828b-434c-83c4-3baa3652f9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:20.691939 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 18 10:18:20.861084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a0d2e-7272-4f26-b4ba-3197c4f603a7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:20.930489 dv-cinder-849498-1-smb devstack@keystone.service[80336]: INFO dbcounter [None req-548a0d2e-7272-4f26-b4ba-3197c4f603a7 None None] Registered counter for database keystone Jul 18 10:18:20.950716 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG oslo_db.sqlalchemy.engines [None req-548a0d2e-7272-4f26-b4ba-3197c4f603a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:18:20.958026 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writer thread running {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:18:21.075991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a0d2e-7272-4f26-b4ba-3197c4f603a7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:21.080956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a825c-1d62-4fb3-8096-b204bbb3cd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:21.081620 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a825c-1d62-4fb3-8096-b204bbb3cd54 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:21.081907 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a825c-1d62-4fb3-8096-b204bbb3cd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:21.082183 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a825c-1d62-4fb3-8096-b204bbb3cd54 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:21.090444 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a825c-1d62-4fb3-8096-b204bbb3cd54 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:21.144072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: WARNING keystone.common.rbac_enforcer.enforcer [None req-756a825c-1d62-4fb3-8096-b204bbb3cd54 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 10:18:21.144351 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a825c-1d62-4fb3-8096-b204bbb3cd54 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:21.154162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Mon Jul 18 10:18:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 10:18:21.160934 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12943706-828b-434c-83c4-3baa3652f9a1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:21.176232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12943706-828b-434c-83c4-3baa3652f9a1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:21.180660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a96e0-ae90-45f5-869b-c84cf896bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:21.181770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a96e0-ae90-45f5-869b-c84cf896bf96 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:21.182054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a96e0-ae90-45f5-869b-c84cf896bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:21.182343 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a96e0-ae90-45f5-869b-c84cf896bf96 admin admin] PATH_INFO: `/v3/projects/bd97299e4fa148ce8ed40c106d7096bc` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:21.183831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a96e0-ae90-45f5-869b-c84cf896bf96 admin admin] RBAC: Authorizing `identity:get_project(project_id=bd97299e4fa148ce8ed40c106d7096bc)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:21.239792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a91a96e0-ae90-45f5-869b-c84cf896bf96 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 10:18:21.240401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a96e0-ae90-45f5-869b-c84cf896bf96 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:21.244737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Mon Jul 18 10:18:21 2022] GET /identity/v3/projects/bd97299e4fa148ce8ed40c106d7096bc => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:23.257561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a66b54-e25b-44d0-a7ab-2eaefce65eb0 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:23.258435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a66b54-e25b-44d0-a7ab-2eaefce65eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:23.258537 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a66b54-e25b-44d0-a7ab-2eaefce65eb0 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:23.262930 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:23.268814 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0c42e-2543-4480-b55b-8df300be1cfb None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:23.269233 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0c42e-2543-4480-b55b-8df300be1cfb None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:23.269366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0c42e-2543-4480-b55b-8df300be1cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:23.289106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-04d0c42e-2543-4480-b55b-8df300be1cfb None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:23.290659 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-04d0c42e-2543-4480-b55b-8df300be1cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:23.298857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 18 10:18:23.323636 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a66b54-e25b-44d0-a7ab-2eaefce65eb0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:23.336758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a66b54-e25b-44d0-a7ab-2eaefce65eb0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:23.341115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f54342-0e88-4384-b11d-b5bcd2987a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:23.341756 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f54342-0e88-4384-b11d-b5bcd2987a83 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:23.342098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f54342-0e88-4384-b11d-b5bcd2987a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:23.342415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f54342-0e88-4384-b11d-b5bcd2987a83 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:23.350744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f54342-0e88-4384-b11d-b5bcd2987a83 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:23.352536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f54342-0e88-4384-b11d-b5bcd2987a83 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:23.362738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Mon Jul 18 10:18:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 10:18:23.368489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0c42e-2543-4480-b55b-8df300be1cfb None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:23.378499 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0c42e-2543-4480-b55b-8df300be1cfb None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:23.383217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d92d7-cb5f-47bb-8cea-608b53c76947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:23.384106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d92d7-cb5f-47bb-8cea-608b53c76947 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:23.384395 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d92d7-cb5f-47bb-8cea-608b53c76947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:23.384671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d92d7-cb5f-47bb-8cea-608b53c76947 admin admin] PATH_INFO: `/v3/users/7af289109e3a4eaf8ae29a4b13dcfb4d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:23.386076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d92d7-cb5f-47bb-8cea-608b53c76947 admin admin] RBAC: Authorizing `identity:get_user(user_id=7af289109e3a4eaf8ae29a4b13dcfb4d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:23.387969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d92d7-cb5f-47bb-8cea-608b53c76947 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:23.389568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Mon Jul 18 10:18:23 2022] GET /identity/v3/users/7af289109e3a4eaf8ae29a4b13dcfb4d => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:25.476739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff39ca-d56c-4c23-95b3-377fb183e320 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:25.477300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff39ca-d56c-4c23-95b3-377fb183e320 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:25.477300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff39ca-d56c-4c23-95b3-377fb183e320 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:25.478708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:25.484973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d08663-44fe-4e66-9c83-56892d0ccd28 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:25.485467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d08663-44fe-4e66-9c83-56892d0ccd28 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:25.485567 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d08663-44fe-4e66-9c83-56892d0ccd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:25.505069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d3d08663-44fe-4e66-9c83-56892d0ccd28 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:25.506365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d3d08663-44fe-4e66-9c83-56892d0ccd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:25.516726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbc120-3c74-40c7-9cc7-4386a4c11a3e None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:25.517048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbc120-3c74-40c7-9cc7-4386a4c11a3e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:25.517589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbc120-3c74-40c7-9cc7-4386a4c11a3e None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:25.518995 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:18:25.524355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda6bb6-bed5-4b10-96cf-3616419b8eae None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:25.524660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda6bb6-bed5-4b10-96cf-3616419b8eae None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:25.524925 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda6bb6-bed5-4b10-96cf-3616419b8eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:25.577872 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG passlib.handlers.bcrypt [None req-2dda6bb6-bed5-4b10-96cf-3616419b8eae None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80336) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 10:18:25.578312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG passlib.handlers.bcrypt [None req-2dda6bb6-bed5-4b10-96cf-3616419b8eae None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80336) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 10:18:25.594206 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:18:25.621716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d08663-44fe-4e66-9c83-56892d0ccd28 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:25.625613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2dda6bb6-bed5-4b10-96cf-3616419b8eae None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:25.627263 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2dda6bb6-bed5-4b10-96cf-3616419b8eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:25.645655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:25.732095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:18:25.732843 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d08663-44fe-4e66-9c83-56892d0ccd28 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:25.754199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda6bb6-bed5-4b10-96cf-3616419b8eae None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:25.768016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f31cc-ee3a-45ff-a124-d653953ace9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:25.768812 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f31cc-ee3a-45ff-a124-d653953ace9c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:25.769100 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f31cc-ee3a-45ff-a124-d653953ace9c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:25.769475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f31cc-ee3a-45ff-a124-d653953ace9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:25.782617 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f31cc-ee3a-45ff-a124-d653953ace9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-d52f31cc-ee3a-45ff-a124-d653953ace9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:25.793967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:25.795204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:25.796193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:25.796193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:25.796193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:25.796193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:25.796193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:25.796193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:25.796193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:25.796193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:25.796193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:25.796193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:25.796193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:25.796193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:18:25.796193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:18:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:18:25.801187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f31cc-ee3a-45ff-a124-d653953ace9c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:25.862388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda6bb6-bed5-4b10-96cf-3616419b8eae None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:25.865551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:25.886813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:25.904713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf60abd-3684-417f-aa25-535e6c72d545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:25.905659 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf60abd-3684-417f-aa25-535e6c72d545 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:25.905945 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf60abd-3684-417f-aa25-535e6c72d545 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:25.906034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f31cc-ee3a-45ff-a124-d653953ace9c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:25.906218 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf60abd-3684-417f-aa25-535e6c72d545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:25.944096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5cd87-24d4-4c2a-bc6b-e99c79b967fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:25.944761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5cd87-24d4-4c2a-bc6b-e99c79b967fc None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:25.945043 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5cd87-24d4-4c2a-bc6b-e99c79b967fc None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:25.945317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5cd87-24d4-4c2a-bc6b-e99c79b967fc None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:25.946067 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5cd87-24d4-4c2a-bc6b-e99c79b967fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:25.946397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5cd87-24d4-4c2a-bc6b-e99c79b967fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:25.947800 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5cd87-24d4-4c2a-bc6b-e99c79b967fc None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:25.960013 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:25.965482 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5cd87-24d4-4c2a-bc6b-e99c79b967fc None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:25.981482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf60abd-3684-417f-aa25-535e6c72d545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:25.983757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf60abd-3684-417f-aa25-535e6c72d545 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:26.068144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5cd87-24d4-4c2a-bc6b-e99c79b967fc None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:26.083018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:18:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 10:18:26.088574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf60abd-3684-417f-aa25-535e6c72d545 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:26.091328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:26.103239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95035575-c83c-4a98-8696-759c21c0728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:26.114188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95035575-c83c-4a98-8696-759c21c0728f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:26.114188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95035575-c83c-4a98-8696-759c21c0728f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:26.114188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95035575-c83c-4a98-8696-759c21c0728f None admin] PATH_INFO: `/v3/users/7af289109e3a4eaf8ae29a4b13dcfb4d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:26.114188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95035575-c83c-4a98-8696-759c21c0728f None admin] RBAC: Authorizing `identity:get_user(user_id=7af289109e3a4eaf8ae29a4b13dcfb4d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:26.114188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95035575-c83c-4a98-8696-759c21c0728f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:26.114188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:25 2022] GET /identity/v3/users/7af289109e3a4eaf8ae29a4b13dcfb4d => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:26.115207 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95035575-c83c-4a98-8696-759c21c0728f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:26.130118 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:26.190042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf60abd-3684-417f-aa25-535e6c72d545 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:26.214755 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95035575-c83c-4a98-8696-759c21c0728f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:26.224256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86890a-6ceb-497f-97d0-cd6d7eb20d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:26.225051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86890a-6ceb-497f-97d0-cd6d7eb20d70 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:26.225342 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86890a-6ceb-497f-97d0-cd6d7eb20d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:26.225617 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86890a-6ceb-497f-97d0-cd6d7eb20d70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:26.246107 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86890a-6ceb-497f-97d0-cd6d7eb20d70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:26.247550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86890a-6ceb-497f-97d0-cd6d7eb20d70 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:26.249647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c39be-2fa6-49b3-b3b2-11123d547511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:26.250467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c39be-2fa6-49b3-b3b2-11123d547511 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:26.250749 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c39be-2fa6-49b3-b3b2-11123d547511 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:26.251020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c39be-2fa6-49b3-b3b2-11123d547511 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:26.252251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c39be-2fa6-49b3-b3b2-11123d547511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:26.253684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c39be-2fa6-49b3-b3b2-11123d547511 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:26.255357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:18:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:26.261327 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c39be-2fa6-49b3-b3b2-11123d547511 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:26.269321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-8d86890a-6ceb-497f-97d0-cd6d7eb20d70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:18:26.269321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:26.269321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:26.269321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:26.269321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:26.269321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:26.269321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:26.269321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:26.269321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:26.269321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:26.269321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:26.269321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:26.269321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:18:26.269321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:18:26.269321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:26.270355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:26.271193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:18:26.271193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:18:26.271193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:18:26.271193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:18:26.271193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:18:26.276556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86890a-6ceb-497f-97d0-cd6d7eb20d70 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:26.336120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:26.345322 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:26.364167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c39be-2fa6-49b3-b3b2-11123d547511 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:26.381519 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86890a-6ceb-497f-97d0-cd6d7eb20d70 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:26.399517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72545e-4242-4211-b4c5-b20097370b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:26.400179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72545e-4242-4211-b4c5-b20097370b07 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:26.400459 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72545e-4242-4211-b4c5-b20097370b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:26.400733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72545e-4242-4211-b4c5-b20097370b07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:26.401567 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72545e-4242-4211-b4c5-b20097370b07 None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.domain.id=default, user.id=7af289109e3a4eaf8ae29a4b13dcfb4d) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:26.401872 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72545e-4242-4211-b4c5-b20097370b07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:26.403337 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72545e-4242-4211-b4c5-b20097370b07 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:26.410800 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Mon Jul 18 10:18:26 2022] GET /identity/v3/role_assignments?user.id=7af289109e3a4eaf8ae29a4b13dcfb4d&scope.domain.id=default&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:26.415853 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b6542-a271-468a-baee-405a6b1578f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:26.416568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b6542-a271-468a-baee-405a6b1578f8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:26.416855 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b6542-a271-468a-baee-405a6b1578f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:26.417137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b6542-a271-468a-baee-405a6b1578f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:26.417892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b6542-a271-468a-baee-405a6b1578f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:26.418206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b6542-a271-468a-baee-405a6b1578f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:26.419721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b6542-a271-468a-baee-405a6b1578f8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:26.442126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:28.775700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d919-b11d-4764-99d7-780dd1eb2883 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:28.776286 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d919-b11d-4764-99d7-780dd1eb2883 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:28.776286 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d919-b11d-4764-99d7-780dd1eb2883 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:28.777894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:28.786606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ac7c3-ab88-4a97-86de-0d1127df98c0 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:28.787138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ac7c3-ab88-4a97-86de-0d1127df98c0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:28.787138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ac7c3-ab88-4a97-86de-0d1127df98c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:28.811971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e99ac7c3-ab88-4a97-86de-0d1127df98c0 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:28.813205 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e99ac7c3-ab88-4a97-86de-0d1127df98c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:28.915519 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:28.946776 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3d919-b11d-4764-99d7-780dd1eb2883 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:29.140038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3d919-b11d-4764-99d7-780dd1eb2883 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:29.195127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab232a-d184-449c-b367-0fb60c398bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:29.196123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab232a-d184-449c-b367-0fb60c398bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:29.196419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab232a-d184-449c-b367-0fb60c398bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:29.196701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab232a-d184-449c-b367-0fb60c398bc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:29.213159 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab232a-d184-449c-b367-0fb60c398bc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-01ab232a-d184-449c-b367-0fb60c398bc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:29.221647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:29.222581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:29.223350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:29.223350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:29.223350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:29.223350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:29.223350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:29.223350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:29.223350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:29.223350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:29.223350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:29.223350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:29.223350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:29.223350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:18:29.223350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 13/24] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:18:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:29.229010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ac7c3-ab88-4a97-86de-0d1127df98c0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:29.242490 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b04ae-7a5a-461e-b61c-7e81e37b98aa None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:29.242808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b04ae-7a5a-461e-b61c-7e81e37b98aa None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:29.243064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b04ae-7a5a-461e-b61c-7e81e37b98aa None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:29.244531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 14/25] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:18:29.260130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191190d-d175-4ba4-b40e-ad136df187eb None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:29.260439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191190d-d175-4ba4-b40e-ad136df187eb None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:29.260698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191190d-d175-4ba4-b40e-ad136df187eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:29.274675 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:29.295628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6191190d-d175-4ba4-b40e-ad136df187eb None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:29.302244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6191190d-d175-4ba4-b40e-ad136df187eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:29.348499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:29.429996 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 15/26] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:18:29.433875 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c17de1-f38f-456e-aab4-6e8bccd2b53e None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:29.436420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c17de1-f38f-456e-aab4-6e8bccd2b53e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:29.438209 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c17de1-f38f-456e-aab4-6e8bccd2b53e None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:29.439807 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 16/27] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:29.447837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e3a6-9551-4578-8092-facd4623b05d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:29.448418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e3a6-9551-4578-8092-facd4623b05d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:29.448910 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e3a6-9551-4578-8092-facd4623b05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:29.472719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ac7c3-ab88-4a97-86de-0d1127df98c0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:29.476287 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7637e3a6-9551-4578-8092-facd4623b05d None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:29.477587 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7637e3a6-9551-4578-8092-facd4623b05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:29.522421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51198bc5-322f-4589-a9a2-fd8cea643ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:29.523184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51198bc5-322f-4589-a9a2-fd8cea643ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:29.523470 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51198bc5-322f-4589-a9a2-fd8cea643ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:29.523746 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51198bc5-322f-4589-a9a2-fd8cea643ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:29.524577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51198bc5-322f-4589-a9a2-fd8cea643ca0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:29.524885 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51198bc5-322f-4589-a9a2-fd8cea643ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:29.526336 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51198bc5-322f-4589-a9a2-fd8cea643ca0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:29.539913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 12/28] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:29.545847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51198bc5-322f-4589-a9a2-fd8cea643ca0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:29.587372 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 17/29] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:18:29.589161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad6863-fea0-4ad0-9a44-bdcf7f60652c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:29.589684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad6863-fea0-4ad0-9a44-bdcf7f60652c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:29.590169 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad6863-fea0-4ad0-9a44-bdcf7f60652c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:29.591964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 18/30] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:29.593003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad6863-fea0-4ad0-9a44-bdcf7f60652c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:29.689499 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:29.691780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51198bc5-322f-4589-a9a2-fd8cea643ca0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:29.703073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:29.731167 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0f625-b061-4b1e-965d-d68c58aa3242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:29.731816 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0f625-b061-4b1e-965d-d68c58aa3242 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:29.732120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0f625-b061-4b1e-965d-d68c58aa3242 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:29.732484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0f625-b061-4b1e-965d-d68c58aa3242 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:29.733471 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0f625-b061-4b1e-965d-d68c58aa3242 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:29.735332 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0f625-b061-4b1e-965d-d68c58aa3242 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:29.739199 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad6863-fea0-4ad0-9a44-bdcf7f60652c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:29.785687 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9340d14-b31a-4c7b-9e0c-acdeb017a5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:29.786639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9340d14-b31a-4c7b-9e0c-acdeb017a5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:29.786929 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9340d14-b31a-4c7b-9e0c-acdeb017a5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:29.787207 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9340d14-b31a-4c7b-9e0c-acdeb017a5f4 None admin] PATH_INFO: `/v3/users/7af289109e3a4eaf8ae29a4b13dcfb4d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:29.788475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9340d14-b31a-4c7b-9e0c-acdeb017a5f4 None admin] RBAC: Authorizing `identity:get_user(user_id=7af289109e3a4eaf8ae29a4b13dcfb4d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:29.789948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9340d14-b31a-4c7b-9e0c-acdeb017a5f4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:29.796978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 19/31] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:29 2022] GET /identity/v3/users/7af289109e3a4eaf8ae29a4b13dcfb4d => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:29.796978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2f6f8-9cf3-4473-9e9b-1df986874584 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:29.796978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2f6f8-9cf3-4473-9e9b-1df986874584 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:29.796978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2f6f8-9cf3-4473-9e9b-1df986874584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:29.814579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-09d2f6f8-9cf3-4473-9e9b-1df986874584 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:29.815796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-09d2f6f8-9cf3-4473-9e9b-1df986874584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:29.899822 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 20/32] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:29.901013 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2f6f8-9cf3-4473-9e9b-1df986874584 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:29.974736 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 13/33] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jul 18 10:18:29 2022] POST /identity/v3/roles => generated 225 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:18:29.976395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0f625-b061-4b1e-965d-d68c58aa3242 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:29.980941 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:30.037095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2f6f8-9cf3-4473-9e9b-1df986874584 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:30.089075 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb30286-ebea-4f05-8086-1258611a7e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:30.090678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb30286-ebea-4f05-8086-1258611a7e96 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:30.090935 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb30286-ebea-4f05-8086-1258611a7e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:30.091227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb30286-ebea-4f05-8086-1258611a7e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:30.105127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb30286-ebea-4f05-8086-1258611a7e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:30.107220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb30286-ebea-4f05-8086-1258611a7e96 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:30.128244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-4fb30286-ebea-4f05-8086-1258611a7e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:18:30.128244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:30.128244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:30.128244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:30.128244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:30.128244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:30.128244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:30.128244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:30.128244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:30.128244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:30.128244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:30.128244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:30.128244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:18:30.128244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:18:30.128244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:30.129146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:30.129945 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:18:30.129945 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:18:30.129945 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:18:30.129945 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:18:30.129945 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 21/34] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:30.131103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb30286-ebea-4f05-8086-1258611a7e96 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:30.156313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0f625-b061-4b1e-965d-d68c58aa3242 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:30.198437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e21124-7849-4000-b86b-422139471946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:30.199745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e21124-7849-4000-b86b-422139471946 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:30.200257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e21124-7849-4000-b86b-422139471946 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:30.200745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e21124-7849-4000-b86b-422139471946 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:30.203388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e21124-7849-4000-b86b-422139471946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:30.205390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e21124-7849-4000-b86b-422139471946 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:30.207902 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 14/35] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:18:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:30.209111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e8dd7-2777-4dd8-8d02-5d4424a9db2c None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:30.209401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e8dd7-2777-4dd8-8d02-5d4424a9db2c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:30.209686 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e8dd7-2777-4dd8-8d02-5d4424a9db2c None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:30.215870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 15/36] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:30.218271 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e8dd7-2777-4dd8-8d02-5d4424a9db2c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:30.258172 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb30286-ebea-4f05-8086-1258611a7e96 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:30.267585 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:30.273691 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:30.298031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2715fc-df2d-4755-bb60-34b371beaf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:30.298979 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2715fc-df2d-4755-bb60-34b371beaf58 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:30.299496 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2715fc-df2d-4755-bb60-34b371beaf58 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:30.299856 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2715fc-df2d-4755-bb60-34b371beaf58 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:30.300630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2715fc-df2d-4755-bb60-34b371beaf58 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:30.302051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2715fc-df2d-4755-bb60-34b371beaf58 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:30.345019 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e8dd7-2777-4dd8-8d02-5d4424a9db2c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:30.381058 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f5c41-5501-4a90-ad18-f70e4cb7e4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:30.381806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f5c41-5501-4a90-ad18-f70e4cb7e4cc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:30.382101 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f5c41-5501-4a90-ad18-f70e4cb7e4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:30.382410 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f5c41-5501-4a90-ad18-f70e4cb7e4cc None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:30.383545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f5c41-5501-4a90-ad18-f70e4cb7e4cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:30.383864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f5c41-5501-4a90-ad18-f70e4cb7e4cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:30.385295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f5c41-5501-4a90-ad18-f70e4cb7e4cc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:30.401739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 16/37] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:30.401739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f5c41-5501-4a90-ad18-f70e4cb7e4cc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:30.504366 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:30.515117 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f5c41-5501-4a90-ad18-f70e4cb7e4cc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:30.558682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da59f7c-4802-433b-b142-59b87d7b95b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:30.559589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da59f7c-4802-433b-b142-59b87d7b95b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:30.559881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da59f7c-4802-433b-b142-59b87d7b95b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:30.560168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da59f7c-4802-433b-b142-59b87d7b95b0 None admin] PATH_INFO: `/v3/domains/default/users/7af289109e3a4eaf8ae29a4b13dcfb4d/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:30.563560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da59f7c-4802-433b-b142-59b87d7b95b0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7af289109e3a4eaf8ae29a4b13dcfb4d, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:30.565066 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da59f7c-4802-433b-b142-59b87d7b95b0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:30.589928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 22/38] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jul 18 10:18:30 2022] POST /identity/v3/roles => generated 219 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:18:30.591438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1503c7-3979-4a8b-b5d8-ccfee4bd3b95 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:30.592441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1503c7-3979-4a8b-b5d8-ccfee4bd3b95 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:30.592705 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1503c7-3979-4a8b-b5d8-ccfee4bd3b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:30.616422 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8a1503c7-3979-4a8b-b5d8-ccfee4bd3b95 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:30.618057 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8a1503c7-3979-4a8b-b5d8-ccfee4bd3b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:30.670279 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 17/39] 10.222.0.16 () {58 vars in 1361 bytes} [Mon Jul 18 10:18:30 2022] PUT /identity/v3/domains/default/users/7af289109e3a4eaf8ae29a4b13dcfb4d/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:18:30.671441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da59f7c-4802-433b-b142-59b87d7b95b0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:30.719393 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 23/40] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:30.721498 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2c923-cda4-4dfc-b8df-b9ec5d176bad None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:30.722008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2c923-cda4-4dfc-b8df-b9ec5d176bad None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:30.722528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2c923-cda4-4dfc-b8df-b9ec5d176bad None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:30.724462 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 24/41] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:30.736106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53e65b-25a2-4c0b-b924-a9ee8dbb7809 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:30.736577 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53e65b-25a2-4c0b-b924-a9ee8dbb7809 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:30.737664 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53e65b-25a2-4c0b-b924-a9ee8dbb7809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:30.767358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7e53e65b-25a2-4c0b-b924-a9ee8dbb7809 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:30.768575 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7e53e65b-25a2-4c0b-b924-a9ee8dbb7809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:30.848803 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da59f7c-4802-433b-b142-59b87d7b95b0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:30.874416 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 25/42] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:30.875923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53e65b-25a2-4c0b-b924-a9ee8dbb7809 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:30.892657 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e52cb-ea6d-4d54-9115-1ff62ee7ec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:30.893455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e52cb-ea6d-4d54-9115-1ff62ee7ec59 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:30.893741 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e52cb-ea6d-4d54-9115-1ff62ee7ec59 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:30.894016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e52cb-ea6d-4d54-9115-1ff62ee7ec59 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:30.894790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e52cb-ea6d-4d54-9115-1ff62ee7ec59 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:30.896261 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e52cb-ea6d-4d54-9115-1ff62ee7ec59 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:30.917804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:30.988288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53e65b-25a2-4c0b-b924-a9ee8dbb7809 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:31.009157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 18/43] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 18 10:18:30 2022] POST /identity/v3/projects => generated 301 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:18:31.016172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e52cb-ea6d-4d54-9115-1ff62ee7ec59 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:31.028979 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c81d9-c346-4f44-bdd7-ccbf4c917850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:31.030304 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c81d9-c346-4f44-bdd7-ccbf4c917850 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:31.030885 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c81d9-c346-4f44-bdd7-ccbf4c917850 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:31.031193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c81d9-c346-4f44-bdd7-ccbf4c917850 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:31.032144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c81d9-c346-4f44-bdd7-ccbf4c917850 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:31.033779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c81d9-c346-4f44-bdd7-ccbf4c917850 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:31.039562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:31.111540 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 26/44] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jul 18 10:18:30 2022] POST /identity/v3/roles => generated 223 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:18:31.169509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e52cb-ea6d-4d54-9115-1ff62ee7ec59 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:31.213316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c45e8d-1a16-4f77-a836-3650fbf08339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:31.214458 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c45e8d-1a16-4f77-a836-3650fbf08339 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:31.214904 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c45e8d-1a16-4f77-a836-3650fbf08339 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:31.215436 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c45e8d-1a16-4f77-a836-3650fbf08339 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:31.218205 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c45e8d-1a16-4f77-a836-3650fbf08339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:31.220106 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c45e8d-1a16-4f77-a836-3650fbf08339 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:31.222500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 19/45] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:18:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:31.228561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c81d9-c346-4f44-bdd7-ccbf4c917850 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:31.345327 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:31.351593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c81d9-c346-4f44-bdd7-ccbf4c917850 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:31.388251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec272c-f86e-4d6a-90e7-66549945a1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:31.388987 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec272c-f86e-4d6a-90e7-66549945a1d8 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:31.389322 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec272c-f86e-4d6a-90e7-66549945a1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:31.389608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec272c-f86e-4d6a-90e7-66549945a1d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:31.390360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec272c-f86e-4d6a-90e7-66549945a1d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:31.391854 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec272c-f86e-4d6a-90e7-66549945a1d8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:31.510354 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 27/46] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 18 10:18:31 2022] POST /identity/v3/projects => generated 312 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:18:32.803060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50c5ad-5646-40fd-b6a1-1855f4e14db1 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:32.803613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50c5ad-5646-40fd-b6a1-1855f4e14db1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:32.803613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50c5ad-5646-40fd-b6a1-1855f4e14db1 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:32.804984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 20/47] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:32.810378 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ce5c9-ce34-445c-94f4-e690d423162b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:32.811272 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ce5c9-ce34-445c-94f4-e690d423162b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:32.811582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ce5c9-ce34-445c-94f4-e690d423162b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:32.828807 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-632ce5c9-ce34-445c-94f4-e690d423162b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:32.830024 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-632ce5c9-ce34-445c-94f4-e690d423162b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:32.898365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 28/48] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:32.924215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50c5ad-5646-40fd-b6a1-1855f4e14db1 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:33.015306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:33.039003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50c5ad-5646-40fd-b6a1-1855f4e14db1 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:33.075245 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f3f95-8676-4627-867a-5d91144d9c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:33.075957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f3f95-8676-4627-867a-5d91144d9c44 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:33.076316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f3f95-8676-4627-867a-5d91144d9c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:33.076594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f3f95-8676-4627-867a-5d91144d9c44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:33.089784 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f3f95-8676-4627-867a-5d91144d9c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-9f5f3f95-8676-4627-867a-5d91144d9c44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:33.099994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:33.100950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:33.102004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:33.102004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:33.102004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:33.102004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:33.102004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:33.102004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:33.102004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:33.102004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:33.102004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:33.102004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:33.102004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:33.102004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:18:33.102004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 21/49] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:18:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:33.107357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ce5c9-ce34-445c-94f4-e690d423162b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:33.185582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:33.208820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ce5c9-ce34-445c-94f4-e690d423162b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:33.243561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ce5ca-af26-40b5-9946-e495b3537c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:33.244229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ce5ca-af26-40b5-9946-e495b3537c44 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:33.244515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ce5ca-af26-40b5-9946-e495b3537c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:33.244797 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ce5ca-af26-40b5-9946-e495b3537c44 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:33.245661 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ce5ca-af26-40b5-9946-e495b3537c44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:33.246451 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ce5ca-af26-40b5-9946-e495b3537c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:33.248966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ce5ca-af26-40b5-9946-e495b3537c44 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:33.257343 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 29/50] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:33.263078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f3f95-8676-4627-867a-5d91144d9c44 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:33.364993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f3f95-8676-4627-867a-5d91144d9c44 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:33.399943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d7fa9-6cda-4c14-b35c-72c613187140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:33.400816 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d7fa9-6cda-4c14-b35c-72c613187140 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:33.401104 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d7fa9-6cda-4c14-b35c-72c613187140 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:33.401383 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d7fa9-6cda-4c14-b35c-72c613187140 None admin] PATH_INFO: `/v3/users/7af289109e3a4eaf8ae29a4b13dcfb4d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:33.402622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d7fa9-6cda-4c14-b35c-72c613187140 None admin] RBAC: Authorizing `identity:get_user(user_id=7af289109e3a4eaf8ae29a4b13dcfb4d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:33.404097 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d7fa9-6cda-4c14-b35c-72c613187140 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:33.405782 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 22/51] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:33 2022] GET /identity/v3/users/7af289109e3a4eaf8ae29a4b13dcfb4d => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:33.411297 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ce5ca-af26-40b5-9946-e495b3537c44 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:33.520232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ce5ca-af26-40b5-9946-e495b3537c44 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:33.549319 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bea54d-68d2-4957-9a19-6ae297b1d400 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:33.549619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bea54d-68d2-4957-9a19-6ae297b1d400 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:33.549974 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bea54d-68d2-4957-9a19-6ae297b1d400 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:33.551339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 23/52] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:18:33.553093 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893ea34-f7d1-4007-9ce0-040ab988c485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:33.553887 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893ea34-f7d1-4007-9ce0-040ab988c485 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:33.554171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893ea34-f7d1-4007-9ce0-040ab988c485 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:33.554485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893ea34-f7d1-4007-9ce0-040ab988c485 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:33.555788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893ea34-f7d1-4007-9ce0-040ab988c485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:33.556381 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eedcc-40de-48fb-bb62-d5453edf8887 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:33.556676 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eedcc-40de-48fb-bb62-d5453edf8887 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:33.556959 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eedcc-40de-48fb-bb62-d5453edf8887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:33.557253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893ea34-f7d1-4007-9ce0-040ab988c485 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:33.562230 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 30/53] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:18:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:33.563584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:33.565270 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893ea34-f7d1-4007-9ce0-040ab988c485 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:33.574374 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:33.574818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-794eedcc-40de-48fb-bb62-d5453edf8887 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:33.576930 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-794eedcc-40de-48fb-bb62-d5453edf8887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:33.651093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 24/54] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:18:33.672760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893ea34-f7d1-4007-9ce0-040ab988c485 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:33.673619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794eedcc-40de-48fb-bb62-d5453edf8887 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:33.708231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9aa305-3c59-42c1-955e-f39507716bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:33.708895 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aa305-3c59-42c1-955e-f39507716bcb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:33.709184 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aa305-3c59-42c1-955e-f39507716bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:33.709462 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aa305-3c59-42c1-955e-f39507716bcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:33.710300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9aa305-3c59-42c1-955e-f39507716bcb None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.domain.id=default, user.id=7af289109e3a4eaf8ae29a4b13dcfb4d) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:33.710645 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9aa305-3c59-42c1-955e-f39507716bcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:33.712111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9aa305-3c59-42c1-955e-f39507716bcb None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:33.718346 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 31/55] 10.222.0.16 () {56 vars in 1322 bytes} [Mon Jul 18 10:18:33 2022] GET /identity/v3/role_assignments?user.id=7af289109e3a4eaf8ae29a4b13dcfb4d&scope.domain.id=default&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:33.782446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794eedcc-40de-48fb-bb62-d5453edf8887 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:33.930035 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640e375-6189-4b55-9b1f-99df1661f16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:33.930832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640e375-6189-4b55-9b1f-99df1661f16c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:33.931124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640e375-6189-4b55-9b1f-99df1661f16c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:33.931408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640e375-6189-4b55-9b1f-99df1661f16c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:33.932623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640e375-6189-4b55-9b1f-99df1661f16c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:33.934108 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640e375-6189-4b55-9b1f-99df1661f16c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:33.936094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 25/56] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:18:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:33.941777 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9aa305-3c59-42c1-955e-f39507716bcb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:34.011909 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:34.044508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9aa305-3c59-42c1-955e-f39507716bcb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:34.077586 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88769b-d5be-4873-af8d-0895a4b4b467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:34.078247 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88769b-d5be-4873-af8d-0895a4b4b467 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:34.078568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88769b-d5be-4873-af8d-0895a4b4b467 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:34.078848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88769b-d5be-4873-af8d-0895a4b4b467 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:34.079559 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88769b-d5be-4873-af8d-0895a4b4b467 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:34.081019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88769b-d5be-4873-af8d-0895a4b4b467 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:34.162722 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 32/57] 10.222.0.16 () {60 vars in 1140 bytes} [Mon Jul 18 10:18:33 2022] POST /identity/v3/projects => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:18:36.171650 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0d535-a919-4182-904c-e198b6bfcb80 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:36.172163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0d535-a919-4182-904c-e198b6bfcb80 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:36.172247 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0d535-a919-4182-904c-e198b6bfcb80 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:36.173595 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 26/58] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:36.178958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369c818-2d9e-49d5-b047-d64c467a2552 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:36.179388 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369c818-2d9e-49d5-b047-d64c467a2552 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:36.179519 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369c818-2d9e-49d5-b047-d64c467a2552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:36.196353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2369c818-2d9e-49d5-b047-d64c467a2552 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:36.197537 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2369c818-2d9e-49d5-b047-d64c467a2552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:36.263077 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 33/59] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:36.286605 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0d535-a919-4182-904c-e198b6bfcb80 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:36.289489 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:36.387134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0d535-a919-4182-904c-e198b6bfcb80 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:36.430464 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c910c-2318-4fc0-9494-1033e5d4d060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:36.431389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c910c-2318-4fc0-9494-1033e5d4d060 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:36.431726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c910c-2318-4fc0-9494-1033e5d4d060 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:36.432058 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c910c-2318-4fc0-9494-1033e5d4d060 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:36.433529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c910c-2318-4fc0-9494-1033e5d4d060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:36.436703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c910c-2318-4fc0-9494-1033e5d4d060 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:36.438859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 27/60] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:18:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:36.444483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369c818-2d9e-49d5-b047-d64c467a2552 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:36.500837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:36.548389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369c818-2d9e-49d5-b047-d64c467a2552 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:36.581293 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d4d43-2446-4629-821e-2c3bc0767994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:36.581968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d4d43-2446-4629-821e-2c3bc0767994 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:36.582254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d4d43-2446-4629-821e-2c3bc0767994 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:36.582562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d4d43-2446-4629-821e-2c3bc0767994 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:36.583282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d4d43-2446-4629-821e-2c3bc0767994 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:36.584733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d4d43-2446-4629-821e-2c3bc0767994 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:36.733097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 34/61] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:18:36 2022] POST /identity/v3/users => generated 275 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:18:40.012807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0934bee-d592-4032-830f-df4210e62959 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:40.014079 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0934bee-d592-4032-830f-df4210e62959 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:40.014702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0934bee-d592-4032-830f-df4210e62959 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:40.016421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 28/62] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:40.022269 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a74bb-5c8c-4094-8c12-c3e70a32bdc3 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:40.023200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a74bb-5c8c-4094-8c12-c3e70a32bdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:40.023684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a74bb-5c8c-4094-8c12-c3e70a32bdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:40.051574 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-723a74bb-5c8c-4094-8c12-c3e70a32bdc3 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:40.053194 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-723a74bb-5c8c-4094-8c12-c3e70a32bdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:40.151685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 35/63] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:40.194341 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0934bee-d592-4032-830f-df4210e62959 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:40.295630 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:40.335464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2f3cd-570e-400f-ae57-dfac16d3cf3c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:40.335799 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2f3cd-570e-400f-ae57-dfac16d3cf3c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:40.336038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2f3cd-570e-400f-ae57-dfac16d3cf3c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:40.337434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 36/64] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:18:40.337962 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0934bee-d592-4032-830f-df4210e62959 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:40.342509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2f887-8883-4183-a032-c6ddd9df3e91 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:40.342798 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2f887-8883-4183-a032-c6ddd9df3e91 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:40.343085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2f887-8883-4183-a032-c6ddd9df3e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:40.367631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-88f2f887-8883-4183-a032-c6ddd9df3e91 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:40.368854 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-88f2f887-8883-4183-a032-c6ddd9df3e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:40.410986 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df4b1b-ddb4-4f29-a4d0-1fb95749cf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:40.411952 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df4b1b-ddb4-4f29-a4d0-1fb95749cf0f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:40.412240 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df4b1b-ddb4-4f29-a4d0-1fb95749cf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:40.412517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df4b1b-ddb4-4f29-a4d0-1fb95749cf0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:40.418001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:40.426345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df4b1b-ddb4-4f29-a4d0-1fb95749cf0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-c7df4b1b-ddb4-4f29-a4d0-1fb95749cf0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:40.435372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:40.436775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:40.437575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:40.437575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:40.437575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:40.437575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:40.437575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:40.437575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:40.437575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:40.437575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:40.437575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:40.437575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:40.437575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:18:40.437575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:18:40.439008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 29/65] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:40.440549 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877c568-e5d3-4f02-8287-2d3a4f6ab448 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:40.441063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877c568-e5d3-4f02-8287-2d3a4f6ab448 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:40.441566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877c568-e5d3-4f02-8287-2d3a4f6ab448 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:40.443130 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 30/66] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:40.444853 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877c568-e5d3-4f02-8287-2d3a4f6ab448 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:40.469955 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 37/67] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:18:40.476419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9579ce-6a1c-42f7-9da1-c9eaf5a554d5 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:40.476714 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9579ce-6a1c-42f7-9da1-c9eaf5a554d5 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:40.476996 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9579ce-6a1c-42f7-9da1-c9eaf5a554d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:40.500904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-9d9579ce-6a1c-42f7-9da1-c9eaf5a554d5 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:40.502183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9d9579ce-6a1c-42f7-9da1-c9eaf5a554d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:40.567748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877c568-e5d3-4f02-8287-2d3a4f6ab448 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:40.569909 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 38/68] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:40.571296 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ceb97-2757-4a14-a8bf-a4bfc2bfb290 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:40.571591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ceb97-2757-4a14-a8bf-a4bfc2bfb290 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:40.571870 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ceb97-2757-4a14-a8bf-a4bfc2bfb290 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:40.578098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 39/69] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:40.578098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224525ff-5b1d-47db-b37a-494966ae092f None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:40.578098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224525ff-5b1d-47db-b37a-494966ae092f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:40.578098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224525ff-5b1d-47db-b37a-494966ae092f None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:40.578098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 40/70] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:40.578098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224525ff-5b1d-47db-b37a-494966ae092f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:40.604322 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:40.610826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b949f6-b5d4-4d30-8853-0c267bbf486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:40.611586 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b949f6-b5d4-4d30-8853-0c267bbf486f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:40.611873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b949f6-b5d4-4d30-8853-0c267bbf486f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:40.612157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b949f6-b5d4-4d30-8853-0c267bbf486f None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:40.612907 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b949f6-b5d4-4d30-8853-0c267bbf486f None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:40.613215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b949f6-b5d4-4d30-8853-0c267bbf486f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:40.614661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b949f6-b5d4-4d30-8853-0c267bbf486f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:40.624224 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 31/71] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:18:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:40.625602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93415cf5-f654-42ef-a2c9-98c28a4a729e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:40.625893 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93415cf5-f654-42ef-a2c9-98c28a4a729e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:40.626346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93415cf5-f654-42ef-a2c9-98c28a4a729e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:40.642707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-93415cf5-f654-42ef-a2c9-98c28a4a729e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:40.643919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-93415cf5-f654-42ef-a2c9-98c28a4a729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:40.678925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:40.683303 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224525ff-5b1d-47db-b37a-494966ae092f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:40.714067 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 32/72] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:40.715400 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ff600-59f0-43ac-bf41-4170674dabcb None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:40.715692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ff600-59f0-43ac-bf41-4170674dabcb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:40.715971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ff600-59f0-43ac-bf41-4170674dabcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:40.718244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb1aa5-16ee-498b-9017-4ae8726990af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:40.719082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb1aa5-16ee-498b-9017-4ae8726990af None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:40.719371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb1aa5-16ee-498b-9017-4ae8726990af None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:40.719777 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb1aa5-16ee-498b-9017-4ae8726990af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:40.720958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb1aa5-16ee-498b-9017-4ae8726990af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:40.722883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb1aa5-16ee-498b-9017-4ae8726990af None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:40.724251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 41/73] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:18:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:40.724925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb1aa5-16ee-498b-9017-4ae8726990af None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:40.738889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a58ff600-59f0-43ac-bf41-4170674dabcb None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:40.740082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a58ff600-59f0-43ac-bf41-4170674dabcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:40.809223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 33/74] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:40.810081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ff600-59f0-43ac-bf41-4170674dabcb None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:40.829786 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb1aa5-16ee-498b-9017-4ae8726990af None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:40.864098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1b63b-26fb-463d-8f8f-4f66101c6382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:40.864896 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1b63b-26fb-463d-8f8f-4f66101c6382 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:40.865181 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1b63b-26fb-463d-8f8f-4f66101c6382 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:40.865460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1b63b-26fb-463d-8f8f-4f66101c6382 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:40.866496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:40.876483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1b63b-26fb-463d-8f8f-4f66101c6382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-38c1b63b-26fb-463d-8f8f-4f66101c6382 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:40.884475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:40.885506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:40.891340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:40.891340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:40.891340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:40.891340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:40.891340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:40.891340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:40.891340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:40.891340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:40.891340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:40.891340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:40.891340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:40.891340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:18:40.891340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 42/75] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:18:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:40.891340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1b63b-26fb-463d-8f8f-4f66101c6382 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:40.914714 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ff600-59f0-43ac-bf41-4170674dabcb None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:40.917618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:40.953019 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03b1db-8f80-4856-bdb2-bbe8da279d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:40.953901 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03b1db-8f80-4856-bdb2-bbe8da279d11 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:40.954549 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03b1db-8f80-4856-bdb2-bbe8da279d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:40.954549 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03b1db-8f80-4856-bdb2-bbe8da279d11 None admin] PATH_INFO: `/v3/users/f2602cd3e1e84ece9b07e9808df280f2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:40.970266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03b1db-8f80-4856-bdb2-bbe8da279d11 None admin] RBAC: Authorizing `identity:get_user(user_id=f2602cd3e1e84ece9b07e9808df280f2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:40.971805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03b1db-8f80-4856-bdb2-bbe8da279d11 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:40.977976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 34/76] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:40 2022] GET /identity/v3/users/f2602cd3e1e84ece9b07e9808df280f2 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:40.977976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03b1db-8f80-4856-bdb2-bbe8da279d11 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:40.999320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1b63b-26fb-463d-8f8f-4f66101c6382 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:41.033972 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4718450-d02f-4b88-8947-8004fd064474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:41.034659 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4718450-d02f-4b88-8947-8004fd064474 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:41.034940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4718450-d02f-4b88-8947-8004fd064474 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:41.035215 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4718450-d02f-4b88-8947-8004fd064474 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:41.035925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4718450-d02f-4b88-8947-8004fd064474 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:41.037391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4718450-d02f-4b88-8947-8004fd064474 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:41.072437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03b1db-8f80-4856-bdb2-bbe8da279d11 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:41.083298 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:41.105928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b24c5-09d0-47d9-bbb2-c1a28f448558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:41.106751 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b24c5-09d0-47d9-bbb2-c1a28f448558 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:41.107111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b24c5-09d0-47d9-bbb2-c1a28f448558 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:41.108053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b24c5-09d0-47d9-bbb2-c1a28f448558 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:41.115004 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 43/77] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:18:40 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:18:41.123461 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4718450-d02f-4b88-8947-8004fd064474 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:41.123607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b24c5-09d0-47d9-bbb2-c1a28f448558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-bc1b24c5-09d0-47d9-bbb2-c1a28f448558 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:41.126257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:41.127181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:41.127938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:41.127938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:41.127938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:41.127938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:41.127938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:41.127938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:41.127938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:41.127938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:41.127938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:41.127938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:41.127938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:18:41.127938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:18:41.127938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 35/78] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:41.128578 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b24c5-09d0-47d9-bbb2-c1a28f448558 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:41.219001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:41.246675 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4718450-d02f-4b88-8947-8004fd064474 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:41.249461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b24c5-09d0-47d9-bbb2-c1a28f448558 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:41.291850 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910b9cc-2ba7-4f8a-81e3-2096c10d415c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:41.292529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910b9cc-2ba7-4f8a-81e3-2096c10d415c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:41.293211 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910b9cc-2ba7-4f8a-81e3-2096c10d415c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:41.293211 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910b9cc-2ba7-4f8a-81e3-2096c10d415c None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:41.293838 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910b9cc-2ba7-4f8a-81e3-2096c10d415c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:41.294097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d4187-2b55-46d3-a789-ee4ae21dd7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:41.294201 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910b9cc-2ba7-4f8a-81e3-2096c10d415c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:41.295520 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d4187-2b55-46d3-a789-ee4ae21dd7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:41.295804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d4187-2b55-46d3-a789-ee4ae21dd7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:41.296084 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d4187-2b55-46d3-a789-ee4ae21dd7a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:41.296352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910b9cc-2ba7-4f8a-81e3-2096c10d415c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:41.305187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 36/79] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:41.306032 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910b9cc-2ba7-4f8a-81e3-2096c10d415c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:41.317485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d4187-2b55-46d3-a789-ee4ae21dd7a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-fd4d4187-2b55-46d3-a789-ee4ae21dd7a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:41.325986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:41.326982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:41.327874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:41.327874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:41.327874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:41.327874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:41.327874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:41.327874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:41.327874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:41.327874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:41.327874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:41.327874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:41.327874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:18:41.327874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:18:41.327874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 44/80] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:18:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:41.328543 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d4187-2b55-46d3-a789-ee4ae21dd7a8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:41.348430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:41.439131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910b9cc-2ba7-4f8a-81e3-2096c10d415c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:41.495843 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d4187-2b55-46d3-a789-ee4ae21dd7a8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:41.505888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e65e0-a20f-4663-bdcb-948c0286fb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:41.507340 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e65e0-a20f-4663-bdcb-948c0286fb47 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:41.508105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e65e0-a20f-4663-bdcb-948c0286fb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:41.508635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e65e0-a20f-4663-bdcb-948c0286fb47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:41.535446 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2642e-7c1c-47f3-a2ab-7a1ac33d7632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:41.536175 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2642e-7c1c-47f3-a2ab-7a1ac33d7632 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:41.536470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2642e-7c1c-47f3-a2ab-7a1ac33d7632 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:41.536734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2642e-7c1c-47f3-a2ab-7a1ac33d7632 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:41.537490 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2642e-7c1c-47f3-a2ab-7a1ac33d7632 None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:41.537801 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2642e-7c1c-47f3-a2ab-7a1ac33d7632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:41.539312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2642e-7c1c-47f3-a2ab-7a1ac33d7632 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:41.548989 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 45/81] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:18:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:41.549874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2642e-7c1c-47f3-a2ab-7a1ac33d7632 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:41.553716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:41.588238 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e65e0-a20f-4663-bdcb-948c0286fb47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:41.590144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e65e0-a20f-4663-bdcb-948c0286fb47 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:41.623428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:41.660037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2642e-7c1c-47f3-a2ab-7a1ac33d7632 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:41.696921 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c500c-b219-47c3-a0d1-32b50bf1d37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:41.697581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c500c-b219-47c3-a0d1-32b50bf1d37e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:41.697865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c500c-b219-47c3-a0d1-32b50bf1d37e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:41.698145 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c500c-b219-47c3-a0d1-32b50bf1d37e None admin] PATH_INFO: `/v3/users/7af289109e3a4eaf8ae29a4b13dcfb4d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:41.699520 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c500c-b219-47c3-a0d1-32b50bf1d37e None admin] RBAC: Authorizing `identity:get_user(user_id=7af289109e3a4eaf8ae29a4b13dcfb4d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:41.701620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c500c-b219-47c3-a0d1-32b50bf1d37e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:41.702496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 37/82] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:18:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:18:41.707076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 46/83] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:41 2022] GET /identity/v3/users/7af289109e3a4eaf8ae29a4b13dcfb4d => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:41.707076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c500c-b219-47c3-a0d1-32b50bf1d37e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:41.707334 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e65e0-a20f-4663-bdcb-948c0286fb47 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:41.800271 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:41.827656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e65e0-a20f-4663-bdcb-948c0286fb47 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:41.836309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c500c-b219-47c3-a0d1-32b50bf1d37e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:41.870241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:41.874519 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77255065-6194-4a44-b000-bd68392d8526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:41.875455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77255065-6194-4a44-b000-bd68392d8526 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:41.875859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77255065-6194-4a44-b000-bd68392d8526 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:41.876145 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77255065-6194-4a44-b000-bd68392d8526 None admin] PATH_INFO: `/v3/users/f2602cd3e1e84ece9b07e9808df280f2` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:41.876614 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392c86f-e62f-4268-98d9-6faedae37871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:41.877374 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77255065-6194-4a44-b000-bd68392d8526 None admin] RBAC: Authorizing `identity:get_user(user_id=f2602cd3e1e84ece9b07e9808df280f2)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:41.877635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392c86f-e62f-4268-98d9-6faedae37871 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:41.878085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392c86f-e62f-4268-98d9-6faedae37871 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:41.878556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392c86f-e62f-4268-98d9-6faedae37871 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:41.879864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77255065-6194-4a44-b000-bd68392d8526 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:41.879957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392c86f-e62f-4268-98d9-6faedae37871 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:41.880175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392c86f-e62f-4268-98d9-6faedae37871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:41.880707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 47/84] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:41 2022] GET /identity/v3/users/f2602cd3e1e84ece9b07e9808df280f2 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:41.881486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77255065-6194-4a44-b000-bd68392d8526 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:41.882204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392c86f-e62f-4268-98d9-6faedae37871 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:41.894550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 38/85] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:18:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:41.896296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392c86f-e62f-4268-98d9-6faedae37871 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:42.011070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77255065-6194-4a44-b000-bd68392d8526 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:42.035532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392c86f-e62f-4268-98d9-6faedae37871 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:42.048613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b569e-d1e4-44fa-94a8-8bd50726f980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:42.050039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b569e-d1e4-44fa-94a8-8bd50726f980 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:42.050504 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b569e-d1e4-44fa-94a8-8bd50726f980 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:42.050947 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b569e-d1e4-44fa-94a8-8bd50726f980 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:42.052316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b569e-d1e4-44fa-94a8-8bd50726f980 None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:42.053934 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b569e-d1e4-44fa-94a8-8bd50726f980 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:42.056702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 48/86] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:41 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:42.057664 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b569e-d1e4-44fa-94a8-8bd50726f980 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:42.069174 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:42.081604 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ae440-2bf1-4b83-8478-c7be0ccbb111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:42.082265 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ae440-2bf1-4b83-8478-c7be0ccbb111 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:42.082594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ae440-2bf1-4b83-8478-c7be0ccbb111 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:42.082875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ae440-2bf1-4b83-8478-c7be0ccbb111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:42.151941 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:42.160725 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ae440-2bf1-4b83-8478-c7be0ccbb111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:42.165821 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ae440-2bf1-4b83-8478-c7be0ccbb111 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:42.167257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b569e-d1e4-44fa-94a8-8bd50726f980 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:42.203358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a43ab-e60c-4df5-91d8-7b6251e8b949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:42.204256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a43ab-e60c-4df5-91d8-7b6251e8b949 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:42.204690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a43ab-e60c-4df5-91d8-7b6251e8b949 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:42.205181 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a43ab-e60c-4df5-91d8-7b6251e8b949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:42.275852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 39/87] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:18:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:18:42.276723 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ae440-2bf1-4b83-8478-c7be0ccbb111 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:42.280196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a43ab-e60c-4df5-91d8-7b6251e8b949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:42.281976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a43ab-e60c-4df5-91d8-7b6251e8b949 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:42.292792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:42.385175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:42.392703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ae440-2bf1-4b83-8478-c7be0ccbb111 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:42.395693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 49/88] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:18:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:18:42.396821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a43ab-e60c-4df5-91d8-7b6251e8b949 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:42.441541 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25473c4-bd82-4dcc-aa8f-0711148a26b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:42.442354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25473c4-bd82-4dcc-aa8f-0711148a26b6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:42.442673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25473c4-bd82-4dcc-aa8f-0711148a26b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:42.442960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25473c4-bd82-4dcc-aa8f-0711148a26b6 None admin] PATH_INFO: `/v3/users/f2602cd3e1e84ece9b07e9808df280f2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:42.444215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25473c4-bd82-4dcc-aa8f-0711148a26b6 None admin] RBAC: Authorizing `identity:get_user(user_id=f2602cd3e1e84ece9b07e9808df280f2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:42.445698 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25473c4-bd82-4dcc-aa8f-0711148a26b6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:42.447523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 40/89] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:42 2022] GET /identity/v3/users/f2602cd3e1e84ece9b07e9808df280f2 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:42.448308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25473c4-bd82-4dcc-aa8f-0711148a26b6 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:42.522772 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a43ab-e60c-4df5-91d8-7b6251e8b949 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:42.536956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:42.571834 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049e39e-c103-497e-b389-ba44b02443d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:42.572503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049e39e-c103-497e-b389-ba44b02443d3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:42.572791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049e39e-c103-497e-b389-ba44b02443d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:42.573071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049e39e-c103-497e-b389-ba44b02443d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:42.574107 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049e39e-c103-497e-b389-ba44b02443d3 None admin] RBAC: Adding query filter params (role.id=4b6ddd50803f4f9bbf171c5c7cb9af63, scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f, user.id=f2602cd3e1e84ece9b07e9808df280f2) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:42.574315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25473c4-bd82-4dcc-aa8f-0711148a26b6 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:42.574457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049e39e-c103-497e-b389-ba44b02443d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:42.576671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049e39e-c103-497e-b389-ba44b02443d3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:42.592469 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 50/90] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:18:42 2022] GET /identity/v3/role_assignments?user.id=f2602cd3e1e84ece9b07e9808df280f2&scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f&role.id=4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:42.594793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049e39e-c103-497e-b389-ba44b02443d3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:42.646007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8df44f-2a55-4c8a-ad66-64537a20f19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:42.647262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8df44f-2a55-4c8a-ad66-64537a20f19d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:42.649096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8df44f-2a55-4c8a-ad66-64537a20f19d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:42.649570 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8df44f-2a55-4c8a-ad66-64537a20f19d None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:42.651391 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8df44f-2a55-4c8a-ad66-64537a20f19d None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:42.654649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8df44f-2a55-4c8a-ad66-64537a20f19d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:42.659212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 41/91] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:42 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:42.661140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8df44f-2a55-4c8a-ad66-64537a20f19d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:42.731810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:42.815784 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049e39e-c103-497e-b389-ba44b02443d3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:42.825402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8df44f-2a55-4c8a-ad66-64537a20f19d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:42.870067 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc9a92-79f3-4745-a34b-52c63eb6a61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:42.871114 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc9a92-79f3-4745-a34b-52c63eb6a61a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:42.871681 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc9a92-79f3-4745-a34b-52c63eb6a61a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:42.872131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc9a92-79f3-4745-a34b-52c63eb6a61a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:42.875116 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1a09c-630d-469c-a791-b5e4315bd4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:42.876073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1a09c-630d-469c-a791-b5e4315bd4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:42.876440 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1a09c-630d-469c-a791-b5e4315bd4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:42.876776 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1a09c-630d-469c-a791-b5e4315bd4c7 None admin] PATH_INFO: `/v3/projects/1cd26397ae054b20949c82f0a5807f1b` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:42.883443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1a09c-630d-469c-a791-b5e4315bd4c7 None admin] RBAC: Authorizing `identity:get_project(project_id=1cd26397ae054b20949c82f0a5807f1b)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:42.885047 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1a09c-630d-469c-a791-b5e4315bd4c7 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:42.887556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 51/92] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:42 2022] GET /identity/v3/projects/1cd26397ae054b20949c82f0a5807f1b => generated 312 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:42.888805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1a09c-630d-469c-a791-b5e4315bd4c7 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:42.965129 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc9a92-79f3-4745-a34b-52c63eb6a61a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:42.968008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc9a92-79f3-4745-a34b-52c63eb6a61a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:42.991837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:43.022721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:43.088086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1a09c-630d-469c-a791-b5e4315bd4c7 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:43.129342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55a2dd-5e61-4a1f-bd1b-3929ea4e545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:43.130307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55a2dd-5e61-4a1f-bd1b-3929ea4e545e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:43.130802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55a2dd-5e61-4a1f-bd1b-3929ea4e545e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:43.131700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55a2dd-5e61-4a1f-bd1b-3929ea4e545e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:43.133286 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55a2dd-5e61-4a1f-bd1b-3929ea4e545e None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f, user.id=7af289109e3a4eaf8ae29a4b13dcfb4d) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:43.133786 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55a2dd-5e61-4a1f-bd1b-3929ea4e545e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:43.135460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55a2dd-5e61-4a1f-bd1b-3929ea4e545e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:43.143933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 52/93] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:18:42 2022] GET /identity/v3/role_assignments?user.id=7af289109e3a4eaf8ae29a4b13dcfb4d&scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:43.145068 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55a2dd-5e61-4a1f-bd1b-3929ea4e545e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:43.240008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 42/94] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:18:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:18:43.245870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc9a92-79f3-4745-a34b-52c63eb6a61a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:43.277802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55a2dd-5e61-4a1f-bd1b-3929ea4e545e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:43.283094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:43.326144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bf724-34d4-415f-86d3-c6349e95d96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:43.327148 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bf724-34d4-415f-86d3-c6349e95d96b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:43.327617 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bf724-34d4-415f-86d3-c6349e95d96b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:43.328071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bf724-34d4-415f-86d3-c6349e95d96b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:43.329092 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bf724-34d4-415f-86d3-c6349e95d96b None admin] RBAC: Adding query filter params (role.id=4b6ddd50803f4f9bbf171c5c7cb9af63, scope.project.id=1cd26397ae054b20949c82f0a5807f1b, user.id=f2602cd3e1e84ece9b07e9808df280f2) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:43.329623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bf724-34d4-415f-86d3-c6349e95d96b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:43.331328 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bf724-34d4-415f-86d3-c6349e95d96b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:43.339163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 53/95] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:18:43 2022] GET /identity/v3/role_assignments?user.id=f2602cd3e1e84ece9b07e9808df280f2&scope.project.id=1cd26397ae054b20949c82f0a5807f1b&role.id=4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:43.440337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc9a92-79f3-4745-a34b-52c63eb6a61a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:43.469068 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad73d1-4cc6-4373-8287-59bf6298f0f4 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:43.469690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad73d1-4cc6-4373-8287-59bf6298f0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:43.470155 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad73d1-4cc6-4373-8287-59bf6298f0f4 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:43.471852 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 54/96] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:18:43.482684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5013f-7ac1-440e-a0de-db80c9e7e0bd None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:43.483247 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5013f-7ac1-440e-a0de-db80c9e7e0bd None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:43.483727 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5013f-7ac1-440e-a0de-db80c9e7e0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:43.508695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-01e5013f-7ac1-440e-a0de-db80c9e7e0bd None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:43.512533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-01e5013f-7ac1-440e-a0de-db80c9e7e0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:43.514929 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:43.529522 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec0070-85dd-46fb-bc6b-6e1022ed9c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:43.530855 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec0070-85dd-46fb-bc6b-6e1022ed9c19 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:43.531318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec0070-85dd-46fb-bc6b-6e1022ed9c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:43.531765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec0070-85dd-46fb-bc6b-6e1022ed9c19 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:43.533256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec0070-85dd-46fb-bc6b-6e1022ed9c19 None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:43.536737 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec0070-85dd-46fb-bc6b-6e1022ed9c19 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:43.539723 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 43/97] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:43 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:43.550049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec0070-85dd-46fb-bc6b-6e1022ed9c19 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:43.667225 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 55/98] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:18:43.670921 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea87b-f3b9-4f6f-9901-9c680f9724ac None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:43.672315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea87b-f3b9-4f6f-9901-9c680f9724ac None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:43.673623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea87b-f3b9-4f6f-9901-9c680f9724ac None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:43.675499 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 56/99] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:43.682424 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30dc5e-edcd-468e-8283-314a00c8441b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:43.682998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30dc5e-edcd-468e-8283-314a00c8441b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:43.683447 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30dc5e-edcd-468e-8283-314a00c8441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:43.703476 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7f30dc5e-edcd-468e-8283-314a00c8441b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:43.705070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7f30dc5e-edcd-468e-8283-314a00c8441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:43.752864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec0070-85dd-46fb-bc6b-6e1022ed9c19 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:43.783807 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 57/100] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:43.784932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30dc5e-edcd-468e-8283-314a00c8441b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:43.830697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:43.835889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8f828-0c0c-4438-bb6c-7d9ef150fcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:43.836625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8f828-0c0c-4438-bb6c-7d9ef150fcf2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:43.836916 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8f828-0c0c-4438-bb6c-7d9ef150fcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:43.844161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8f828-0c0c-4438-bb6c-7d9ef150fcf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:43.844161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8f828-0c0c-4438-bb6c-7d9ef150fcf2 None admin] RBAC: Adding query filter params (role.id=575c54955d4a474e9c687a0100991d1d, scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f, user.id=f2602cd3e1e84ece9b07e9808df280f2) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:43.844161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8f828-0c0c-4438-bb6c-7d9ef150fcf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:43.844161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8f828-0c0c-4438-bb6c-7d9ef150fcf2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:43.861586 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 44/101] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:18:43 2022] GET /identity/v3/role_assignments?user.id=f2602cd3e1e84ece9b07e9808df280f2&scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f&role.id=575c54955d4a474e9c687a0100991d1d => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:43.862542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8f828-0c0c-4438-bb6c-7d9ef150fcf2 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:44.061247 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30dc5e-edcd-468e-8283-314a00c8441b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:44.064308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:44.146381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784eedb-0f8b-43e5-87c8-c976078ecb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:44.147201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784eedb-0f8b-43e5-87c8-c976078ecb95 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:44.147489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784eedb-0f8b-43e5-87c8-c976078ecb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:44.147770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784eedb-0f8b-43e5-87c8-c976078ecb95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:44.153173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8f828-0c0c-4438-bb6c-7d9ef150fcf2 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:44.155493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784eedb-0f8b-43e5-87c8-c976078ecb95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:44.156999 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784eedb-0f8b-43e5-87c8-c976078ecb95 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:44.158910 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 58/102] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:18:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:44.164417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784eedb-0f8b-43e5-87c8-c976078ecb95 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:44.231237 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577db50-de85-4463-b22c-5a863bb05750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:44.232164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577db50-de85-4463-b22c-5a863bb05750 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:44.233109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577db50-de85-4463-b22c-5a863bb05750 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:44.233395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577db50-de85-4463-b22c-5a863bb05750 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:44.260660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577db50-de85-4463-b22c-5a863bb05750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-e577db50-de85-4463-b22c-5a863bb05750 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:44.269535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:44.270561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:44.271317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:44.271317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:44.271317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:44.271317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:44.271317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:44.271317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:44.271317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:44.271317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:44.271317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:44.271317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:44.271317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:18:44.271317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:18:44.276198 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 45/103] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:44.283051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577db50-de85-4463-b22c-5a863bb05750 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:44.402786 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:44.405337 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784eedb-0f8b-43e5-87c8-c976078ecb95 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:44.465176 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8095f47-5c90-4a81-a553-446b93f5b648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:44.465847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8095f47-5c90-4a81-a553-446b93f5b648 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:44.466131 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8095f47-5c90-4a81-a553-446b93f5b648 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:44.466513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8095f47-5c90-4a81-a553-446b93f5b648 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:44.467242 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8095f47-5c90-4a81-a553-446b93f5b648 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:44.468725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8095f47-5c90-4a81-a553-446b93f5b648 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:44.490562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577db50-de85-4463-b22c-5a863bb05750 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:44.532629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:44.547696 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee4914-aa3d-4a99-a95e-818653d949f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:44.548384 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4914-aa3d-4a99-a95e-818653d949f1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:44.548672 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4914-aa3d-4a99-a95e-818653d949f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:44.548952 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4914-aa3d-4a99-a95e-818653d949f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:44.549769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee4914-aa3d-4a99-a95e-818653d949f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:44.550082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee4914-aa3d-4a99-a95e-818653d949f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:44.551743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee4914-aa3d-4a99-a95e-818653d949f1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:44.566939 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 46/104] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:18:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:44.580072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee4914-aa3d-4a99-a95e-818653d949f1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:44.582335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 59/105] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 18 10:18:44 2022] POST /identity/v3/projects => generated 302 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:18:44.713572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee4914-aa3d-4a99-a95e-818653d949f1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:44.762931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ac4b4-a604-48a5-8f2a-ef5857e202db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:44.763916 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ac4b4-a604-48a5-8f2a-ef5857e202db None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:44.764206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ac4b4-a604-48a5-8f2a-ef5857e202db None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:44.764484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ac4b4-a604-48a5-8f2a-ef5857e202db None admin] PATH_INFO: `/v3/users/2250c02ff5ec40548230fac70d69518c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:44.787180 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ac4b4-a604-48a5-8f2a-ef5857e202db None admin] RBAC: Authorizing `identity:get_user(user_id=2250c02ff5ec40548230fac70d69518c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:44.788902 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ac4b4-a604-48a5-8f2a-ef5857e202db None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:44.791246 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 47/106] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:44 2022] GET /identity/v3/users/2250c02ff5ec40548230fac70d69518c => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:44.797222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8095f47-5c90-4a81-a553-446b93f5b648 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:44.962278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8095f47-5c90-4a81-a553-446b93f5b648 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:45.012373 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc248d2-75d5-40c6-b670-6289b70a69e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:45.013602 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc248d2-75d5-40c6-b670-6289b70a69e4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:45.014116 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc248d2-75d5-40c6-b670-6289b70a69e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:45.014626 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc248d2-75d5-40c6-b670-6289b70a69e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:45.036044 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:45.112410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc248d2-75d5-40c6-b670-6289b70a69e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:45.113937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc248d2-75d5-40c6-b670-6289b70a69e4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:45.226366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 60/107] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:18:45.229041 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ac4b4-a604-48a5-8f2a-ef5857e202db None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:45.295388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:45.368798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ac4b4-a604-48a5-8f2a-ef5857e202db None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:45.421318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95e3ec-5ec8-4635-9dce-9b46750162fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:45.422206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95e3ec-5ec8-4635-9dce-9b46750162fa None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:45.422593 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95e3ec-5ec8-4635-9dce-9b46750162fa None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:45.422821 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95e3ec-5ec8-4635-9dce-9b46750162fa None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:45.427230 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95e3ec-5ec8-4635-9dce-9b46750162fa None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:45.428741 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95e3ec-5ec8-4635-9dce-9b46750162fa None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:45.430592 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 48/108] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:45 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:45.438401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc248d2-75d5-40c6-b670-6289b70a69e4 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:45.542824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:45.623204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc248d2-75d5-40c6-b670-6289b70a69e4 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:45.665936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d624f24-390d-4b8f-a8f4-ea17353f4f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:45.666647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d624f24-390d-4b8f-a8f4-ea17353f4f48 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:45.666935 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d624f24-390d-4b8f-a8f4-ea17353f4f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:45.667221 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d624f24-390d-4b8f-a8f4-ea17353f4f48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:45.668189 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d624f24-390d-4b8f-a8f4-ea17353f4f48 None admin] RBAC: Adding query filter params (role.id=ea3d8b70e23b44c0ba368fe1a3b9d04f, scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f, user.id=2250c02ff5ec40548230fac70d69518c) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:45.668503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d624f24-390d-4b8f-a8f4-ea17353f4f48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:45.670101 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d624f24-390d-4b8f-a8f4-ea17353f4f48 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:45.682507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 61/109] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:18:45 2022] GET /identity/v3/role_assignments?user.id=2250c02ff5ec40548230fac70d69518c&scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f&role.id=ea3d8b70e23b44c0ba368fe1a3b9d04f => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:45.712101 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552916a-76e0-4438-acc1-a6eb6e371f49 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:45.712441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552916a-76e0-4438-acc1-a6eb6e371f49 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:45.712677 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552916a-76e0-4438-acc1-a6eb6e371f49 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:45.714129 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 49/110] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:45.720384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b248a66-eca4-47f0-bbb3-71c3fda4067a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:45.720698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b248a66-eca4-47f0-bbb3-71c3fda4067a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:45.720946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b248a66-eca4-47f0-bbb3-71c3fda4067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:45.742646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2b248a66-eca4-47f0-bbb3-71c3fda4067a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:45.743939 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2b248a66-eca4-47f0-bbb3-71c3fda4067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:45.824802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 62/111] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:45.859800 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552916a-76e0-4438-acc1-a6eb6e371f49 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:46.010303 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2336-5665-4c7d-be5e-043aa539fd3a None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:46.010731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2336-5665-4c7d-be5e-043aa539fd3a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:46.011087 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2336-5665-4c7d-be5e-043aa539fd3a None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:46.014399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 63/112] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:46.020697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91636497-7fd0-409a-83dc-a82b0cdaba19 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:46.021063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91636497-7fd0-409a-83dc-a82b0cdaba19 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:46.021561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91636497-7fd0-409a-83dc-a82b0cdaba19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:46.027742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552916a-76e0-4438-acc1-a6eb6e371f49 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:46.050727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:46.071589 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-91636497-7fd0-409a-83dc-a82b0cdaba19 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:46.076674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-91636497-7fd0-409a-83dc-a82b0cdaba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:46.097259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a89d44-fd46-48c0-9de9-ad0d2eabc305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:46.099151 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a89d44-fd46-48c0-9de9-ad0d2eabc305 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:46.099862 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a89d44-fd46-48c0-9de9-ad0d2eabc305 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:46.100512 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a89d44-fd46-48c0-9de9-ad0d2eabc305 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:46.131751 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a89d44-fd46-48c0-9de9-ad0d2eabc305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-78a89d44-fd46-48c0-9de9-ad0d2eabc305 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:46.141158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:46.142072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:46.142965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:46.142965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:46.142965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:46.142965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:46.142965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:46.142965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:46.142965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:46.142965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:46.142965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:46.142965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:46.142965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:18:46.142965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:18:46.148346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 50/113] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:46.154957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a89d44-fd46-48c0-9de9-ad0d2eabc305 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:46.175922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:46.265905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 64/114] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:18:46.364870 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91636497-7fd0-409a-83dc-a82b0cdaba19 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:46.368239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a89d44-fd46-48c0-9de9-ad0d2eabc305 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:46.429082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bd2a4-54e4-4e5a-9601-7789ad88a15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:46.429768 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bd2a4-54e4-4e5a-9601-7789ad88a15d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:46.430057 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bd2a4-54e4-4e5a-9601-7789ad88a15d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:46.430357 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bd2a4-54e4-4e5a-9601-7789ad88a15d None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:46.431127 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bd2a4-54e4-4e5a-9601-7789ad88a15d None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:46.431438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bd2a4-54e4-4e5a-9601-7789ad88a15d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:46.437180 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bd2a4-54e4-4e5a-9601-7789ad88a15d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:46.456893 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 51/115] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:18:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:46.463530 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bd2a4-54e4-4e5a-9601-7789ad88a15d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:46.538399 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:46.581128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91636497-7fd0-409a-83dc-a82b0cdaba19 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:46.658434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4170e7a-d3a7-48af-b2da-89ba98cb631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:46.659261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4170e7a-d3a7-48af-b2da-89ba98cb631b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:46.659551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4170e7a-d3a7-48af-b2da-89ba98cb631b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:46.659833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4170e7a-d3a7-48af-b2da-89ba98cb631b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:46.673138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bd2a4-54e4-4e5a-9601-7789ad88a15d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:46.681628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4170e7a-d3a7-48af-b2da-89ba98cb631b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-c4170e7a-d3a7-48af-b2da-89ba98cb631b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:46.699725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:46.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:46.702585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:46.702585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:46.702585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:46.702585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:46.702585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:46.702585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:46.702585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:46.702585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:46.702585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:46.702585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:46.702585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:46.702585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:18:46.702585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 65/116] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:18:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:18:46.719576 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4170e7a-d3a7-48af-b2da-89ba98cb631b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:46.747333 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f55d7c-20dc-45aa-89ef-6ef8da94c183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:46.752975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f55d7c-20dc-45aa-89ef-6ef8da94c183 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:46.752975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f55d7c-20dc-45aa-89ef-6ef8da94c183 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:46.752975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f55d7c-20dc-45aa-89ef-6ef8da94c183 None admin] PATH_INFO: `/v3/users/f2602cd3e1e84ece9b07e9808df280f2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:46.754355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f55d7c-20dc-45aa-89ef-6ef8da94c183 None admin] RBAC: Authorizing `identity:get_user(user_id=f2602cd3e1e84ece9b07e9808df280f2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:46.761388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f55d7c-20dc-45aa-89ef-6ef8da94c183 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:46.768182 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 52/117] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:46 2022] GET /identity/v3/users/f2602cd3e1e84ece9b07e9808df280f2 => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:46.774392 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f55d7c-20dc-45aa-89ef-6ef8da94c183 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:46.803266 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:46.961877 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4170e7a-d3a7-48af-b2da-89ba98cb631b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:46.995193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:47.000047 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f55d7c-20dc-45aa-89ef-6ef8da94c183 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:47.039124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c9e9b-de3a-44a5-b14a-01378b2101e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:47.040956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c9e9b-de3a-44a5-b14a-01378b2101e1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:47.041973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c9e9b-de3a-44a5-b14a-01378b2101e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:47.042820 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29760e6-648a-4479-9394-8a307aae31d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:47.043377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c9e9b-de3a-44a5-b14a-01378b2101e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:47.044367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c9e9b-de3a-44a5-b14a-01378b2101e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:47.046085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29760e6-648a-4479-9394-8a307aae31d0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:47.046648 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c9e9b-de3a-44a5-b14a-01378b2101e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:47.047131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29760e6-648a-4479-9394-8a307aae31d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:47.048772 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c9e9b-de3a-44a5-b14a-01378b2101e1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:47.049272 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29760e6-648a-4479-9394-8a307aae31d0 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:47.052222 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29760e6-648a-4479-9394-8a307aae31d0 None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:47.053978 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29760e6-648a-4479-9394-8a307aae31d0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:47.056200 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 53/118] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:46 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:47.058724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9b80d-aaf2-413d-97fc-15983c192a7a None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:47.062194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9b80d-aaf2-413d-97fc-15983c192a7a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:47.062752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9b80d-aaf2-413d-97fc-15983c192a7a None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:47.064651 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 54/119] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:47.066757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9b80d-aaf2-413d-97fc-15983c192a7a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:47.069467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 66/120] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:47.073437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f903f17-8b12-49be-8209-778adc09268c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:47.073998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f903f17-8b12-49be-8209-778adc09268c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:47.074885 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f903f17-8b12-49be-8209-778adc09268c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:47.111276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1f903f17-8b12-49be-8209-778adc09268c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:47.115298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1f903f17-8b12-49be-8209-778adc09268c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:47.244696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 67/121] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:47.245543 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f903f17-8b12-49be-8209-778adc09268c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:47.255602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9b80d-aaf2-413d-97fc-15983c192a7a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:47.290248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:47.315281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608fd04-6e28-41d2-ad83-070595bc2556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:47.317047 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608fd04-6e28-41d2-ad83-070595bc2556 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:47.317486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608fd04-6e28-41d2-ad83-070595bc2556 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:47.317910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608fd04-6e28-41d2-ad83-070595bc2556 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f/users/f2602cd3e1e84ece9b07e9808df280f2/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:47.321911 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608fd04-6e28-41d2-ad83-070595bc2556 None admin] RBAC: Authorizing `identity:create_grant(project_id=b99807a59bdf4c95bc2a8e8af4d5974f, user_id=f2602cd3e1e84ece9b07e9808df280f2, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:47.323915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608fd04-6e28-41d2-ad83-070595bc2556 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:47.393651 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 55/122] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:18:47 2022] PUT /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f/users/f2602cd3e1e84ece9b07e9808df280f2/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:18:47.401883 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ff714-16f3-4f1f-af41-d879e2b97138 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:47.403220 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ff714-16f3-4f1f-af41-d879e2b97138 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:47.403982 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ff714-16f3-4f1f-af41-d879e2b97138 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:47.412397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f903f17-8b12-49be-8209-778adc09268c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:47.413005 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 56/123] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:47 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:47.414187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ff714-16f3-4f1f-af41-d879e2b97138 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:47.482795 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:47.494765 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222a84b-6f38-4899-bfb1-204f566cb5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:47.496741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222a84b-6f38-4899-bfb1-204f566cb5ee None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:47.498522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222a84b-6f38-4899-bfb1-204f566cb5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:47.499716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222a84b-6f38-4899-bfb1-204f566cb5ee None admin] PATH_INFO: `/v3/users/7af289109e3a4eaf8ae29a4b13dcfb4d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:47.501328 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222a84b-6f38-4899-bfb1-204f566cb5ee None admin] RBAC: Authorizing `identity:get_user(user_id=7af289109e3a4eaf8ae29a4b13dcfb4d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:47.503168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222a84b-6f38-4899-bfb1-204f566cb5ee None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:47.512868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 68/124] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:47 2022] GET /identity/v3/users/7af289109e3a4eaf8ae29a4b13dcfb4d => generated 247 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:47.514984 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb3f62-69ee-4945-8d58-d055403bd60c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:47.515415 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb3f62-69ee-4945-8d58-d055403bd60c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:47.516317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb3f62-69ee-4945-8d58-d055403bd60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:47.561910 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-80eb3f62-69ee-4945-8d58-d055403bd60c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:47.564001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-80eb3f62-69ee-4945-8d58-d055403bd60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:47.645281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ff714-16f3-4f1f-af41-d879e2b97138 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:47.704454 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423430c-bd9e-4480-ab94-d159c5211e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:47.705295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423430c-bd9e-4480-ab94-d159c5211e6c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:47.705579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423430c-bd9e-4480-ab94-d159c5211e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:47.705863 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423430c-bd9e-4480-ab94-d159c5211e6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:47.711817 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 69/125] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:47.713485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb3f62-69ee-4945-8d58-d055403bd60c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:47.730139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423430c-bd9e-4480-ab94-d159c5211e6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-5423430c-bd9e-4480-ab94-d159c5211e6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:47.744299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:47.745777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:47.747356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:47.747356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:47.747356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:47.747356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:47.747356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:47.747356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:47.747356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:47.747356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:47.747356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:47.747356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:47.747356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:18:47.747356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:18:47.747356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 57/126] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:18:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:47.747356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423430c-bd9e-4480-ab94-d159c5211e6c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:47.772471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:47.879709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:47.880830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb3f62-69ee-4945-8d58-d055403bd60c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:47.896960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423430c-bd9e-4480-ab94-d159c5211e6c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:47.940549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686adc5e-f7f3-4648-b2c2-e12ab1cf1b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:47.941621 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686adc5e-f7f3-4648-b2c2-e12ab1cf1b39 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:47.942101 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686adc5e-f7f3-4648-b2c2-e12ab1cf1b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:47.942371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686adc5e-f7f3-4648-b2c2-e12ab1cf1b39 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:47.943838 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686adc5e-f7f3-4648-b2c2-e12ab1cf1b39 None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:47.945940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686adc5e-f7f3-4648-b2c2-e12ab1cf1b39 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:47.947509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 70/127] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:47 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:47.948652 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686adc5e-f7f3-4648-b2c2-e12ab1cf1b39 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:47.967801 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77538de3-295a-4f47-8a52-882e72cb9e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:47.968755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538de3-295a-4f47-8a52-882e72cb9e1c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:47.969145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538de3-295a-4f47-8a52-882e72cb9e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:47.969527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538de3-295a-4f47-8a52-882e72cb9e1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:47.985731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77538de3-295a-4f47-8a52-882e72cb9e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-77538de3-295a-4f47-8a52-882e72cb9e1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:47.996761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:47.998206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:47.999684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:47.999684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:47.999684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:47.999684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:47.999684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:47.999684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:47.999684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:47.999684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:47.999684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:47.999684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:47.999684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:18:47.999684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:18:47.999684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 58/128] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:48.000916 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca6f77-01ed-4094-ac3d-06c97b3efcc1 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:48.001275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca6f77-01ed-4094-ac3d-06c97b3efcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:48.001638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca6f77-01ed-4094-ac3d-06c97b3efcc1 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:48.003096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 59/129] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:48.008129 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca6f77-01ed-4094-ac3d-06c97b3efcc1 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:48.081945 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:48.094492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686adc5e-f7f3-4648-b2c2-e12ab1cf1b39 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:48.137657 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca6f77-01ed-4094-ac3d-06c97b3efcc1 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:48.143907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff92d9-79ce-4b54-bd50-cbc9dcaab85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:48.144590 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff92d9-79ce-4b54-bd50-cbc9dcaab85c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:48.144876 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff92d9-79ce-4b54-bd50-cbc9dcaab85c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:48.145158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff92d9-79ce-4b54-bd50-cbc9dcaab85c None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:48.145922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff92d9-79ce-4b54-bd50-cbc9dcaab85c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:48.146231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff92d9-79ce-4b54-bd50-cbc9dcaab85c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:48.147743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff92d9-79ce-4b54-bd50-cbc9dcaab85c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:48.159673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 71/130] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:18:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:48.160733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff92d9-79ce-4b54-bd50-cbc9dcaab85c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:48.188519 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca7066-2d66-423f-8e4c-f69acbff0f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:48.194645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca7066-2d66-423f-8e4c-f69acbff0f77 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:48.195270 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca7066-2d66-423f-8e4c-f69acbff0f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:48.195872 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca7066-2d66-423f-8e4c-f69acbff0f77 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f/users/7af289109e3a4eaf8ae29a4b13dcfb4d/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:48.199221 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca7066-2d66-423f-8e4c-f69acbff0f77 None admin] RBAC: Authorizing `identity:create_grant(project_id=b99807a59bdf4c95bc2a8e8af4d5974f, user_id=7af289109e3a4eaf8ae29a4b13dcfb4d, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:48.202215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca7066-2d66-423f-8e4c-f69acbff0f77 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:48.273950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 60/131] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:18:48 2022] PUT /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f/users/7af289109e3a4eaf8ae29a4b13dcfb4d/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:18:48.276413 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36671f-f8cf-453f-bbb8-c4ecc4cf45b6 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:48.277033 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36671f-f8cf-453f-bbb8-c4ecc4cf45b6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:48.277517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36671f-f8cf-453f-bbb8-c4ecc4cf45b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:48.317928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-fc36671f-f8cf-453f-bbb8-c4ecc4cf45b6 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:48.319346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-fc36671f-f8cf-453f-bbb8-c4ecc4cf45b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:48.321899 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:48.323979 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff92d9-79ce-4b54-bd50-cbc9dcaab85c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:48.396712 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecce94-72b6-4108-81d6-a16d2de9b399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:48.397408 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecce94-72b6-4108-81d6-a16d2de9b399 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:48.397692 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecce94-72b6-4108-81d6-a16d2de9b399 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:48.398024 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecce94-72b6-4108-81d6-a16d2de9b399 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:48.399291 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecce94-72b6-4108-81d6-a16d2de9b399 None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:48.399600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecce94-72b6-4108-81d6-a16d2de9b399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:48.401036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecce94-72b6-4108-81d6-a16d2de9b399 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:48.426560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 72/132] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:18:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:48.427471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecce94-72b6-4108-81d6-a16d2de9b399 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:48.469862 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 61/133] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:48.470700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:48.471573 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36671f-f8cf-453f-bbb8-c4ecc4cf45b6 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:48.608089 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36671f-f8cf-453f-bbb8-c4ecc4cf45b6 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:48.625015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecce94-72b6-4108-81d6-a16d2de9b399 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:48.659492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34aa51a-52ad-490b-90ec-2749b3a89e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:48.660597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aa51a-52ad-490b-90ec-2749b3a89e0f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:48.660883 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aa51a-52ad-490b-90ec-2749b3a89e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:48.661623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aa51a-52ad-490b-90ec-2749b3a89e0f None admin] PATH_INFO: `/v3/users/f2602cd3e1e84ece9b07e9808df280f2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:48.663493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34aa51a-52ad-490b-90ec-2749b3a89e0f None admin] RBAC: Authorizing `identity:get_user(user_id=f2602cd3e1e84ece9b07e9808df280f2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:48.666256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34aa51a-52ad-490b-90ec-2749b3a89e0f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:48.666422 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bb497-8859-40f0-bb29-532e324192f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:48.667289 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bb497-8859-40f0-bb29-532e324192f4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:48.667567 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bb497-8859-40f0-bb29-532e324192f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:48.667845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bb497-8859-40f0-bb29-532e324192f4 None admin] PATH_INFO: `/v3/users/f2602cd3e1e84ece9b07e9808df280f2` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:48.668689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 62/134] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:48 2022] GET /identity/v3/users/f2602cd3e1e84ece9b07e9808df280f2 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:48.669514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bb497-8859-40f0-bb29-532e324192f4 None admin] RBAC: Authorizing `identity:get_user(user_id=f2602cd3e1e84ece9b07e9808df280f2)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:48.669627 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34aa51a-52ad-490b-90ec-2749b3a89e0f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:48.671620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bb497-8859-40f0-bb29-532e324192f4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:48.673355 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 73/135] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:48 2022] GET /identity/v3/users/f2602cd3e1e84ece9b07e9808df280f2 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:48.675066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615c1d9-d747-4266-9f62-b242c469fb07 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:48.675352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615c1d9-d747-4266-9f62-b242c469fb07 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:48.675633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615c1d9-d747-4266-9f62-b242c469fb07 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:48.677084 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 74/136] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:48.681052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:48.681199 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615c1d9-d747-4266-9f62-b242c469fb07 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:48.815069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:48.823976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34aa51a-52ad-490b-90ec-2749b3a89e0f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:48.828032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615c1d9-d747-4266-9f62-b242c469fb07 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:48.871251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb306246-a695-434b-af71-46da9608b597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:48.872242 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb306246-a695-434b-af71-46da9608b597 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:48.873722 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb306246-a695-434b-af71-46da9608b597 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:48.874312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb306246-a695-434b-af71-46da9608b597 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:48.877129 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb306246-a695-434b-af71-46da9608b597 None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:48.879007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb306246-a695-434b-af71-46da9608b597 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:48.882036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 75/137] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:48 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:48.882985 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb306246-a695-434b-af71-46da9608b597 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:48.892546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b131a19-720f-486a-be26-b2c20b3eb820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:48.893851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b131a19-720f-486a-be26-b2c20b3eb820 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:48.894354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b131a19-720f-486a-be26-b2c20b3eb820 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:48.894846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b131a19-720f-486a-be26-b2c20b3eb820 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:48.897777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b131a19-720f-486a-be26-b2c20b3eb820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:48.901673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b131a19-720f-486a-be26-b2c20b3eb820 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:48.906482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 63/138] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:18:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:48.908792 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1439ca4-f17b-4380-9f8c-58cd983c6e11 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:48.909293 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1439ca4-f17b-4380-9f8c-58cd983c6e11 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:48.911320 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1439ca4-f17b-4380-9f8c-58cd983c6e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:48.945606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d1439ca4-f17b-4380-9f8c-58cd983c6e11 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:48.947700 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d1439ca4-f17b-4380-9f8c-58cd983c6e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:49.026927 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb306246-a695-434b-af71-46da9608b597 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:49.041393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 64/139] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:49.042308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1439ca4-f17b-4380-9f8c-58cd983c6e11 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:49.047136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:49.072367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72145e-ce7e-4fe4-b7e7-aae545656e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:49.073816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72145e-ce7e-4fe4-b7e7-aae545656e66 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:49.074302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72145e-ce7e-4fe4-b7e7-aae545656e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:49.074835 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72145e-ce7e-4fe4-b7e7-aae545656e66 None admin] PATH_INFO: `/v3/projects/1cd26397ae054b20949c82f0a5807f1b` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:49.076847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72145e-ce7e-4fe4-b7e7-aae545656e66 None admin] RBAC: Authorizing `identity:get_project(project_id=1cd26397ae054b20949c82f0a5807f1b)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:49.079549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72145e-ce7e-4fe4-b7e7-aae545656e66 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:49.083025 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 76/140] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:48 2022] GET /identity/v3/projects/1cd26397ae054b20949c82f0a5807f1b => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:49.091082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72145e-ce7e-4fe4-b7e7-aae545656e66 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:49.126283 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:49.161188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1439ca4-f17b-4380-9f8c-58cd983c6e11 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:49.199043 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10508d-06e8-48be-a687-7284385be51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:49.199867 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10508d-06e8-48be-a687-7284385be51f None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:49.200157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10508d-06e8-48be-a687-7284385be51f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:49.201190 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10508d-06e8-48be-a687-7284385be51f None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f/users/f2602cd3e1e84ece9b07e9808df280f2/roles/575c54955d4a474e9c687a0100991d1d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:49.203363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10508d-06e8-48be-a687-7284385be51f None admin] RBAC: Authorizing `identity:create_grant(project_id=b99807a59bdf4c95bc2a8e8af4d5974f, user_id=f2602cd3e1e84ece9b07e9808df280f2, role_id=575c54955d4a474e9c687a0100991d1d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:49.204856 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10508d-06e8-48be-a687-7284385be51f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:49.225950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72145e-ce7e-4fe4-b7e7-aae545656e66 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:49.270698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f673e08-af1a-45a3-a6a4-9b44e3852f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:49.273578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f673e08-af1a-45a3-a6a4-9b44e3852f4c None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:49.274014 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f673e08-af1a-45a3-a6a4-9b44e3852f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:49.274642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f673e08-af1a-45a3-a6a4-9b44e3852f4c None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:49.275783 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f673e08-af1a-45a3-a6a4-9b44e3852f4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:49.277591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f673e08-af1a-45a3-a6a4-9b44e3852f4c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:49.279948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 65/141] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:18:49 2022] PUT /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f/users/f2602cd3e1e84ece9b07e9808df280f2/roles/575c54955d4a474e9c687a0100991d1d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:18:49.279948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10508d-06e8-48be-a687-7284385be51f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:49.363741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 77/142] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:18:49 2022] POST /identity/v3/users => generated 283 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:18:49.365719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f673e08-af1a-45a3-a6a4-9b44e3852f4c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:49.432280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:49.517852 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:49.525542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10508d-06e8-48be-a687-7284385be51f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:49.573080 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f673e08-af1a-45a3-a6a4-9b44e3852f4c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:49.642022 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b4fa3-ecbb-4617-b1b9-85d683fb245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:49.643694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b4fa3-ecbb-4617-b1b9-85d683fb245f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:49.646081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b4fa3-ecbb-4617-b1b9-85d683fb245f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:49.650813 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b4fa3-ecbb-4617-b1b9-85d683fb245f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:49.684685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b4fa3-ecbb-4617-b1b9-85d683fb245f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:49.705544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcb2b7-a0b6-4755-b48b-ddd51828d19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:49.707524 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcb2b7-a0b6-4755-b48b-ddd51828d19b None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:49.708265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcb2b7-a0b6-4755-b48b-ddd51828d19b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:49.708978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcb2b7-a0b6-4755-b48b-ddd51828d19b None admin] PATH_INFO: `/v3/projects/1cd26397ae054b20949c82f0a5807f1b/users/f2602cd3e1e84ece9b07e9808df280f2/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-916b4fa3-ecbb-4617-b1b9-85d683fb245f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:49.713558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:49.715346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:49.717082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:49.717082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:49.717082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:49.717082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:49.717082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:49.717082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:49.717082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:49.717082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:49.717082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:49.717082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:49.717082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:18:49.717082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:18:49.720685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcb2b7-a0b6-4755-b48b-ddd51828d19b None admin] RBAC: Authorizing `identity:create_grant(project_id=1cd26397ae054b20949c82f0a5807f1b, user_id=f2602cd3e1e84ece9b07e9808df280f2, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:49.723645 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcb2b7-a0b6-4755-b48b-ddd51828d19b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:49.726155 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 66/143] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:49.734416 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b4fa3-ecbb-4617-b1b9-85d683fb245f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:49.811503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 78/144] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:18:49 2022] PUT /identity/v3/projects/1cd26397ae054b20949c82f0a5807f1b/users/f2602cd3e1e84ece9b07e9808df280f2/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:18:49.948597 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a74a6d-0584-4579-b1ec-2ac57dbf70ae None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:49.949353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a74a6d-0584-4579-b1ec-2ac57dbf70ae None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:49.950585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a74a6d-0584-4579-b1ec-2ac57dbf70ae None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:49.953794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 79/145] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:49.960780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788841f-aa02-497a-8536-e5c7b5dd8ecf None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:49.961267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788841f-aa02-497a-8536-e5c7b5dd8ecf None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:49.961709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788841f-aa02-497a-8536-e5c7b5dd8ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:50.011434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b4fa3-ecbb-4617-b1b9-85d683fb245f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:50.023808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8788841f-aa02-497a-8536-e5c7b5dd8ecf None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:50.032787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8788841f-aa02-497a-8536-e5c7b5dd8ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:50.073787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:50.090213 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291a1fb-3d15-4251-8dfd-d357436d1714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:50.097920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291a1fb-3d15-4251-8dfd-d357436d1714 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:50.097920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291a1fb-3d15-4251-8dfd-d357436d1714 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:50.097920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291a1fb-3d15-4251-8dfd-d357436d1714 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:50.097920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291a1fb-3d15-4251-8dfd-d357436d1714 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:50.097920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291a1fb-3d15-4251-8dfd-d357436d1714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:50.097920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291a1fb-3d15-4251-8dfd-d357436d1714 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:50.111066 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 67/146] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:18:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:50.118307 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291a1fb-3d15-4251-8dfd-d357436d1714 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:50.192476 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 80/147] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:50.225483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788841f-aa02-497a-8536-e5c7b5dd8ecf None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:50.288998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291a1fb-3d15-4251-8dfd-d357436d1714 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:50.327718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec9b93-7253-4fee-938d-186d58ea2766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:50.328538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9b93-7253-4fee-938d-186d58ea2766 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:50.328828 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9b93-7253-4fee-938d-186d58ea2766 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:50.329113 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9b93-7253-4fee-938d-186d58ea2766 None admin] PATH_INFO: `/v3/users/2250c02ff5ec40548230fac70d69518c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:50.330391 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec9b93-7253-4fee-938d-186d58ea2766 None admin] RBAC: Authorizing `identity:get_user(user_id=2250c02ff5ec40548230fac70d69518c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:50.331864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec9b93-7253-4fee-938d-186d58ea2766 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:50.333904 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 68/148] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:50 2022] GET /identity/v3/users/2250c02ff5ec40548230fac70d69518c => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:50.336202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:50.339969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec9b93-7253-4fee-938d-186d58ea2766 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:50.388629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788841f-aa02-497a-8536-e5c7b5dd8ecf None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:50.421458 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:50.428726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7268868-a585-4bfb-ae52-70e27e7de2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:50.429542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7268868-a585-4bfb-ae52-70e27e7de2eb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:50.429826 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7268868-a585-4bfb-ae52-70e27e7de2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:50.430104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7268868-a585-4bfb-ae52-70e27e7de2eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:50.443029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7268868-a585-4bfb-ae52-70e27e7de2eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-f7268868-a585-4bfb-ae52-70e27e7de2eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:50.452549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:50.453541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:50.454349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:50.454349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:50.454349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:50.454349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:50.454349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:50.454349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:50.454349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:50.454349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:50.454349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:50.454349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:50.454349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:18:50.454349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:18:50.454349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 81/149] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:18:50.461588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7268868-a585-4bfb-ae52-70e27e7de2eb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:50.487484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec9b93-7253-4fee-938d-186d58ea2766 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:50.541879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6693ddf-2708-4afb-807f-8c17497feca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:50.542845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6693ddf-2708-4afb-807f-8c17497feca1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:50.543139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6693ddf-2708-4afb-807f-8c17497feca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:50.543419 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6693ddf-2708-4afb-807f-8c17497feca1 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:50.545201 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6693ddf-2708-4afb-807f-8c17497feca1 None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:50.546697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6693ddf-2708-4afb-807f-8c17497feca1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:50.548624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 69/150] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:50 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:50.554354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6693ddf-2708-4afb-807f-8c17497feca1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:50.612356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7268868-a585-4bfb-ae52-70e27e7de2eb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:50.639004 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:50.655103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d648b6-503f-4d4e-a769-ac89ccb86a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:50.655871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d648b6-503f-4d4e-a769-ac89ccb86a10 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:50.656158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d648b6-503f-4d4e-a769-ac89ccb86a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:50.656435 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d648b6-503f-4d4e-a769-ac89ccb86a10 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:50.657203 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d648b6-503f-4d4e-a769-ac89ccb86a10 None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:50.657509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d648b6-503f-4d4e-a769-ac89ccb86a10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:50.659098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d648b6-503f-4d4e-a769-ac89ccb86a10 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:50.669167 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6693ddf-2708-4afb-807f-8c17497feca1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:50.670116 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 82/151] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:18:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:50.676666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d648b6-503f-4d4e-a769-ac89ccb86a10 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:50.703030 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:50.717740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622bd48-3b62-4c3f-8342-dab67f5a4133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:50.719397 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622bd48-3b62-4c3f-8342-dab67f5a4133 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:50.719688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622bd48-3b62-4c3f-8342-dab67f5a4133 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:50.719973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622bd48-3b62-4c3f-8342-dab67f5a4133 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f/users/2250c02ff5ec40548230fac70d69518c/roles/ea3d8b70e23b44c0ba368fe1a3b9d04f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:50.723442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622bd48-3b62-4c3f-8342-dab67f5a4133 None admin] RBAC: Authorizing `identity:create_grant(project_id=b99807a59bdf4c95bc2a8e8af4d5974f, user_id=2250c02ff5ec40548230fac70d69518c, role_id=ea3d8b70e23b44c0ba368fe1a3b9d04f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:50.724585 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622bd48-3b62-4c3f-8342-dab67f5a4133 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:50.807895 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d648b6-503f-4d4e-a769-ac89ccb86a10 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:50.811313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 70/152] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:18:50 2022] PUT /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f/users/2250c02ff5ec40548230fac70d69518c/roles/ea3d8b70e23b44c0ba368fe1a3b9d04f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:18:50.894880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757ccb3-d032-48e6-93d6-2653e83072aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:50.896259 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757ccb3-d032-48e6-93d6-2653e83072aa None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:50.896747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757ccb3-d032-48e6-93d6-2653e83072aa None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:50.897210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757ccb3-d032-48e6-93d6-2653e83072aa None admin] PATH_INFO: `/v3/users/f2602cd3e1e84ece9b07e9808df280f2` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:50.899257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757ccb3-d032-48e6-93d6-2653e83072aa None admin] RBAC: Authorizing `identity:get_user(user_id=f2602cd3e1e84ece9b07e9808df280f2)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:50.901778 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757ccb3-d032-48e6-93d6-2653e83072aa None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:50.905373 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 83/153] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:50 2022] GET /identity/v3/users/f2602cd3e1e84ece9b07e9808df280f2 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:50.911673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622bd48-3b62-4c3f-8342-dab67f5a4133 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:50.988980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af917bf-b304-4d10-b0be-47aca23d9ffe None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:50.989428 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af917bf-b304-4d10-b0be-47aca23d9ffe None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:50.989837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af917bf-b304-4d10-b0be-47aca23d9ffe None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:50.992538 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 84/154] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:18:50.999079 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66602390-1e20-4336-b335-7cba4995df76 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:50.999512 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66602390-1e20-4336-b335-7cba4995df76 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:50.999940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66602390-1e20-4336-b335-7cba4995df76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:51.035919 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-66602390-1e20-4336-b335-7cba4995df76 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:51.037836 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-66602390-1e20-4336-b335-7cba4995df76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:51.071975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622bd48-3b62-4c3f-8342-dab67f5a4133 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:51.126941 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f051914-57c9-48dd-935c-a987f29d1321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:51.128012 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f051914-57c9-48dd-935c-a987f29d1321 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:51.128493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f051914-57c9-48dd-935c-a987f29d1321 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:51.129024 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f051914-57c9-48dd-935c-a987f29d1321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:51.194149 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:51.206709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:51.215179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f051914-57c9-48dd-935c-a987f29d1321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:51.216895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f051914-57c9-48dd-935c-a987f29d1321 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:51.264129 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 85/155] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:51.302700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66602390-1e20-4336-b335-7cba4995df76 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:51.333053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 71/156] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:18:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:18:51.339371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f051914-57c9-48dd-935c-a987f29d1321 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:51.464231 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:51.486548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f051914-57c9-48dd-935c-a987f29d1321 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:51.490819 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66602390-1e20-4336-b335-7cba4995df76 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:51.526312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62882c68-c149-46ea-b172-d8585709d590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:51.527479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62882c68-c149-46ea-b172-d8585709d590 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:51.527907 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62882c68-c149-46ea-b172-d8585709d590 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:51.528326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62882c68-c149-46ea-b172-d8585709d590 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:51.530009 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62882c68-c149-46ea-b172-d8585709d590 None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:51.531703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62882c68-c149-46ea-b172-d8585709d590 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:51.533923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 72/157] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:51 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:51.539953 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62882c68-c149-46ea-b172-d8585709d590 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:51.556573 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bae1b-cdec-4577-bcfc-050557aa35cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:51.557390 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bae1b-cdec-4577-bcfc-050557aa35cb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:51.557986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bae1b-cdec-4577-bcfc-050557aa35cb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:51.557986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bae1b-cdec-4577-bcfc-050557aa35cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:51.575936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bae1b-cdec-4577-bcfc-050557aa35cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-558bae1b-cdec-4577-bcfc-050557aa35cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:51.593020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:51.594144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:51.595106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:51.595106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:51.595106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:51.595106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:51.595106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:51.595106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:51.595106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:51.595106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:51.595106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:51.595106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:51.595106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:51.595106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:18:51.595106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 86/158] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:18:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:18:51.603340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bae1b-cdec-4577-bcfc-050557aa35cb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:51.660594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62882c68-c149-46ea-b172-d8585709d590 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:51.669323 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:51.720223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba46d56-bd84-4c7b-bd8a-fc1b9c0d8c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:51.722448 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba46d56-bd84-4c7b-bd8a-fc1b9c0d8c58 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:51.722962 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba46d56-bd84-4c7b-bd8a-fc1b9c0d8c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:51.723546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba46d56-bd84-4c7b-bd8a-fc1b9c0d8c58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:51.724747 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba46d56-bd84-4c7b-bd8a-fc1b9c0d8c58 None admin] RBAC: Adding query filter params (role.id=4b6ddd50803f4f9bbf171c5c7cb9af63, scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f, user.id=f2602cd3e1e84ece9b07e9808df280f2) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:51.725275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba46d56-bd84-4c7b-bd8a-fc1b9c0d8c58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:51.727017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba46d56-bd84-4c7b-bd8a-fc1b9c0d8c58 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:51.727342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bae1b-cdec-4577-bcfc-050557aa35cb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:51.741909 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 73/159] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:18:51 2022] GET /identity/v3/role_assignments?user.id=f2602cd3e1e84ece9b07e9808df280f2&scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f&role.id=4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:51.769193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633e458-2470-4cd3-897f-745d9a4d1fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:51.769889 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633e458-2470-4cd3-897f-745d9a4d1fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:51.770173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633e458-2470-4cd3-897f-745d9a4d1fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:51.770484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633e458-2470-4cd3-897f-745d9a4d1fa7 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:51.771253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633e458-2470-4cd3-897f-745d9a4d1fa7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:51.771559 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633e458-2470-4cd3-897f-745d9a4d1fa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:51.773098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633e458-2470-4cd3-897f-745d9a4d1fa7 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:51.783996 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 87/160] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:51.789748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba46d56-bd84-4c7b-bd8a-fc1b9c0d8c58 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:51.813165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:51.917297 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba46d56-bd84-4c7b-bd8a-fc1b9c0d8c58 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:51.969558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f4ffa-47c5-49e2-ae63-52029507d831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:51.970913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f4ffa-47c5-49e2-ae63-52029507d831 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:51.971399 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f4ffa-47c5-49e2-ae63-52029507d831 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:51.971888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f4ffa-47c5-49e2-ae63-52029507d831 None admin] PATH_INFO: `/v3/users/7af289109e3a4eaf8ae29a4b13dcfb4d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:51.973292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f4ffa-47c5-49e2-ae63-52029507d831 None admin] RBAC: Authorizing `identity:get_user(user_id=7af289109e3a4eaf8ae29a4b13dcfb4d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:51.975050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f4ffa-47c5-49e2-ae63-52029507d831 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:51.981382 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 74/161] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:51 2022] GET /identity/v3/users/7af289109e3a4eaf8ae29a4b13dcfb4d => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:51.983739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633e458-2470-4cd3-897f-745d9a4d1fa7 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:52.121057 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633e458-2470-4cd3-897f-745d9a4d1fa7 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:52.128895 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:52.163603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96012ce2-6f3a-4833-a339-b719b0534188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:52.164256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96012ce2-6f3a-4833-a339-b719b0534188 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:52.164543 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96012ce2-6f3a-4833-a339-b719b0534188 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:52.164823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96012ce2-6f3a-4833-a339-b719b0534188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:52.240535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96012ce2-6f3a-4833-a339-b719b0534188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:52.242043 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96012ce2-6f3a-4833-a339-b719b0534188 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:52.351862 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 88/162] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:18:52.358197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f4ffa-47c5-49e2-ae63-52029507d831 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:52.459973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:52.481133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f4ffa-47c5-49e2-ae63-52029507d831 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:52.519921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbbe28-788e-4d5b-afb8-331527c120a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:52.520715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbbe28-788e-4d5b-afb8-331527c120a4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:52.521000 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbbe28-788e-4d5b-afb8-331527c120a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:52.521279 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbbe28-788e-4d5b-afb8-331527c120a4 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:52.527138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbbe28-788e-4d5b-afb8-331527c120a4 None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:52.528678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbbe28-788e-4d5b-afb8-331527c120a4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:52.530672 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 75/163] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:52 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:18:52.536925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96012ce2-6f3a-4833-a339-b719b0534188 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:52.546341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:52.650440 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96012ce2-6f3a-4833-a339-b719b0534188 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:52.686917 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a0a98-ada0-4151-9f6f-36ff6aa926d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:52.687579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a0a98-ada0-4151-9f6f-36ff6aa926d1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:52.687864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a0a98-ada0-4151-9f6f-36ff6aa926d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:52.688144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a0a98-ada0-4151-9f6f-36ff6aa926d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:52.688984 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a0a98-ada0-4151-9f6f-36ff6aa926d1 None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f, user.id=7af289109e3a4eaf8ae29a4b13dcfb4d) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:52.689296 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a0a98-ada0-4151-9f6f-36ff6aa926d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:52.690798 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a0a98-ada0-4151-9f6f-36ff6aa926d1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:52.697250 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 89/164] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:18:52 2022] GET /identity/v3/role_assignments?user.id=7af289109e3a4eaf8ae29a4b13dcfb4d&scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:54.005884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6774b4b-75b2-4208-991c-cf8a34ab1d3f None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:54.006409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6774b4b-75b2-4208-991c-cf8a34ab1d3f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:54.006487 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6774b4b-75b2-4208-991c-cf8a34ab1d3f None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:54.008223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 76/165] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:54.009690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412c0bc-f3c8-4bb5-91a0-5caef2727304 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:54.010107 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412c0bc-f3c8-4bb5-91a0-5caef2727304 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:54.010273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412c0bc-f3c8-4bb5-91a0-5caef2727304 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:54.011883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 90/166] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:54.014282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99129d-813b-4274-9791-492ded2225c3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:54.014603 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99129d-813b-4274-9791-492ded2225c3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:54.014883 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99129d-813b-4274-9791-492ded2225c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:54.017619 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae0782-feda-4c17-b1ac-ddd40f7dede9 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:54.017901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae0782-feda-4c17-b1ac-ddd40f7dede9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:54.018180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae0782-feda-4c17-b1ac-ddd40f7dede9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:54.054569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0c99129d-813b-4274-9791-492ded2225c3 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:54.055794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0c99129d-813b-4274-9791-492ded2225c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:54.063195 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6bae0782-feda-4c17-b1ac-ddd40f7dede9 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:54.064386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6bae0782-feda-4c17-b1ac-ddd40f7dede9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:54.199548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 77/167] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:54.200105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:54.201452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51d792-e57b-4c1a-9abe-8a886dd99b6b None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:54.201741 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51d792-e57b-4c1a-9abe-8a886dd99b6b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:54.202021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51d792-e57b-4c1a-9abe-8a886dd99b6b None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:54.205816 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 78/168] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:54.208090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 91/169] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:54.211233 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bc176-c2f0-4c05-88df-a295e105375a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:54.213264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bc176-c2f0-4c05-88df-a295e105375a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:54.213264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bc176-c2f0-4c05-88df-a295e105375a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:54.230028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8d6bc176-c2f0-4c05-88df-a295e105375a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:54.231246 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8d6bc176-c2f0-4c05-88df-a295e105375a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:54.237318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae0782-feda-4c17-b1ac-ddd40f7dede9 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:54.348692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 79/170] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:18:54.349900 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bc176-c2f0-4c05-88df-a295e105375a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:54.371424 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:54.402415 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae0782-feda-4c17-b1ac-ddd40f7dede9 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:54.440183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88786-cd3d-496a-b77f-569557bb4c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:54.440988 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88786-cd3d-496a-b77f-569557bb4c16 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:54.441270 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88786-cd3d-496a-b77f-569557bb4c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:54.441548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88786-cd3d-496a-b77f-569557bb4c16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:54.453670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a88786-cd3d-496a-b77f-569557bb4c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-d0a88786-cd3d-496a-b77f-569557bb4c16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:54.461831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:54.462766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:54.463618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:54.463618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:54.463618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:54.463618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:54.463618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:54.463618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:54.463618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:54.463618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:54.463618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:54.463618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:54.463618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:54.463618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:18:54.463618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 92/171] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:18:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:18:54.464274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88786-cd3d-496a-b77f-569557bb4c16 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:54.532940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:54.578482 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88786-cd3d-496a-b77f-569557bb4c16 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:54.615715 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90c67e-dffb-4e2b-aa51-f037d9daaa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:54.617280 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90c67e-dffb-4e2b-aa51-f037d9daaa00 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:54.617565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90c67e-dffb-4e2b-aa51-f037d9daaa00 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:54.617846 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90c67e-dffb-4e2b-aa51-f037d9daaa00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:54.627593 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bc176-c2f0-4c05-88df-a295e105375a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:54.642418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90c67e-dffb-4e2b-aa51-f037d9daaa00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-dc90c67e-dffb-4e2b-aa51-f037d9daaa00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:54.653054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:54.654104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:54.655251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:54.655251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:54.655251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:54.655251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:54.655251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:54.655251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:54.655251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:54.655251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:54.655251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:54.655251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:54.655251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:18:54.655251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:18:54.658293 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 93/172] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:54.659572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90c67e-dffb-4e2b-aa51-f037d9daaa00 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:54.673016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dce704-d9b6-4f0f-9ac5-7b3cc6abb17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:54.674022 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dce704-d9b6-4f0f-9ac5-7b3cc6abb17e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:54.674377 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dce704-d9b6-4f0f-9ac5-7b3cc6abb17e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:54.675006 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dce704-d9b6-4f0f-9ac5-7b3cc6abb17e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:54.689950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dce704-d9b6-4f0f-9ac5-7b3cc6abb17e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-49dce704-d9b6-4f0f-9ac5-7b3cc6abb17e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:54.701466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:54.702844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:54.703624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:54.703624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:54.703624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:54.703624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:54.703624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:54.703624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:54.703624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:54.703624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:54.703624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:54.703624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:54.703624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:18:54.703624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:18:54.703624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 80/173] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:18:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:54.704599 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9276f-532d-4854-8c64-c331ee414a6c None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:54.704700 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9276f-532d-4854-8c64-c331ee414a6c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:54.704953 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9276f-532d-4854-8c64-c331ee414a6c None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:54.707344 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 81/174] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:54.712059 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9276f-532d-4854-8c64-c331ee414a6c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:54.783913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90c67e-dffb-4e2b-aa51-f037d9daaa00 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:54.789956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:54.808478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:54.824242 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238bf58-9c9f-4381-9214-6b9e1e03f501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:54.824934 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238bf58-9c9f-4381-9214-6b9e1e03f501 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:54.825218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238bf58-9c9f-4381-9214-6b9e1e03f501 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:54.825496 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238bf58-9c9f-4381-9214-6b9e1e03f501 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:54.826798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9276f-532d-4854-8c64-c331ee414a6c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:54.826907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238bf58-9c9f-4381-9214-6b9e1e03f501 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:54.827227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238bf58-9c9f-4381-9214-6b9e1e03f501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:54.828624 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238bf58-9c9f-4381-9214-6b9e1e03f501 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:54.842903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 94/175] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:54.842903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238bf58-9c9f-4381-9214-6b9e1e03f501 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:54.876264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcff6e2-7ad4-40ae-a63e-7bc3119c4470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:54.876945 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcff6e2-7ad4-40ae-a63e-7bc3119c4470 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:54.877252 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcff6e2-7ad4-40ae-a63e-7bc3119c4470 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:54.877514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcff6e2-7ad4-40ae-a63e-7bc3119c4470 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:54.878259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcff6e2-7ad4-40ae-a63e-7bc3119c4470 None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:54.878608 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcff6e2-7ad4-40ae-a63e-7bc3119c4470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:54.880001 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcff6e2-7ad4-40ae-a63e-7bc3119c4470 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:54.897499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 82/176] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:18:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:54.897499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c34aa5-892a-4802-9c69-6991a7a4b9ad None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:54.897499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c34aa5-892a-4802-9c69-6991a7a4b9ad None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:54.897499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c34aa5-892a-4802-9c69-6991a7a4b9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:54.920829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e7c34aa5-892a-4802-9c69-6991a7a4b9ad None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:54.922408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e7c34aa5-892a-4802-9c69-6991a7a4b9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:54.948529 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238bf58-9c9f-4381-9214-6b9e1e03f501 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:54.988034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4390450-f435-4618-945c-b2c85bb8451d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:54.988679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4390450-f435-4618-945c-b2c85bb8451d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:54.988960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4390450-f435-4618-945c-b2c85bb8451d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:54.989234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4390450-f435-4618-945c-b2c85bb8451d None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:54.989981 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4390450-f435-4618-945c-b2c85bb8451d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:54.990289 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4390450-f435-4618-945c-b2c85bb8451d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:54.991709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4390450-f435-4618-945c-b2c85bb8451d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:55.010362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 95/177] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:18:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:55.010966 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 83/178] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:55.011333 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2a219-17ba-4342-841a-84f897748962 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:55.011333 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2a219-17ba-4342-841a-84f897748962 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:55.011477 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c34aa5-892a-4802-9c69-6991a7a4b9ad None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:55.011545 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2a219-17ba-4342-841a-84f897748962 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:55.011545 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 96/179] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:55.011545 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2a219-17ba-4342-841a-84f897748962 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:55.066654 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:55.081971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:55.121912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c34aa5-892a-4802-9c69-6991a7a4b9ad None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:55.123621 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2a219-17ba-4342-841a-84f897748962 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:55.157606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07361c6b-59d8-494f-b486-6e22893c6966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:55.157844 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763f66f-9518-4f8f-80cc-2cd2f6e47195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:55.158526 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07361c6b-59d8-494f-b486-6e22893c6966 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:55.158739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763f66f-9518-4f8f-80cc-2cd2f6e47195 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:55.158844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07361c6b-59d8-494f-b486-6e22893c6966 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:55.159023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763f66f-9518-4f8f-80cc-2cd2f6e47195 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:55.159123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07361c6b-59d8-494f-b486-6e22893c6966 None admin] PATH_INFO: `/v3/users/31914a98aa66424ab02d5918805f06f1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:55.159302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763f66f-9518-4f8f-80cc-2cd2f6e47195 None admin] PATH_INFO: `/v3/users/f2602cd3e1e84ece9b07e9808df280f2` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:55.160534 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763f66f-9518-4f8f-80cc-2cd2f6e47195 None admin] RBAC: Authorizing `identity:get_user(user_id=f2602cd3e1e84ece9b07e9808df280f2)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:55.162001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763f66f-9518-4f8f-80cc-2cd2f6e47195 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:55.163684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 97/180] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:55 2022] GET /identity/v3/users/f2602cd3e1e84ece9b07e9808df280f2 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:55.164442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763f66f-9518-4f8f-80cc-2cd2f6e47195 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:55.176227 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07361c6b-59d8-494f-b486-6e22893c6966 None admin] RBAC: Authorizing `identity:get_user(user_id=31914a98aa66424ab02d5918805f06f1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:55.177411 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07361c6b-59d8-494f-b486-6e22893c6966 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:55.183788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 84/181] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:55 2022] GET /identity/v3/users/31914a98aa66424ab02d5918805f06f1 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:55.183788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2129a-c673-4e21-8dd6-0055394f375f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:55.183788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2129a-c673-4e21-8dd6-0055394f375f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:55.183788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2129a-c673-4e21-8dd6-0055394f375f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:55.198521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-5ba2129a-c673-4e21-8dd6-0055394f375f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:55.199709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5ba2129a-c673-4e21-8dd6-0055394f375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:55.269616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 85/182] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:55.270402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2129a-c673-4e21-8dd6-0055394f375f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:55.274196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763f66f-9518-4f8f-80cc-2cd2f6e47195 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:55.289864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:55.315430 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d01d4f-d2b1-433f-9831-16c71bce3d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:55.316494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d01d4f-d2b1-433f-9831-16c71bce3d20 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:55.317056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d01d4f-d2b1-433f-9831-16c71bce3d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:55.317328 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d01d4f-d2b1-433f-9831-16c71bce3d20 None admin] PATH_INFO: `/v3/users/f2602cd3e1e84ece9b07e9808df280f2` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:55.318543 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d01d4f-d2b1-433f-9831-16c71bce3d20 None admin] RBAC: Authorizing `identity:get_user(user_id=f2602cd3e1e84ece9b07e9808df280f2)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:55.320019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d01d4f-d2b1-433f-9831-16c71bce3d20 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:55.321646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 98/183] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:55 2022] GET /identity/v3/users/f2602cd3e1e84ece9b07e9808df280f2 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:55.322907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabd9f8-f95d-41ea-951c-162b3bf77187 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:55.323196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabd9f8-f95d-41ea-951c-162b3bf77187 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:55.323467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabd9f8-f95d-41ea-951c-162b3bf77187 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:55.323667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:55.324687 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 99/184] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:55.325363 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabd9f8-f95d-41ea-951c-162b3bf77187 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:55.378724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2129a-c673-4e21-8dd6-0055394f375f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:55.417502 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7507f9-8ebd-4215-88a1-a0a399e71922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:55.418340 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7507f9-8ebd-4215-88a1-a0a399e71922 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:55.418640 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7507f9-8ebd-4215-88a1-a0a399e71922 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:55.418918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7507f9-8ebd-4215-88a1-a0a399e71922 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:55.429815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7507f9-8ebd-4215-88a1-a0a399e71922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:55.433223 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabd9f8-f95d-41ea-951c-162b3bf77187 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-db7507f9-8ebd-4215-88a1-a0a399e71922 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:55.438915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:55.439932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:55.445534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:55.445534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:55.445534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:55.445534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:55.445534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:55.445534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:55.445534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:55.445534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:55.445534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:55.445534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:55.445534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:18:55.445534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:18:55.445534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 86/185] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:18:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:55.445534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7507f9-8ebd-4215-88a1-a0a399e71922 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:55.468253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063962c5-35ca-4280-b83d-f73c19a5ce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:55.468905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063962c5-35ca-4280-b83d-f73c19a5ce56 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:55.469187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063962c5-35ca-4280-b83d-f73c19a5ce56 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:55.469470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063962c5-35ca-4280-b83d-f73c19a5ce56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:55.520875 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:55.540239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063962c5-35ca-4280-b83d-f73c19a5ce56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:55.541983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063962c5-35ca-4280-b83d-f73c19a5ce56 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:55.546992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7507f9-8ebd-4215-88a1-a0a399e71922 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:55.557606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:55.583407 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ec342-7226-405c-90f3-0396b2051be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:55.584055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ec342-7226-405c-90f3-0396b2051be6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:55.584333 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ec342-7226-405c-90f3-0396b2051be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:55.584606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ec342-7226-405c-90f3-0396b2051be6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:55.649178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 100/186] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:18:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:18:55.650028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063962c5-35ca-4280-b83d-f73c19a5ce56 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:55.659986 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ec342-7226-405c-90f3-0396b2051be6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:55.661475 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ec342-7226-405c-90f3-0396b2051be6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:55.733890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:55.752498 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063962c5-35ca-4280-b83d-f73c19a5ce56 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:55.764638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 87/187] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:18:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:18:55.765491 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ec342-7226-405c-90f3-0396b2051be6 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:55.777445 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:55.793281 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b50d27-c28f-4c1e-8c25-9bed0433c56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:55.794142 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b50d27-c28f-4c1e-8c25-9bed0433c56d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:55.794961 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b50d27-c28f-4c1e-8c25-9bed0433c56d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:55.795236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b50d27-c28f-4c1e-8c25-9bed0433c56d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:55.805784 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b50d27-c28f-4c1e-8c25-9bed0433c56d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-01b50d27-c28f-4c1e-8c25-9bed0433c56d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:55.814192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:55.815153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:55.816069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:55.816069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:55.816069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:55.816069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:55.816069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:55.816069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:55.816069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:55.816069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:55.816069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:55.816069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:55.816069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:18:55.816069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:18:55.816069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 101/188] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:18:55.816964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af57f2-73ef-41af-a400-6a0b3791e114 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:55.816964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af57f2-73ef-41af-a400-6a0b3791e114 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:55.817248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af57f2-73ef-41af-a400-6a0b3791e114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:55.835509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-91af57f2-73ef-41af-a400-6a0b3791e114 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:55.836726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-91af57f2-73ef-41af-a400-6a0b3791e114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:55.868453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ec342-7226-405c-90f3-0396b2051be6 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:55.905199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6a8db-6f32-4768-ab2b-df6c5a833b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:55.905875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6a8db-6f32-4768-ab2b-df6c5a833b3a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:55.906125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 102/189] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:55.906257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6a8db-6f32-4768-ab2b-df6c5a833b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:55.907015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af57f2-73ef-41af-a400-6a0b3791e114 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:55.911283 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6a8db-6f32-4768-ab2b-df6c5a833b3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:55.977951 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:55.985128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6a8db-6f32-4768-ab2b-df6c5a833b3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:55.989961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6a8db-6f32-4768-ab2b-df6c5a833b3a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:55.998675 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:56.010536 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af57f2-73ef-41af-a400-6a0b3791e114 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:56.045162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f88ea-20c5-4ed1-852c-75ac6f7df82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:56.045799 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f88ea-20c5-4ed1-852c-75ac6f7df82a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:56.046074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f88ea-20c5-4ed1-852c-75ac6f7df82a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:56.046365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f88ea-20c5-4ed1-852c-75ac6f7df82a None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:56.047114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f88ea-20c5-4ed1-852c-75ac6f7df82a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:56.047431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f88ea-20c5-4ed1-852c-75ac6f7df82a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:56.048799 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f88ea-20c5-4ed1-852c-75ac6f7df82a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:56.056790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 103/190] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:18:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:56.057578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f88ea-20c5-4ed1-852c-75ac6f7df82a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:56.094839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 88/191] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:18:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:18:56.095685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6a8db-6f32-4768-ab2b-df6c5a833b3a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:56.165361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f88ea-20c5-4ed1-852c-75ac6f7df82a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:56.198114 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6a8db-6f32-4768-ab2b-df6c5a833b3a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:56.198941 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:56.204874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1601d-0138-46d0-86c4-80511c424486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:56.205745 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1601d-0138-46d0-86c4-80511c424486 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:56.206028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1601d-0138-46d0-86c4-80511c424486 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:56.206304 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1601d-0138-46d0-86c4-80511c424486 None admin] PATH_INFO: `/v3/projects/1cd26397ae054b20949c82f0a5807f1b` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:56.207539 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1601d-0138-46d0-86c4-80511c424486 None admin] RBAC: Authorizing `identity:get_project(project_id=1cd26397ae054b20949c82f0a5807f1b)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:56.209021 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1601d-0138-46d0-86c4-80511c424486 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:56.209849 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:56.210776 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 104/192] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:56 2022] GET /identity/v3/projects/1cd26397ae054b20949c82f0a5807f1b => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:56.211542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1601d-0138-46d0-86c4-80511c424486 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:56.233423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707c90f-df60-4a12-845d-40b84cb6d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:56.234294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707c90f-df60-4a12-845d-40b84cb6d32d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:56.234602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707c90f-df60-4a12-845d-40b84cb6d32d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:56.234877 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707c90f-df60-4a12-845d-40b84cb6d32d None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:56.236069 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707c90f-df60-4a12-845d-40b84cb6d32d None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:56.237537 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707c90f-df60-4a12-845d-40b84cb6d32d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:56.239428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 89/193] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:56 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:56.240078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707c90f-df60-4a12-845d-40b84cb6d32d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:56.315661 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1601d-0138-46d0-86c4-80511c424486 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:56.346298 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707c90f-df60-4a12-845d-40b84cb6d32d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:56.349224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3cfa2-2597-4ddd-8f90-4ed6ddc0c035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:56.349883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3cfa2-2597-4ddd-8f90-4ed6ddc0c035 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:56.350160 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3cfa2-2597-4ddd-8f90-4ed6ddc0c035 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:56.350474 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3cfa2-2597-4ddd-8f90-4ed6ddc0c035 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:56.351213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3cfa2-2597-4ddd-8f90-4ed6ddc0c035 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:56.351516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3cfa2-2597-4ddd-8f90-4ed6ddc0c035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:56.352912 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3cfa2-2597-4ddd-8f90-4ed6ddc0c035 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:56.361994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 105/194] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:18:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:56.362832 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3cfa2-2597-4ddd-8f90-4ed6ddc0c035 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:56.386556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094f548-0813-480e-a991-095465662e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:56.387350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094f548-0813-480e-a991-095465662e04 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:56.387633 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094f548-0813-480e-a991-095465662e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:56.387905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094f548-0813-480e-a991-095465662e04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:56.389172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094f548-0813-480e-a991-095465662e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:56.390647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094f548-0813-480e-a991-095465662e04 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:56.392267 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 90/195] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:18:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:56.396855 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094f548-0813-480e-a991-095465662e04 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:56.433247 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:56.457703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:56.476090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3cfa2-2597-4ddd-8f90-4ed6ddc0c035 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:56.511770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094f548-0813-480e-a991-095465662e04 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:56.511998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f707ef-7b8d-4fdf-991a-70eaec559d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:56.512844 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f707ef-7b8d-4fdf-991a-70eaec559d23 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:56.513163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f707ef-7b8d-4fdf-991a-70eaec559d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:56.513443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f707ef-7b8d-4fdf-991a-70eaec559d23 None admin] PATH_INFO: `/v3/users/31914a98aa66424ab02d5918805f06f1` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:56.514695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f707ef-7b8d-4fdf-991a-70eaec559d23 None admin] RBAC: Authorizing `identity:get_user(user_id=31914a98aa66424ab02d5918805f06f1)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:56.516173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f707ef-7b8d-4fdf-991a-70eaec559d23 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:56.517863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 106/196] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:56 2022] GET /identity/v3/users/31914a98aa66424ab02d5918805f06f1 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:56.522544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f707ef-7b8d-4fdf-991a-70eaec559d23 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:56.550753 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ebf0f-a7d9-4838-bab1-139849c2bd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:56.551606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ebf0f-a7d9-4838-bab1-139849c2bd51 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:56.551892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ebf0f-a7d9-4838-bab1-139849c2bd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:56.552167 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ebf0f-a7d9-4838-bab1-139849c2bd51 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:56.553352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ebf0f-a7d9-4838-bab1-139849c2bd51 None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:56.554855 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ebf0f-a7d9-4838-bab1-139849c2bd51 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:56.556556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 91/197] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:56 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:56.562127 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ebf0f-a7d9-4838-bab1-139849c2bd51 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:56.622280 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f707ef-7b8d-4fdf-991a-70eaec559d23 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:56.650989 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:56.657159 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c17461-182d-419e-9641-70943bbc8240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:56.657808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c17461-182d-419e-9641-70943bbc8240 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:56.658088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c17461-182d-419e-9641-70943bbc8240 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:56.658380 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c17461-182d-419e-9641-70943bbc8240 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:56.659210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c17461-182d-419e-9641-70943bbc8240 None admin] RBAC: Adding query filter params (role.id=4b6ddd50803f4f9bbf171c5c7cb9af63, scope.project.id=1cd26397ae054b20949c82f0a5807f1b, user.id=f2602cd3e1e84ece9b07e9808df280f2) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:56.659516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c17461-182d-419e-9641-70943bbc8240 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:56.660971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c17461-182d-419e-9641-70943bbc8240 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:56.666902 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 107/198] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:18:56 2022] GET /identity/v3/role_assignments?user.id=f2602cd3e1e84ece9b07e9808df280f2&scope.project.id=1cd26397ae054b20949c82f0a5807f1b&role.id=4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:56.667690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c17461-182d-419e-9641-70943bbc8240 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:56.682730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ebf0f-a7d9-4838-bab1-139849c2bd51 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:56.699976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:56.726356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69697509-61a4-4938-a7b2-c0e9bf190209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:56.727541 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69697509-61a4-4938-a7b2-c0e9bf190209 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:56.728287 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69697509-61a4-4938-a7b2-c0e9bf190209 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:56.728667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69697509-61a4-4938-a7b2-c0e9bf190209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:56.729639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69697509-61a4-4938-a7b2-c0e9bf190209 None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1, user.id=31914a98aa66424ab02d5918805f06f1) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:56.730052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69697509-61a4-4938-a7b2-c0e9bf190209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:56.732276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69697509-61a4-4938-a7b2-c0e9bf190209 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:56.739550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 92/199] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:18:56 2022] GET /identity/v3/role_assignments?user.id=31914a98aa66424ab02d5918805f06f1&scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:56.739550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69697509-61a4-4938-a7b2-c0e9bf190209 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:56.824691 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c17461-182d-419e-9641-70943bbc8240 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:56.876370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa9f25-a5fd-4a2d-8a37-be12607f3596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:56.877419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa9f25-a5fd-4a2d-8a37-be12607f3596 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:56.877709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa9f25-a5fd-4a2d-8a37-be12607f3596 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:56.879063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa9f25-a5fd-4a2d-8a37-be12607f3596 None admin] PATH_INFO: `/v3/users/2250c02ff5ec40548230fac70d69518c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:56.879560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa9f25-a5fd-4a2d-8a37-be12607f3596 None admin] RBAC: Authorizing `identity:get_user(user_id=2250c02ff5ec40548230fac70d69518c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:56.881134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa9f25-a5fd-4a2d-8a37-be12607f3596 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:56.883617 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 108/200] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:56 2022] GET /identity/v3/users/2250c02ff5ec40548230fac70d69518c => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:56.884285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa9f25-a5fd-4a2d-8a37-be12607f3596 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:56.896961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69697509-61a4-4938-a7b2-c0e9bf190209 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:56.956720 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697c613-d046-4993-95bb-384f80150d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:56.957398 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697c613-d046-4993-95bb-384f80150d79 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:56.957683 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697c613-d046-4993-95bb-384f80150d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:56.957961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697c613-d046-4993-95bb-384f80150d79 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:56.958766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697c613-d046-4993-95bb-384f80150d79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:56.960228 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697c613-d046-4993-95bb-384f80150d79 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:56.970500 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:57.012931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa9f25-a5fd-4a2d-8a37-be12607f3596 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:57.049927 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9eb37-d4c6-407d-9d9b-e50a1f224a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:57.050613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9eb37-d4c6-407d-9d9b-e50a1f224a9e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:57.050898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9eb37-d4c6-407d-9d9b-e50a1f224a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:57.051174 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9eb37-d4c6-407d-9d9b-e50a1f224a9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:57.062667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 93/201] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:18:56 2022] POST /identity/v3/users => generated 297 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:18:57.062667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697c613-d046-4993-95bb-384f80150d79 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:57.127722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:57.135505 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9eb37-d4c6-407d-9d9b-e50a1f224a9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:57.139868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9eb37-d4c6-407d-9d9b-e50a1f224a9e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:57.212206 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:57.217464 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697c613-d046-4993-95bb-384f80150d79 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:57.259786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e80dd3-5013-42db-9114-76918be84410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:57.260453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e80dd3-5013-42db-9114-76918be84410 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:57.260732 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e80dd3-5013-42db-9114-76918be84410 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:57.260995 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e80dd3-5013-42db-9114-76918be84410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:57.261837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e80dd3-5013-42db-9114-76918be84410 None admin] RBAC: Adding query filter params (role.id=575c54955d4a474e9c687a0100991d1d, scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f, user.id=f2602cd3e1e84ece9b07e9808df280f2) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:57.262145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e80dd3-5013-42db-9114-76918be84410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:57.264482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e80dd3-5013-42db-9114-76918be84410 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:57.273766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 109/202] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:18:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:18:57.276460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9eb37-d4c6-407d-9d9b-e50a1f224a9e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:57.276625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 94/203] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:18:57 2022] GET /identity/v3/role_assignments?user.id=f2602cd3e1e84ece9b07e9808df280f2&scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f&role.id=575c54955d4a474e9c687a0100991d1d => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:57.284071 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e80dd3-5013-42db-9114-76918be84410 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:57.435035 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:57.436156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9eb37-d4c6-407d-9d9b-e50a1f224a9e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:57.439159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e80dd3-5013-42db-9114-76918be84410 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:57.488905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7314c-3ff9-4d8d-b53b-4a02fad37228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:57.490880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7314c-3ff9-4d8d-b53b-4a02fad37228 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:57.491729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7314c-3ff9-4d8d-b53b-4a02fad37228 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:57.493244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15a894-24ff-4c01-bc06-164e067c4c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:57.493668 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7314c-3ff9-4d8d-b53b-4a02fad37228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:57.495692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15a894-24ff-4c01-bc06-164e067c4c42 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:57.495983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15a894-24ff-4c01-bc06-164e067c4c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:57.496264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15a894-24ff-4c01-bc06-164e067c4c42 None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:57.498068 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15a894-24ff-4c01-bc06-164e067c4c42 None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:57.500328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15a894-24ff-4c01-bc06-164e067c4c42 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:57.502233 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 95/204] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:57 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:57.508869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15a894-24ff-4c01-bc06-164e067c4c42 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:57.537383 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:57.598636 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7314c-3ff9-4d8d-b53b-4a02fad37228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:57.600803 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7314c-3ff9-4d8d-b53b-4a02fad37228 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:57.643321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15a894-24ff-4c01-bc06-164e067c4c42 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:57.685798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572206f-f053-444e-b240-42be0a55f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:57.686415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572206f-f053-444e-b240-42be0a55f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:57.686705 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572206f-f053-444e-b240-42be0a55f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:57.686984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572206f-f053-444e-b240-42be0a55f6f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:57.687858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572206f-f053-444e-b240-42be0a55f6f0 None admin] RBAC: Adding query filter params (role.id=575c54955d4a474e9c687a0100991d1d, scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1, user.id=31914a98aa66424ab02d5918805f06f1) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:57.688211 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572206f-f053-444e-b240-42be0a55f6f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:57.689698 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572206f-f053-444e-b240-42be0a55f6f0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:57.695792 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 96/205] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:18:57 2022] GET /identity/v3/role_assignments?user.id=31914a98aa66424ab02d5918805f06f1&scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1&role.id=575c54955d4a474e9c687a0100991d1d => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:57.718545 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 110/206] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:18:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:18:57.721490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572206f-f053-444e-b240-42be0a55f6f0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:57.779999 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:57.891220 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572206f-f053-444e-b240-42be0a55f6f0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:57.954139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01f3e3-7bfe-411a-b3c2-b8c6a871aefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:57.954139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01f3e3-7bfe-411a-b3c2-b8c6a871aefa None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:57.954139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01f3e3-7bfe-411a-b3c2-b8c6a871aefa None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:57.954139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01f3e3-7bfe-411a-b3c2-b8c6a871aefa None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:57.954549 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01f3e3-7bfe-411a-b3c2-b8c6a871aefa None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:57.955814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01f3e3-7bfe-411a-b3c2-b8c6a871aefa None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:57.957878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 97/207] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:18:57 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:57.963710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7314c-3ff9-4d8d-b53b-4a02fad37228 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:58.048024 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:58.094805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7314c-3ff9-4d8d-b53b-4a02fad37228 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:58.133926 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952d933-efbc-4d76-9677-cf2c65616841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:58.134987 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952d933-efbc-4d76-9677-cf2c65616841 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:58.135477 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952d933-efbc-4d76-9677-cf2c65616841 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:58.135954 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952d933-efbc-4d76-9677-cf2c65616841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:58.136994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952d933-efbc-4d76-9677-cf2c65616841 None admin] RBAC: Adding query filter params (role.id=ea3d8b70e23b44c0ba368fe1a3b9d04f, scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f, user.id=2250c02ff5ec40548230fac70d69518c) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:58.137507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952d933-efbc-4d76-9677-cf2c65616841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:58.139799 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952d933-efbc-4d76-9677-cf2c65616841 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:58.146647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 111/208] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:18:57 2022] GET /identity/v3/role_assignments?user.id=2250c02ff5ec40548230fac70d69518c&scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f&role.id=ea3d8b70e23b44c0ba368fe1a3b9d04f => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:59.078068 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eb49f-38e0-4170-82f0-ea911ff6403d None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:59.078678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eb49f-38e0-4170-82f0-ea911ff6403d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:59.078678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eb49f-38e0-4170-82f0-ea911ff6403d None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:59.080045 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 98/209] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:59.086674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcbf75-fd87-4746-9298-4e9aa796763f None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:59.087307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcbf75-fd87-4746-9298-4e9aa796763f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:59.087307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcbf75-fd87-4746-9298-4e9aa796763f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:59.108764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-19dcbf75-fd87-4746-9298-4e9aa796763f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:59.110009 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-19dcbf75-fd87-4746-9298-4e9aa796763f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:18:59.207407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 112/210] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:18:59.230084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587eb49f-38e0-4170-82f0-ea911ff6403d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:59.372752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:59.380353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587eb49f-38e0-4170-82f0-ea911ff6403d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:59.439393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5d683-d5b7-4d98-8ce2-0f4fd631700a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:59.440737 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5d683-d5b7-4d98-8ce2-0f4fd631700a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:59.441210 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5d683-d5b7-4d98-8ce2-0f4fd631700a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:59.441683 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5d683-d5b7-4d98-8ce2-0f4fd631700a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:59.460833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5d683-d5b7-4d98-8ce2-0f4fd631700a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-cec5d683-d5b7-4d98-8ce2-0f4fd631700a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:18:59.476873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:18:59.477846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:18:59.478726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:18:59.478726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:18:59.478726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:18:59.478726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:18:59.478726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:18:59.478726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:18:59.478726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:18:59.478726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:18:59.478726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:18:59.478726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:18:59.478726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:18:59.478726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:18:59.480138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 99/211] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:18:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:18:59.489320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcbf75-fd87-4746-9298-4e9aa796763f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:59.592542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:18:59.672676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcbf75-fd87-4746-9298-4e9aa796763f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:59.736320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145bbe1-5062-46e0-b226-1f9f8fe63744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:18:59.737471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145bbe1-5062-46e0-b226-1f9f8fe63744 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:59.737988 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145bbe1-5062-46e0-b226-1f9f8fe63744 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:59.738533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145bbe1-5062-46e0-b226-1f9f8fe63744 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:59.739975 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145bbe1-5062-46e0-b226-1f9f8fe63744 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:18:59.740538 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145bbe1-5062-46e0-b226-1f9f8fe63744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:18:59.743288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145bbe1-5062-46e0-b226-1f9f8fe63744 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:18:59.759733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 113/212] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:18:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:18:59.769231 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5d683-d5b7-4d98-8ce2-0f4fd631700a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:18:59.934991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276dc80-86c1-44e0-be86-b03ed75f5823 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:59.935614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276dc80-86c1-44e0-be86-b03ed75f5823 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:59.936156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276dc80-86c1-44e0-be86-b03ed75f5823 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:59.942367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 114/213] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:18:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:18:59.944538 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6211a-d69a-41ff-83da-0b196ebe3624 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:18:59.944824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6211a-d69a-41ff-83da-0b196ebe3624 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:18:59.945102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6211a-d69a-41ff-83da-0b196ebe3624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:18:59.960984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5d683-d5b7-4d98-8ce2-0f4fd631700a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:18:59.963391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f6d6211a-d69a-41ff-83da-0b196ebe3624 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:18:59.964696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f6d6211a-d69a-41ff-83da-0b196ebe3624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:00.001934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a056b-d0ef-4de9-acab-71259b4157cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:00.003213 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a056b-d0ef-4de9-acab-71259b4157cc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:00.003815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a056b-d0ef-4de9-acab-71259b4157cc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:00.004418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a056b-d0ef-4de9-acab-71259b4157cc None admin] PATH_INFO: `/v3/users/31914a98aa66424ab02d5918805f06f1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:00.005929 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a056b-d0ef-4de9-acab-71259b4157cc None admin] RBAC: Authorizing `identity:get_user(user_id=31914a98aa66424ab02d5918805f06f1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:00.007942 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a056b-d0ef-4de9-acab-71259b4157cc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:00.009882 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 100/214] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:18:59 2022] GET /identity/v3/users/31914a98aa66424ab02d5918805f06f1 => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:00.021763 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a056b-d0ef-4de9-acab-71259b4157cc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:00.051105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 115/215] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:19:00.052519 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119e0fb-1adb-4f9c-a390-62a4df94a567 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:00.053920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119e0fb-1adb-4f9c-a390-62a4df94a567 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:00.053920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119e0fb-1adb-4f9c-a390-62a4df94a567 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:00.054573 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 116/216] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:00.059905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:00.064363 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738930ef-fbe5-43e7-aaf6-361dc5c1907e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:00.065139 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738930ef-fbe5-43e7-aaf6-361dc5c1907e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:00.065621 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738930ef-fbe5-43e7-aaf6-361dc5c1907e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:00.085311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-738930ef-fbe5-43e7-aaf6-361dc5c1907e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:00.086514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-738930ef-fbe5-43e7-aaf6-361dc5c1907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:00.133011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:00.142784 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a056b-d0ef-4de9-acab-71259b4157cc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:00.160044 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 117/217] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:19:00.165510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738930ef-fbe5-43e7-aaf6-361dc5c1907e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:00.182278 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c080728-f2f5-4be1-a781-a2bb15177360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:00.183169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080728-f2f5-4be1-a781-a2bb15177360 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:00.183444 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080728-f2f5-4be1-a781-a2bb15177360 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:00.183721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080728-f2f5-4be1-a781-a2bb15177360 None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:00.185003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c080728-f2f5-4be1-a781-a2bb15177360 None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:00.186833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c080728-f2f5-4be1-a781-a2bb15177360 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:00.188540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 101/218] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:00 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:00.189702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49689bc6-aac1-41b9-a323-a411131bcd3d None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:00.189984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49689bc6-aac1-41b9-a323-a411131bcd3d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:00.190276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49689bc6-aac1-41b9-a323-a411131bcd3d None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:00.191503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 102/219] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:00.192188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49689bc6-aac1-41b9-a323-a411131bcd3d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:00.275075 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738930ef-fbe5-43e7-aaf6-361dc5c1907e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:00.297698 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:00.305600 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49689bc6-aac1-41b9-a323-a411131bcd3d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:00.316442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0474a6c-ab16-4a3d-9dc2-3ca004ebbbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:00.316442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0474a6c-ab16-4a3d-9dc2-3ca004ebbbce None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:00.316442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0474a6c-ab16-4a3d-9dc2-3ca004ebbbce None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:00.316780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0474a6c-ab16-4a3d-9dc2-3ca004ebbbce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:00.328031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0474a6c-ab16-4a3d-9dc2-3ca004ebbbce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-d0474a6c-ab16-4a3d-9dc2-3ca004ebbbce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:00.335890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:00.336969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:00.337942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:00.337942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:00.337942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:00.337942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:00.337942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:00.337942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:00.337942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:00.337942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:00.337942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:00.337942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:00.337942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:00.337942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:00.337942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 118/220] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:00.337942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0474a6c-ab16-4a3d-9dc2-3ca004ebbbce None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:00.357400 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34a0d1-0f76-4ac0-8dd9-d5e86cdd50b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:00.358206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34a0d1-0f76-4ac0-8dd9-d5e86cdd50b0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:00.358518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34a0d1-0f76-4ac0-8dd9-d5e86cdd50b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:00.358796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34a0d1-0f76-4ac0-8dd9-d5e86cdd50b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:00.369057 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34a0d1-0f76-4ac0-8dd9-d5e86cdd50b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-2d34a0d1-0f76-4ac0-8dd9-d5e86cdd50b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:00.377311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:00.378339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:00.379157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:00.379157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:00.379157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:00.379157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:00.379157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:00.379157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:00.379157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:00.379157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:00.379157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:00.379157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:00.379157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:00.379157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:00.379157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 103/221] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:19:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:00.379826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b3745-10f4-43d5-9c19-9c8fd3a182cc None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:00.380202 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b3745-10f4-43d5-9c19-9c8fd3a182cc None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:00.380319 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b3745-10f4-43d5-9c19-9c8fd3a182cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:00.393895 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:00.398164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d01b3745-10f4-43d5-9c19-9c8fd3a182cc None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:00.399408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d01b3745-10f4-43d5-9c19-9c8fd3a182cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:00.457716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0474a6c-ab16-4a3d-9dc2-3ca004ebbbce None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:00.471947 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 104/222] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:00.473158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b3745-10f4-43d5-9c19-9c8fd3a182cc None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:00.496646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3a5f6-fc6a-4e37-b8b3-d2db75f2ee72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:00.498160 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3a5f6-fc6a-4e37-b8b3-d2db75f2ee72 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:00.498474 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3a5f6-fc6a-4e37-b8b3-d2db75f2ee72 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:00.498754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3a5f6-fc6a-4e37-b8b3-d2db75f2ee72 None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1/users/31914a98aa66424ab02d5918805f06f1/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:00.500779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3a5f6-fc6a-4e37-b8b3-d2db75f2ee72 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f94f6141c04458d8c29d2f3bddeaaa1, user_id=31914a98aa66424ab02d5918805f06f1, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:00.502252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3a5f6-fc6a-4e37-b8b3-d2db75f2ee72 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:00.550090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 119/223] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:19:00 2022] PUT /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1/users/31914a98aa66424ab02d5918805f06f1/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:19:00.551042 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3a5f6-fc6a-4e37-b8b3-d2db75f2ee72 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:00.579541 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:00.598452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b3745-10f4-43d5-9c19-9c8fd3a182cc None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:00.642521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca59bd0-5ecd-4d07-b334-106539933cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:00.643549 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca59bd0-5ecd-4d07-b334-106539933cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:00.643836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca59bd0-5ecd-4d07-b334-106539933cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:00.644115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca59bd0-5ecd-4d07-b334-106539933cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:00.644889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca59bd0-5ecd-4d07-b334-106539933cf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:00.645196 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca59bd0-5ecd-4d07-b334-106539933cf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:00.646676 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca59bd0-5ecd-4d07-b334-106539933cf4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:00.661204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 105/224] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:00.661204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca59bd0-5ecd-4d07-b334-106539933cf4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:00.682162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:00.692267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3a5f6-fc6a-4e37-b8b3-d2db75f2ee72 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:00.740023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023877a-ff77-46c2-91fb-652360416354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:00.740697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023877a-ff77-46c2-91fb-652360416354 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:00.740978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023877a-ff77-46c2-91fb-652360416354 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:00.741251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023877a-ff77-46c2-91fb-652360416354 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:00.742004 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023877a-ff77-46c2-91fb-652360416354 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:00.742307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023877a-ff77-46c2-91fb-652360416354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:00.743792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023877a-ff77-46c2-91fb-652360416354 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:00.754768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 120/225] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:00.755637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023877a-ff77-46c2-91fb-652360416354 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:00.791007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca59bd0-5ecd-4d07-b334-106539933cf4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:00.830394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb8ab0-7750-4dde-92bd-ad1a95650512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:00.831103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb8ab0-7750-4dde-92bd-ad1a95650512 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:00.831392 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb8ab0-7750-4dde-92bd-ad1a95650512 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:00.831664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb8ab0-7750-4dde-92bd-ad1a95650512 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:00.832875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb8ab0-7750-4dde-92bd-ad1a95650512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:00.834380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb8ab0-7750-4dde-92bd-ad1a95650512 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:00.836060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 106/226] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:00.836832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb8ab0-7750-4dde-92bd-ad1a95650512 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:00.855473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:00.877582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023877a-ff77-46c2-91fb-652360416354 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:00.920652 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaff732-f3c9-4e13-a942-96c111e40431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:00.921543 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaff732-f3c9-4e13-a942-96c111e40431 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:00.921823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaff732-f3c9-4e13-a942-96c111e40431 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:00.922097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaff732-f3c9-4e13-a942-96c111e40431 None admin] PATH_INFO: `/v3/users/e677ebb81aeb40bba8ff966c9c58bcef` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:00.941936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaff732-f3c9-4e13-a942-96c111e40431 None admin] RBAC: Authorizing `identity:get_user(user_id=e677ebb81aeb40bba8ff966c9c58bcef)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:00.943565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaff732-f3c9-4e13-a942-96c111e40431 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:00.945555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 121/227] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:19:00 2022] GET /identity/v3/users/e677ebb81aeb40bba8ff966c9c58bcef => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:00.946301 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaff732-f3c9-4e13-a942-96c111e40431 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:00.969874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb8ab0-7750-4dde-92bd-ad1a95650512 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:00.970738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:01.008431 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7d077-c900-4a51-be79-9f712b175e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:01.009310 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7d077-c900-4a51-be79-9f712b175e56 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:01.009596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7d077-c900-4a51-be79-9f712b175e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:01.009876 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7d077-c900-4a51-be79-9f712b175e56 None admin] PATH_INFO: `/v3/users/31914a98aa66424ab02d5918805f06f1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:01.011125 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7d077-c900-4a51-be79-9f712b175e56 None admin] RBAC: Authorizing `identity:get_user(user_id=31914a98aa66424ab02d5918805f06f1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:01.012630 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7d077-c900-4a51-be79-9f712b175e56 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:01.014874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 107/228] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:19:00 2022] GET /identity/v3/users/31914a98aa66424ab02d5918805f06f1 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:01.015669 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7d077-c900-4a51-be79-9f712b175e56 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:01.063707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaff732-f3c9-4e13-a942-96c111e40431 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:01.103128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028c236-1bd2-4ba1-a4d0-aac5d1838521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:01.103719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028c236-1bd2-4ba1-a4d0-aac5d1838521 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:01.104006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028c236-1bd2-4ba1-a4d0-aac5d1838521 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:01.104280 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028c236-1bd2-4ba1-a4d0-aac5d1838521 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:01.104998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028c236-1bd2-4ba1-a4d0-aac5d1838521 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:01.105239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:01.106546 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028c236-1bd2-4ba1-a4d0-aac5d1838521 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:01.125406 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7d077-c900-4a51-be79-9f712b175e56 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:01.169059 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dbbd9-0168-41cd-9185-9e603d33d704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:01.170561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dbbd9-0168-41cd-9185-9e603d33d704 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:01.170987 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dbbd9-0168-41cd-9185-9e603d33d704 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:01.171402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dbbd9-0168-41cd-9185-9e603d33d704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:01.174078 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 122/229] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:19:00 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:19:01.177110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028c236-1bd2-4ba1-a4d0-aac5d1838521 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:01.260117 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361dbbd9-0168-41cd-9185-9e603d33d704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:01.262064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361dbbd9-0168-41cd-9185-9e603d33d704 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:01.296524 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:01.334982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028c236-1bd2-4ba1-a4d0-aac5d1838521 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:01.389636 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:01.392649 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583a9c1-e862-4df1-8095-d8e7c829512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:01.393610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583a9c1-e862-4df1-8095-d8e7c829512d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:01.397478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583a9c1-e862-4df1-8095-d8e7c829512d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:01.397478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583a9c1-e862-4df1-8095-d8e7c829512d None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:01.397478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583a9c1-e862-4df1-8095-d8e7c829512d None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:01.398922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583a9c1-e862-4df1-8095-d8e7c829512d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:01.400870 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 123/230] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:01 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:01.407945 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583a9c1-e862-4df1-8095-d8e7c829512d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:01.413510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 108/231] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:01.421510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dbbd9-0168-41cd-9185-9e603d33d704 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:01.547820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583a9c1-e862-4df1-8095-d8e7c829512d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:01.560947 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dbbd9-0168-41cd-9185-9e603d33d704 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:01.595323 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d731a-3b34-42be-ac0a-18b107866164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:01.596339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d731a-3b34-42be-ac0a-18b107866164 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:01.596622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d731a-3b34-42be-ac0a-18b107866164 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:01.596899 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d731a-3b34-42be-ac0a-18b107866164 None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1/users/31914a98aa66424ab02d5918805f06f1/roles/575c54955d4a474e9c687a0100991d1d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:01.602176 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d731a-3b34-42be-ac0a-18b107866164 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f94f6141c04458d8c29d2f3bddeaaa1, user_id=31914a98aa66424ab02d5918805f06f1, role_id=575c54955d4a474e9c687a0100991d1d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:01.603852 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d731a-3b34-42be-ac0a-18b107866164 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:01.612479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad160b54-e55f-45c4-9804-c9812f0d4ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:01.613414 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad160b54-e55f-45c4-9804-c9812f0d4ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:01.613696 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad160b54-e55f-45c4-9804-c9812f0d4ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:01.614004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad160b54-e55f-45c4-9804-c9812f0d4ee4 None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:01.615482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad160b54-e55f-45c4-9804-c9812f0d4ee4 None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:01.616982 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad160b54-e55f-45c4-9804-c9812f0d4ee4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:01.620062 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 109/232] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:01 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:01.626151 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad160b54-e55f-45c4-9804-c9812f0d4ee4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:01.665302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 124/233] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:19:01 2022] PUT /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1/users/31914a98aa66424ab02d5918805f06f1/roles/575c54955d4a474e9c687a0100991d1d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:19:01.722656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:01.799558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad160b54-e55f-45c4-9804-c9812f0d4ee4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:01.852187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff985a-98f2-4eef-accb-37ea3cc54665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:01.852849 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff985a-98f2-4eef-accb-37ea3cc54665 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:01.853131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff985a-98f2-4eef-accb-37ea3cc54665 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:01.853405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff985a-98f2-4eef-accb-37ea3cc54665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:01.854245 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff985a-98f2-4eef-accb-37ea3cc54665 None admin] RBAC: Adding query filter params (role.id=4b6ddd50803f4f9bbf171c5c7cb9af63, scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1, user.id=e677ebb81aeb40bba8ff966c9c58bcef) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:01.854587 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff985a-98f2-4eef-accb-37ea3cc54665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:01.856355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff985a-98f2-4eef-accb-37ea3cc54665 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:01.863412 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 110/234] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:19:01 2022] GET /identity/v3/role_assignments?user.id=e677ebb81aeb40bba8ff966c9c58bcef&scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1&role.id=4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:02.910749 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a947894-7a8f-48ed-a34d-02445184e528 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:02.911265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a947894-7a8f-48ed-a34d-02445184e528 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:02.911453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a947894-7a8f-48ed-a34d-02445184e528 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:02.912818 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 125/235] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:02.918395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f7c43-cbb6-42a3-90a2-251da4d7f552 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:02.918900 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f7c43-cbb6-42a3-90a2-251da4d7f552 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:02.918990 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f7c43-cbb6-42a3-90a2-251da4d7f552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:02.941050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2c8f7c43-cbb6-42a3-90a2-251da4d7f552 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:02.942255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2c8f7c43-cbb6-42a3-90a2-251da4d7f552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:03.030734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 111/236] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:03.068632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a947894-7a8f-48ed-a34d-02445184e528 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:03.071926 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:03.199594 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a947894-7a8f-48ed-a34d-02445184e528 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:03.251680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb63fb3-c962-4fb6-bf8b-495574cfb28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:03.252484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb63fb3-c962-4fb6-bf8b-495574cfb28e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:03.252764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb63fb3-c962-4fb6-bf8b-495574cfb28e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:03.253040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb63fb3-c962-4fb6-bf8b-495574cfb28e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:03.269199 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb63fb3-c962-4fb6-bf8b-495574cfb28e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-abb63fb3-c962-4fb6-bf8b-495574cfb28e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:03.277370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:03.278257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:03.279168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:03.279168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:03.279168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:03.279168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:03.279168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:03.279168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:03.279168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:03.279168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:03.279168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:03.279168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:03.279168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:19:03.279168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:03.279168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 126/237] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:19:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:19:03.285875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f7c43-cbb6-42a3-90a2-251da4d7f552 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:03.337811 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:03.401679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f7c43-cbb6-42a3-90a2-251da4d7f552 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:03.439953 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e355f-3c7c-439c-82d4-b3927fd50840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:03.440629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e355f-3c7c-439c-82d4-b3927fd50840 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:03.440911 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e355f-3c7c-439c-82d4-b3927fd50840 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:03.441236 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e355f-3c7c-439c-82d4-b3927fd50840 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:03.441993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e355f-3c7c-439c-82d4-b3927fd50840 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:03.442299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e355f-3c7c-439c-82d4-b3927fd50840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:03.443723 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e355f-3c7c-439c-82d4-b3927fd50840 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:03.453670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 112/238] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:03.458888 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb63fb3-c962-4fb6-bf8b-495574cfb28e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:03.539493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:03.589635 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb63fb3-c962-4fb6-bf8b-495574cfb28e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:03.637307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47ae7b-4343-443b-b727-7f21490d2c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:03.638517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47ae7b-4343-443b-b727-7f21490d2c50 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:03.638845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47ae7b-4343-443b-b727-7f21490d2c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:03.639125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47ae7b-4343-443b-b727-7f21490d2c50 None admin] PATH_INFO: `/v3/users/31914a98aa66424ab02d5918805f06f1` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:03.640365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47ae7b-4343-443b-b727-7f21490d2c50 None admin] RBAC: Authorizing `identity:get_user(user_id=31914a98aa66424ab02d5918805f06f1)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:03.641864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47ae7b-4343-443b-b727-7f21490d2c50 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:03.643642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 127/239] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:19:03 2022] GET /identity/v3/users/31914a98aa66424ab02d5918805f06f1 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:03.649977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e355f-3c7c-439c-82d4-b3927fd50840 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:03.760681 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e355f-3c7c-439c-82d4-b3927fd50840 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:03.768771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:03.803512 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c51394-92d6-4e5f-a687-9cb6eec35acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:03.804173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c51394-92d6-4e5f-a687-9cb6eec35acd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:03.804455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c51394-92d6-4e5f-a687-9cb6eec35acd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:03.804731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c51394-92d6-4e5f-a687-9cb6eec35acd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:03.889808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d3193-9cb3-4115-a543-38ceb9c672da None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:03.890137 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d3193-9cb3-4115-a543-38ceb9c672da None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:03.890382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d3193-9cb3-4115-a543-38ceb9c672da None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:03.891990 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 128/240] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:19:03.903481 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d8d27-0186-41cd-a23d-6904d7879a2f None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:03.903781 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d8d27-0186-41cd-a23d-6904d7879a2f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:03.904092 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d8d27-0186-41cd-a23d-6904d7879a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:03.905713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c51394-92d6-4e5f-a687-9cb6eec35acd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:03.908244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c51394-92d6-4e5f-a687-9cb6eec35acd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:03.937234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-688d8d27-0186-41cd-a23d-6904d7879a2f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:03.938183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-688d8d27-0186-41cd-a23d-6904d7879a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:04.083542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 113/241] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:04.095382 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c51394-92d6-4e5f-a687-9cb6eec35acd None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:04.096060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 129/242] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:19:04.110346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:04.183644 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d8d27-0186-41cd-a23d-6904d7879a2f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:04.231048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c51394-92d6-4e5f-a687-9cb6eec35acd None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:04.270474 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25e942-bd08-446d-b3cb-2d6cfed6c9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:04.271446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25e942-bd08-446d-b3cb-2d6cfed6c9cf None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:04.271723 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25e942-bd08-446d-b3cb-2d6cfed6c9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:04.271992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25e942-bd08-446d-b3cb-2d6cfed6c9cf None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:04.272633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:04.274521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25e942-bd08-446d-b3cb-2d6cfed6c9cf None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:04.276180 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25e942-bd08-446d-b3cb-2d6cfed6c9cf None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:04.282466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 114/243] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:04 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:04.289730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42a481-740e-44cc-b9fd-213c5345d1d7 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:04.289730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42a481-740e-44cc-b9fd-213c5345d1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:04.289730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42a481-740e-44cc-b9fd-213c5345d1d7 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:04.289730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 115/244] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:04.289730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42a481-740e-44cc-b9fd-213c5345d1d7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:04.334889 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d8d27-0186-41cd-a23d-6904d7879a2f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:04.376070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1da53-c5f5-4bb1-85f9-f0e172062a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:04.376615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1da53-c5f5-4bb1-85f9-f0e172062a01 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:04.376961 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1da53-c5f5-4bb1-85f9-f0e172062a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:04.377239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1da53-c5f5-4bb1-85f9-f0e172062a01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:04.389940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1da53-c5f5-4bb1-85f9-f0e172062a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-0da1da53-c5f5-4bb1-85f9-f0e172062a01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:04.398560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:04.411377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:04.412171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:04.412171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:04.412171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:04.412171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:04.412171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:04.412171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:04.412171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:04.412171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:04.412171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:04.412171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:04.412171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:19:04.412171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:04.412171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 130/245] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:04.412171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525e9c3-0eb9-43a8-81d5-3f879ebd839f None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:04.412899 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525e9c3-0eb9-43a8-81d5-3f879ebd839f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:04.412899 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525e9c3-0eb9-43a8-81d5-3f879ebd839f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:04.422119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:04.427185 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c525e9c3-0eb9-43a8-81d5-3f879ebd839f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:04.428459 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c525e9c3-0eb9-43a8-81d5-3f879ebd839f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:04.450263 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42a481-740e-44cc-b9fd-213c5345d1d7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:04.491433 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85624d0d-5948-444e-9e42-2880ccf77540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:04.492083 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85624d0d-5948-444e-9e42-2880ccf77540 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:04.492370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85624d0d-5948-444e-9e42-2880ccf77540 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:04.492647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85624d0d-5948-444e-9e42-2880ccf77540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:04.493480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85624d0d-5948-444e-9e42-2880ccf77540 None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1, user.id=31914a98aa66424ab02d5918805f06f1) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:04.493791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85624d0d-5948-444e-9e42-2880ccf77540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:04.495269 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85624d0d-5948-444e-9e42-2880ccf77540 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:04.510353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 116/246] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:19:04 2022] GET /identity/v3/role_assignments?user.id=31914a98aa66424ab02d5918805f06f1&scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:04.510545 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 131/247] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:04.510637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85624d0d-5948-444e-9e42-2880ccf77540 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:04.510720 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0a5c8-2c92-41d2-b49f-19b79c4724d7 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:04.510720 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0a5c8-2c92-41d2-b49f-19b79c4724d7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:04.510720 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0a5c8-2c92-41d2-b49f-19b79c4724d7 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:04.510720 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 132/248] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:04.511777 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd77782-cc31-48fa-b457-176a7af16505 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:04.512071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd77782-cc31-48fa-b457-176a7af16505 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:04.512375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd77782-cc31-48fa-b457-176a7af16505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:04.536761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-4cd77782-cc31-48fa-b457-176a7af16505 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:04.538420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4cd77782-cc31-48fa-b457-176a7af16505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:04.600521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:04.632813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 133/249] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:19:04.638566 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd77782-cc31-48fa-b457-176a7af16505 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:04.643368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85624d0d-5948-444e-9e42-2880ccf77540 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:04.690669 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92585dc4-9826-4a9a-a754-c86ca53c7d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:04.691361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92585dc4-9826-4a9a-a754-c86ca53c7d37 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:04.691641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92585dc4-9826-4a9a-a754-c86ca53c7d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:04.691917 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92585dc4-9826-4a9a-a754-c86ca53c7d37 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:04.692676 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92585dc4-9826-4a9a-a754-c86ca53c7d37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:04.692984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92585dc4-9826-4a9a-a754-c86ca53c7d37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:04.694424 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92585dc4-9826-4a9a-a754-c86ca53c7d37 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:04.701606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:04.710524 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 117/250] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:04.712931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92585dc4-9826-4a9a-a754-c86ca53c7d37 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:04.783794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd77782-cc31-48fa-b457-176a7af16505 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:04.824980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ded04f-312e-4d72-b547-7d5a944669ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:04.826498 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ded04f-312e-4d72-b547-7d5a944669ab None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:04.826784 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ded04f-312e-4d72-b547-7d5a944669ab None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:04.827066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ded04f-312e-4d72-b547-7d5a944669ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:04.828296 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ded04f-312e-4d72-b547-7d5a944669ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:04.829793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ded04f-312e-4d72-b547-7d5a944669ab None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:04.831511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 134/251] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:04.836353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b9d4f-9674-4fb8-b967-324355bf35a0 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:04.836353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b9d4f-9674-4fb8-b967-324355bf35a0 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:04.836353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b9d4f-9674-4fb8-b967-324355bf35a0 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:04.836353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 135/252] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:04.836353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b9d4f-9674-4fb8-b967-324355bf35a0 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:04.843546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92585dc4-9826-4a9a-a754-c86ca53c7d37 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:04.877056 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d24a99-acb5-49fc-b131-e25473618569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:04.877774 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d24a99-acb5-49fc-b131-e25473618569 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:04.878052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d24a99-acb5-49fc-b131-e25473618569 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:04.878350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d24a99-acb5-49fc-b131-e25473618569 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:04.889037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:04.889989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d24a99-acb5-49fc-b131-e25473618569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-62d24a99-acb5-49fc-b131-e25473618569 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:04.898138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:04.902847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:04.905162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:04.905162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:04.905162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:04.905162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:04.905162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:04.905162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:04.905162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:04.905162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:04.905162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:04.905162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:04.905162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:04.905162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:04.905162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 118/253] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:19:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:04.905162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d24a99-acb5-49fc-b131-e25473618569 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:04.948875 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b9d4f-9674-4fb8-b967-324355bf35a0 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:04.964181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:04.985273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db11089-3bcf-4b63-8bba-28a6dbd67cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:04.986131 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db11089-3bcf-4b63-8bba-28a6dbd67cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:04.986434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db11089-3bcf-4b63-8bba-28a6dbd67cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:04.986709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db11089-3bcf-4b63-8bba-28a6dbd67cc5 None admin] PATH_INFO: `/v3/users/6bbfc6cb9337478cbb90313e52550fff` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:05.000750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db11089-3bcf-4b63-8bba-28a6dbd67cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=6bbfc6cb9337478cbb90313e52550fff)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:05.002208 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db11089-3bcf-4b63-8bba-28a6dbd67cc5 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:05.003945 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 136/254] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:19:04 2022] GET /identity/v3/users/6bbfc6cb9337478cbb90313e52550fff => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:05.005126 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faeb4a-adb0-4a34-bb5f-eac8fd881e84 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:05.005407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faeb4a-adb0-4a34-bb5f-eac8fd881e84 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:05.005677 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faeb4a-adb0-4a34-bb5f-eac8fd881e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:05.006460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d24a99-acb5-49fc-b131-e25473618569 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:05.022646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-14faeb4a-adb0-4a34-bb5f-eac8fd881e84 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:05.023823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-14faeb4a-adb0-4a34-bb5f-eac8fd881e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:05.044665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8c23a-983a-4502-9bd3-642614173f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:05.045340 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8c23a-983a-4502-9bd3-642614173f6f None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:05.045626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8c23a-983a-4502-9bd3-642614173f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:05.045903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8c23a-983a-4502-9bd3-642614173f6f None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:05.046655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8c23a-983a-4502-9bd3-642614173f6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:05.048128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8c23a-983a-4502-9bd3-642614173f6f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:05.094276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 137/255] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:05.095151 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faeb4a-adb0-4a34-bb5f-eac8fd881e84 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:05.126888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 119/256] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:19:04 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:19:05.128396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8c23a-983a-4502-9bd3-642614173f6f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:05.143950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:05.223388 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faeb4a-adb0-4a34-bb5f-eac8fd881e84 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:05.257492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8c23a-983a-4502-9bd3-642614173f6f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:05.266944 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988f33c-aeec-4ca9-a73e-f182826544a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:05.267729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988f33c-aeec-4ca9-a73e-f182826544a6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:05.268085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988f33c-aeec-4ca9-a73e-f182826544a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:05.268375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988f33c-aeec-4ca9-a73e-f182826544a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:05.269157 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988f33c-aeec-4ca9-a73e-f182826544a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:05.269463 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988f33c-aeec-4ca9-a73e-f182826544a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:05.270991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988f33c-aeec-4ca9-a73e-f182826544a6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:05.279833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:05.281533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 138/257] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:05.283836 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988f33c-aeec-4ca9-a73e-f182826544a6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:05.307385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30320c-01ef-4644-b7e7-840d92f1b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:05.308643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30320c-01ef-4644-b7e7-840d92f1b9bf None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:05.309548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30320c-01ef-4644-b7e7-840d92f1b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:05.310515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30320c-01ef-4644-b7e7-840d92f1b9bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:05.421255 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:05.427217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30320c-01ef-4644-b7e7-840d92f1b9bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:05.428676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988f33c-aeec-4ca9-a73e-f182826544a6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:05.428794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30320c-01ef-4644-b7e7-840d92f1b9bf None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:05.483749 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb1814-8080-48bd-8b43-fdbd6e1c6c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:05.484565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb1814-8080-48bd-8b43-fdbd6e1c6c15 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:05.484845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb1814-8080-48bd-8b43-fdbd6e1c6c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:05.485121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb1814-8080-48bd-8b43-fdbd6e1c6c15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:05.500712 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb1814-8080-48bd-8b43-fdbd6e1c6c15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-17eb1814-8080-48bd-8b43-fdbd6e1c6c15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:05.509908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:05.511037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:05.511901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:05.511901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:05.511901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:05.511901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:05.511901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:05.511901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:05.511901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:05.511901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:05.511901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:05.511901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:05.511901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:05.511901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:05.511901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 139/258] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:05.512569 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb1814-8080-48bd-8b43-fdbd6e1c6c15 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:05.565375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 120/259] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:05.566767 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30320c-01ef-4644-b7e7-840d92f1b9bf None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:05.591483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:05.643902 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb1814-8080-48bd-8b43-fdbd6e1c6c15 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:05.690700 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30320c-01ef-4644-b7e7-840d92f1b9bf None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:05.692950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87354e3a-0ce5-47a8-b73d-68e7d873302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:05.694805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87354e3a-0ce5-47a8-b73d-68e7d873302e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:05.695089 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87354e3a-0ce5-47a8-b73d-68e7d873302e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:05.695365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87354e3a-0ce5-47a8-b73d-68e7d873302e None admin] PATH_INFO: `/v3/users/31914a98aa66424ab02d5918805f06f1` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:05.696633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87354e3a-0ce5-47a8-b73d-68e7d873302e None admin] RBAC: Authorizing `identity:get_user(user_id=31914a98aa66424ab02d5918805f06f1)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:05.698123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87354e3a-0ce5-47a8-b73d-68e7d873302e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:05.701255 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 140/260] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:19:05 2022] GET /identity/v3/users/31914a98aa66424ab02d5918805f06f1 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:05.706598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87354e3a-0ce5-47a8-b73d-68e7d873302e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:05.735569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a26798-ede9-4a6d-83f5-e18c0bcd9efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:05.736338 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a26798-ede9-4a6d-83f5-e18c0bcd9efb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:05.736549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:05.736686 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a26798-ede9-4a6d-83f5-e18c0bcd9efb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:05.737311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a26798-ede9-4a6d-83f5-e18c0bcd9efb None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:05.738352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a26798-ede9-4a6d-83f5-e18c0bcd9efb None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:05.738535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a26798-ede9-4a6d-83f5-e18c0bcd9efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:05.739941 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a26798-ede9-4a6d-83f5-e18c0bcd9efb None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:05.750639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 121/261] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:05.751505 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a26798-ede9-4a6d-83f5-e18c0bcd9efb None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:05.839691 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87354e3a-0ce5-47a8-b73d-68e7d873302e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:05.872857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:05.880390 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d732d8-be6a-4ab8-9133-091f217886d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:05.881487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d732d8-be6a-4ab8-9133-091f217886d4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:05.881904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d732d8-be6a-4ab8-9133-091f217886d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:05.882317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d732d8-be6a-4ab8-9133-091f217886d4 None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:05.896125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d732d8-be6a-4ab8-9133-091f217886d4 None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:05.896125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d732d8-be6a-4ab8-9133-091f217886d4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:05.896125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 141/262] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:05 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:05.896125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d732d8-be6a-4ab8-9133-091f217886d4 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:05.899804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a26798-ede9-4a6d-83f5-e18c0bcd9efb None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:05.957465 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48b59f-1074-47dd-8dee-a34e65346137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:05.958217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48b59f-1074-47dd-8dee-a34e65346137 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:05.958602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48b59f-1074-47dd-8dee-a34e65346137 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:05.959235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48b59f-1074-47dd-8dee-a34e65346137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:06.014893 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:06.023494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d732d8-be6a-4ab8-9133-091f217886d4 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:06.053345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48b59f-1074-47dd-8dee-a34e65346137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:06.055894 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48b59f-1074-47dd-8dee-a34e65346137 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:06.066699 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2817bc9-2726-45f7-82bd-1932eaccff91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:06.067865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2817bc9-2726-45f7-82bd-1932eaccff91 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:06.068287 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2817bc9-2726-45f7-82bd-1932eaccff91 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:06.068701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2817bc9-2726-45f7-82bd-1932eaccff91 None admin] PATH_INFO: `/v3/users/e677ebb81aeb40bba8ff966c9c58bcef` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:06.070221 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2817bc9-2726-45f7-82bd-1932eaccff91 None admin] RBAC: Authorizing `identity:get_user(user_id=e677ebb81aeb40bba8ff966c9c58bcef)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:06.072101 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2817bc9-2726-45f7-82bd-1932eaccff91 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:06.074661 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 142/263] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:19:05 2022] GET /identity/v3/users/e677ebb81aeb40bba8ff966c9c58bcef => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:06.076290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2817bc9-2726-45f7-82bd-1932eaccff91 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:06.164074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:06.189586 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 122/264] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:06.191048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48b59f-1074-47dd-8dee-a34e65346137 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:06.216194 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2817bc9-2726-45f7-82bd-1932eaccff91 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:06.264713 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d03e4-8eba-45b1-80a3-4b3fce2be0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:06.265376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d03e4-8eba-45b1-80a3-4b3fce2be0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:06.265660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d03e4-8eba-45b1-80a3-4b3fce2be0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:06.266229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d03e4-8eba-45b1-80a3-4b3fce2be0f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:06.267383 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d03e4-8eba-45b1-80a3-4b3fce2be0f5 None admin] RBAC: Adding query filter params (role.id=ea3d8b70e23b44c0ba368fe1a3b9d04f, scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1, user.id=6bbfc6cb9337478cbb90313e52550fff) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:06.267704 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d03e4-8eba-45b1-80a3-4b3fce2be0f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:06.270062 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d03e4-8eba-45b1-80a3-4b3fce2be0f5 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:06.277198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 143/265] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:19:06 2022] GET /identity/v3/role_assignments?user.id=6bbfc6cb9337478cbb90313e52550fff&scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1&role.id=ea3d8b70e23b44c0ba368fe1a3b9d04f => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:06.278582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d03e4-8eba-45b1-80a3-4b3fce2be0f5 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:06.315408 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:06.351615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48b59f-1074-47dd-8dee-a34e65346137 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:06.414235 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d03e4-8eba-45b1-80a3-4b3fce2be0f5 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:06.435222 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51aa3b6-39fb-4f74-8729-c63986d01094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:06.436287 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51aa3b6-39fb-4f74-8729-c63986d01094 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:06.436567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51aa3b6-39fb-4f74-8729-c63986d01094 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:06.436840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51aa3b6-39fb-4f74-8729-c63986d01094 None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:06.438233 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51aa3b6-39fb-4f74-8729-c63986d01094 None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:06.439852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51aa3b6-39fb-4f74-8729-c63986d01094 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:06.441961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 123/266] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:06 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:06.462565 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51aa3b6-39fb-4f74-8729-c63986d01094 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:06.465539 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66151231-c43a-4dcc-8170-e2bda866846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:06.467068 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151231-c43a-4dcc-8170-e2bda866846b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:06.467517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151231-c43a-4dcc-8170-e2bda866846b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:06.467965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151231-c43a-4dcc-8170-e2bda866846b None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:06.471101 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66151231-c43a-4dcc-8170-e2bda866846b None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:06.472960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66151231-c43a-4dcc-8170-e2bda866846b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:06.475466 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 144/267] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:06 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:06.482707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66151231-c43a-4dcc-8170-e2bda866846b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:06.587531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:06.612229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:06.623712 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66151231-c43a-4dcc-8170-e2bda866846b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:06.666980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88df2bf-2b26-4410-98db-09234b8a6d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:06.668290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88df2bf-2b26-4410-98db-09234b8a6d49 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:06.669077 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88df2bf-2b26-4410-98db-09234b8a6d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:06.670266 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88df2bf-2b26-4410-98db-09234b8a6d49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:06.671295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88df2bf-2b26-4410-98db-09234b8a6d49 None admin] RBAC: Adding query filter params (role.id=575c54955d4a474e9c687a0100991d1d, scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1, user.id=31914a98aa66424ab02d5918805f06f1) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:06.671776 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88df2bf-2b26-4410-98db-09234b8a6d49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:06.671889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51aa3b6-39fb-4f74-8729-c63986d01094 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:06.673736 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88df2bf-2b26-4410-98db-09234b8a6d49 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:06.681393 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 145/268] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:19:06 2022] GET /identity/v3/role_assignments?user.id=31914a98aa66424ab02d5918805f06f1&scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1&role.id=575c54955d4a474e9c687a0100991d1d => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:06.737816 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e909e7-c464-4a44-820b-67d2fd810e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:06.738807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e909e7-c464-4a44-820b-67d2fd810e1f None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:06.739401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e909e7-c464-4a44-820b-67d2fd810e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:06.740893 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e909e7-c464-4a44-820b-67d2fd810e1f None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1/users/e677ebb81aeb40bba8ff966c9c58bcef/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:06.743518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e909e7-c464-4a44-820b-67d2fd810e1f None admin] RBAC: Authorizing `identity:create_grant(project_id=9f94f6141c04458d8c29d2f3bddeaaa1, user_id=e677ebb81aeb40bba8ff966c9c58bcef, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:06.745016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e909e7-c464-4a44-820b-67d2fd810e1f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:06.827294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 124/269] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:19:06 2022] PUT /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1/users/e677ebb81aeb40bba8ff966c9c58bcef/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:19:07.360591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302b691-a98f-4703-9d4e-4a4ef0635c87 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:07.361116 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302b691-a98f-4703-9d4e-4a4ef0635c87 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:07.361116 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302b691-a98f-4703-9d4e-4a4ef0635c87 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:07.362831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 146/270] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:07.368408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18d5ab-be22-474b-be9a-40e902cf7f4f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:07.368866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18d5ab-be22-474b-be9a-40e902cf7f4f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:07.368942 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18d5ab-be22-474b-be9a-40e902cf7f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:07.387647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-de18d5ab-be22-474b-be9a-40e902cf7f4f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:07.389481 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-de18d5ab-be22-474b-be9a-40e902cf7f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:07.464888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 125/271] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:07.479167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56312cb1-0206-475d-96bc-8df7e9f09a66 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:07.479455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56312cb1-0206-475d-96bc-8df7e9f09a66 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:07.479739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56312cb1-0206-475d-96bc-8df7e9f09a66 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:07.481365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 147/272] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:07.487176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf04a7-fbbb-4846-bb5f-7126a250f2a9 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:07.487469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf04a7-fbbb-4846-bb5f-7126a250f2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:07.487747 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf04a7-fbbb-4846-bb5f-7126a250f2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:07.489680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56312cb1-0206-475d-96bc-8df7e9f09a66 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:07.506241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a0cf04a7-fbbb-4846-bb5f-7126a250f2a9 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:07.507477 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a0cf04a7-fbbb-4846-bb5f-7126a250f2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:07.538602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:07.586642 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 126/273] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:07.611492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf04a7-fbbb-4846-bb5f-7126a250f2a9 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:07.612933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56312cb1-0206-475d-96bc-8df7e9f09a66 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:07.654055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d0a43-d18d-4ba2-b2ab-b2366383042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:07.655390 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d0a43-d18d-4ba2-b2ab-b2366383042b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:07.655390 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d0a43-d18d-4ba2-b2ab-b2366383042b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:07.655390 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d0a43-d18d-4ba2-b2ab-b2366383042b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:07.666600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d0a43-d18d-4ba2-b2ab-b2366383042b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-8d2d0a43-d18d-4ba2-b2ab-b2366383042b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:07.674805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:07.675690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:07.682073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:07.682073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:07.682073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:07.682073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:07.682073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:07.682073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:07.682073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:07.682073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:07.682073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:07.682073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:07.682073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:07.682073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:07.682073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 148/274] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:19:07.684687 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d0a43-d18d-4ba2-b2ab-b2366383042b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:07.715565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:07.759905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf04a7-fbbb-4846-bb5f-7126a250f2a9 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:07.804003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c55013-b2b0-486f-bf42-08ac289e9130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:07.804979 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c55013-b2b0-486f-bf42-08ac289e9130 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:07.805362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c55013-b2b0-486f-bf42-08ac289e9130 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:07.805738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c55013-b2b0-486f-bf42-08ac289e9130 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:07.807083 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c55013-b2b0-486f-bf42-08ac289e9130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:07.808632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c55013-b2b0-486f-bf42-08ac289e9130 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:07.813458 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d0a43-d18d-4ba2-b2ab-b2366383042b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:07.814759 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 127/275] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:07.816389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c55013-b2b0-486f-bf42-08ac289e9130 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:07.853724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:07.863694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f1add-f93c-437e-9486-65c3e4a084b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:07.865580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f1add-f93c-437e-9486-65c3e4a084b6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:07.866542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f1add-f93c-437e-9486-65c3e4a084b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:07.867202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f1add-f93c-437e-9486-65c3e4a084b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:07.869288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f1add-f93c-437e-9486-65c3e4a084b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:07.869882 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f1add-f93c-437e-9486-65c3e4a084b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:07.873358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f1add-f93c-437e-9486-65c3e4a084b6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:07.895089 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 149/276] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:07.897563 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f1add-f93c-437e-9486-65c3e4a084b6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:07.935958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c55013-b2b0-486f-bf42-08ac289e9130 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:07.974849 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191717f-188b-425c-84e3-25fa50b11dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:07.975595 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191717f-188b-425c-84e3-25fa50b11dde None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:07.975927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191717f-188b-425c-84e3-25fa50b11dde None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:07.976208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191717f-188b-425c-84e3-25fa50b11dde None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:07.976919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191717f-188b-425c-84e3-25fa50b11dde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:07.978393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191717f-188b-425c-84e3-25fa50b11dde None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:07.995261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:08.015030 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f1add-f93c-437e-9486-65c3e4a084b6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:08.049025 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831b22b-6a7f-4a04-826a-d715d935b342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:08.049892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831b22b-6a7f-4a04-826a-d715d935b342 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:08.050170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831b22b-6a7f-4a04-826a-d715d935b342 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:08.050468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831b22b-6a7f-4a04-826a-d715d935b342 None admin] PATH_INFO: `/v3/users/a78f210d17274d93897a73ed1501f06a` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:08.065562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 128/277] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:19:07 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:19:08.073265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831b22b-6a7f-4a04-826a-d715d935b342 None admin] RBAC: Authorizing `identity:get_user(user_id=a78f210d17274d93897a73ed1501f06a)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:08.074943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831b22b-6a7f-4a04-826a-d715d935b342 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:08.077018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 150/278] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:19:07 2022] GET /identity/v3/users/a78f210d17274d93897a73ed1501f06a => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:08.083290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191717f-188b-425c-84e3-25fa50b11dde None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:08.196351 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:08.212024 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191717f-188b-425c-84e3-25fa50b11dde None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:08.252112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8234b4-57cc-4597-8cff-c592f8899508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:08.253092 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8234b4-57cc-4597-8cff-c592f8899508 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:08.253555 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8234b4-57cc-4597-8cff-c592f8899508 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:08.254006 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8234b4-57cc-4597-8cff-c592f8899508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:08.255061 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8234b4-57cc-4597-8cff-c592f8899508 None admin] RBAC: Adding query filter params (role.id=4b6ddd50803f4f9bbf171c5c7cb9af63, user.id=a78f210d17274d93897a73ed1501f06a, scope.system=all) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:08.255584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8234b4-57cc-4597-8cff-c592f8899508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:08.257262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8234b4-57cc-4597-8cff-c592f8899508 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:08.266401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 129/279] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jul 18 10:19:08 2022] GET /identity/v3/role_assignments?user.id=a78f210d17274d93897a73ed1501f06a&scope.system=all&role.id=4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:08.678813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cec27-4c4f-4570-9785-d5872e3d9fe2 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:08.679334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cec27-4c4f-4570-9785-d5872e3d9fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:08.679334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cec27-4c4f-4570-9785-d5872e3d9fe2 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:08.681306 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 151/280] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:08.687661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6459188-d083-4b7b-b53a-aba71d62726b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:08.688140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6459188-d083-4b7b-b53a-aba71d62726b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:08.688216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6459188-d083-4b7b-b53a-aba71d62726b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:08.710044 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e6459188-d083-4b7b-b53a-aba71d62726b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:08.711264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e6459188-d083-4b7b-b53a-aba71d62726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:08.815404 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 130/281] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:08.848949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cec27-4c4f-4570-9785-d5872e3d9fe2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:09.003035 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cec27-4c4f-4570-9785-d5872e3d9fe2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:09.049793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c4e6e-deda-4bbc-b6a3-c7eceeb711f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:09.050633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c4e6e-deda-4bbc-b6a3-c7eceeb711f8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:09.050911 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c4e6e-deda-4bbc-b6a3-c7eceeb711f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:09.051184 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c4e6e-deda-4bbc-b6a3-c7eceeb711f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:09.068090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c4e6e-deda-4bbc-b6a3-c7eceeb711f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:09.078677 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-dc8c4e6e-deda-4bbc-b6a3-c7eceeb711f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:09.082074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:09.083011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:09.083804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:09.083804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:09.083804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:09.083804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:09.083804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:09.083804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:09.083804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:09.083804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:09.083804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:09.083804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:09.083804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:19:09.083804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:09.083804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 152/282] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:09.091109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6459188-d083-4b7b-b53a-aba71d62726b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:09.191686 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:09.221612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd5406-c922-4caa-91be-9747a1d14566 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:09.221612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd5406-c922-4caa-91be-9747a1d14566 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:09.221612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd5406-c922-4caa-91be-9747a1d14566 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:09.221612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 153/283] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:19:09.221948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6459188-d083-4b7b-b53a-aba71d62726b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:09.222043 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080825ca-304e-45b4-96cc-c2fd893c02b4 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:09.222043 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080825ca-304e-45b4-96cc-c2fd893c02b4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:09.222043 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080825ca-304e-45b4-96cc-c2fd893c02b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:09.253787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-080825ca-304e-45b4-96cc-c2fd893c02b4 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:09.255018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-080825ca-304e-45b4-96cc-c2fd893c02b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:09.265932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6753d-f3c3-4ab3-bff5-762b1728d9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:09.266664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6753d-f3c3-4ab3-bff5-762b1728d9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:09.266945 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6753d-f3c3-4ab3-bff5-762b1728d9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:09.267210 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6753d-f3c3-4ab3-bff5-762b1728d9f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:09.267966 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6753d-f3c3-4ab3-bff5-762b1728d9f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:09.268266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6753d-f3c3-4ab3-bff5-762b1728d9f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:09.269701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6753d-f3c3-4ab3-bff5-762b1728d9f2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:09.282674 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 131/284] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:09.292864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6753d-f3c3-4ab3-bff5-762b1728d9f2 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:09.390239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 154/285] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 18 10:19:09.425562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080825ca-304e-45b4-96cc-c2fd893c02b4 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:09.459325 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6753d-f3c3-4ab3-bff5-762b1728d9f2 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:09.496098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdc32c-eee7-4976-abdc-c7be7b000224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:09.496975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdc32c-eee7-4976-abdc-c7be7b000224 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:09.497886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdc32c-eee7-4976-abdc-c7be7b000224 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:09.498300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdc32c-eee7-4976-abdc-c7be7b000224 None admin] PATH_INFO: `/v3/users/6bbfc6cb9337478cbb90313e52550fff` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:09.499696 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdc32c-eee7-4976-abdc-c7be7b000224 None admin] RBAC: Authorizing `identity:get_user(user_id=6bbfc6cb9337478cbb90313e52550fff)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:09.501157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdc32c-eee7-4976-abdc-c7be7b000224 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:09.507379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 132/286] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:19:09 2022] GET /identity/v3/users/6bbfc6cb9337478cbb90313e52550fff => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:09.508850 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdc32c-eee7-4976-abdc-c7be7b000224 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:09.527432 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:09.620021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdc32c-eee7-4976-abdc-c7be7b000224 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:09.657989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb106b-caeb-49a1-a0fa-d7081af1852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:09.659088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb106b-caeb-49a1-a0fa-d7081af1852f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:09.659497 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb106b-caeb-49a1-a0fa-d7081af1852f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:09.659910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb106b-caeb-49a1-a0fa-d7081af1852f None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:09.661409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb106b-caeb-49a1-a0fa-d7081af1852f None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:09.663201 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb106b-caeb-49a1-a0fa-d7081af1852f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:09.670530 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 133/287] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:09 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:09.672366 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb106b-caeb-49a1-a0fa-d7081af1852f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:09.692341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080825ca-304e-45b4-96cc-c2fd893c02b4 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:09.766772 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:09.768635 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:09.783562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb106b-caeb-49a1-a0fa-d7081af1852f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:09.791225 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013b4d2-5b0f-474b-92d9-b14ffddcc9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:09.799021 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013b4d2-5b0f-474b-92d9-b14ffddcc9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:09.799021 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013b4d2-5b0f-474b-92d9-b14ffddcc9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:09.799021 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013b4d2-5b0f-474b-92d9-b14ffddcc9c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:09.816020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013b4d2-5b0f-474b-92d9-b14ffddcc9c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:09.820573 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a91d0-ea05-4385-a6a5-7f2f3494ffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:09.821467 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a91d0-ea05-4385-a6a5-7f2f3494ffcc None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:09.821756 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a91d0-ea05-4385-a6a5-7f2f3494ffcc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:09.822080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a91d0-ea05-4385-a6a5-7f2f3494ffcc None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1/users/6bbfc6cb9337478cbb90313e52550fff/roles/ea3d8b70e23b44c0ba368fe1a3b9d04f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:09.824100 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a91d0-ea05-4385-a6a5-7f2f3494ffcc None admin] RBAC: Authorizing `identity:create_grant(project_id=9f94f6141c04458d8c29d2f3bddeaaa1, user_id=6bbfc6cb9337478cbb90313e52550fff, role_id=ea3d8b70e23b44c0ba368fe1a3b9d04f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:09.826176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a91d0-ea05-4385-a6a5-7f2f3494ffcc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-8013b4d2-5b0f-474b-92d9-b14ffddcc9c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:09.836528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:09.837549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:09.838685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:09.838685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:09.838685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:09.838685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:09.838685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:09.838685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:09.838685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:09.838685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:09.838685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:09.838685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:09.838685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:09.838685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:09.838685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 155/288] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:19:09.844828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013b4d2-5b0f-474b-92d9-b14ffddcc9c3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:09.923638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 134/289] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:19:09 2022] PUT /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1/users/6bbfc6cb9337478cbb90313e52550fff/roles/ea3d8b70e23b44c0ba368fe1a3b9d04f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:19:09.958847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013b4d2-5b0f-474b-92d9-b14ffddcc9c3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:10.000455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b754e5b-4e43-4229-94ec-1c2e8783ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:10.001176 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b754e5b-4e43-4229-94ec-1c2e8783ac0e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:10.001458 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b754e5b-4e43-4229-94ec-1c2e8783ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:10.001770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b754e5b-4e43-4229-94ec-1c2e8783ac0e None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:10.002605 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b754e5b-4e43-4229-94ec-1c2e8783ac0e None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:10.002969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b754e5b-4e43-4229-94ec-1c2e8783ac0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:10.004451 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b754e5b-4e43-4229-94ec-1c2e8783ac0e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:10.015690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 156/290] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:10.021777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a91d0-ea05-4385-a6a5-7f2f3494ffcc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:10.185920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a91d0-ea05-4385-a6a5-7f2f3494ffcc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:10.240884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5988e2-7361-4067-acd6-b63a5c7af0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:10.241980 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5988e2-7361-4067-acd6-b63a5c7af0dd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:10.242272 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5988e2-7361-4067-acd6-b63a5c7af0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:10.242560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5988e2-7361-4067-acd6-b63a5c7af0dd None admin] PATH_INFO: `/v3/users/e677ebb81aeb40bba8ff966c9c58bcef` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:10.243847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5988e2-7361-4067-acd6-b63a5c7af0dd None admin] RBAC: Authorizing `identity:get_user(user_id=e677ebb81aeb40bba8ff966c9c58bcef)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:10.245434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5988e2-7361-4067-acd6-b63a5c7af0dd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:10.247702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 135/291] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:19:10 2022] GET /identity/v3/users/e677ebb81aeb40bba8ff966c9c58bcef => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:10.253317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b754e5b-4e43-4229-94ec-1c2e8783ac0e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:10.321970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:10.417622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b754e5b-4e43-4229-94ec-1c2e8783ac0e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:10.472189 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cc4c6-af19-4853-85c4-7b713783226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:10.473309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cc4c6-af19-4853-85c4-7b713783226b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:10.473882 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cc4c6-af19-4853-85c4-7b713783226b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:10.474571 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cc4c6-af19-4853-85c4-7b713783226b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:10.592387 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cc4c6-af19-4853-85c4-7b713783226b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:10.593801 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cc4c6-af19-4853-85c4-7b713783226b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:10.668867 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:10.690135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc66d23-4a4f-48aa-a0c2-de9d5ddaa534 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:10.690522 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc66d23-4a4f-48aa-a0c2-de9d5ddaa534 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:10.696949 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc66d23-4a4f-48aa-a0c2-de9d5ddaa534 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:10.696949 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 136/292] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:19:10.708604 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09abba2-d030-4b9b-b292-6052105dccbc None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:10.709213 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09abba2-d030-4b9b-b292-6052105dccbc None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:10.709689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09abba2-d030-4b9b-b292-6052105dccbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:10.745385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 157/293] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:10.750410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cc4c6-af19-4853-85c4-7b713783226b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:10.753367 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c09abba2-d030-4b9b-b292-6052105dccbc None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:10.755896 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c09abba2-d030-4b9b-b292-6052105dccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:10.765240 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:10.898512 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 137/294] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:10.916614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cc4c6-af19-4853-85c4-7b713783226b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:10.948666 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09abba2-d030-4b9b-b292-6052105dccbc None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:10.959999 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b78939-b198-4d08-9732-dc7ffe75ce15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:10.961103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b78939-b198-4d08-9732-dc7ffe75ce15 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:10.961597 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b78939-b198-4d08-9732-dc7ffe75ce15 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:10.962054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b78939-b198-4d08-9732-dc7ffe75ce15 None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:10.964086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b78939-b198-4d08-9732-dc7ffe75ce15 None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:10.965737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b78939-b198-4d08-9732-dc7ffe75ce15 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:10.968874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 158/295] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:10 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:10.970816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b7223-fe61-4db9-adac-e5586fe935f2 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:10.971288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b7223-fe61-4db9-adac-e5586fe935f2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:10.971741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b7223-fe61-4db9-adac-e5586fe935f2 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:10.973167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 159/296] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:10.976543 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b7223-fe61-4db9-adac-e5586fe935f2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:11.003061 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:11.087569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09abba2-d030-4b9b-b292-6052105dccbc None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:11.108782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b7223-fe61-4db9-adac-e5586fe935f2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:11.124247 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b35c8-9cf1-4525-b959-b723a7081bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:11.125052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b35c8-9cf1-4525-b959-b723a7081bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:11.125333 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b35c8-9cf1-4525-b959-b723a7081bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:11.125607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b35c8-9cf1-4525-b959-b723a7081bc6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:11.133828 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:11.136760 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b35c8-9cf1-4525-b959-b723a7081bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-7c3b35c8-9cf1-4525-b959-b723a7081bc6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:11.144647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:11.151421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:11.152225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:11.152225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:11.152225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:11.152225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:11.152225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:11.152225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:11.152225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:11.152225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:11.152225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:11.152225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:11.152225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:19:11.152225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:11.152225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 138/297] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:19:11.152225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af462fd-e3f6-453c-9a1c-2750c41766de None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:11.152943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af462fd-e3f6-453c-9a1c-2750c41766de None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:11.152943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af462fd-e3f6-453c-9a1c-2750c41766de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:11.159428 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d34b5b-ad02-4b38-8343-008ab39db5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:11.160152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d34b5b-ad02-4b38-8343-008ab39db5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:11.160432 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d34b5b-ad02-4b38-8343-008ab39db5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:11.160707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d34b5b-ad02-4b38-8343-008ab39db5e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:11.161534 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d34b5b-ad02-4b38-8343-008ab39db5e6 None admin] RBAC: Adding query filter params (role.id=4b6ddd50803f4f9bbf171c5c7cb9af63, scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1, user.id=e677ebb81aeb40bba8ff966c9c58bcef) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:11.161841 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d34b5b-ad02-4b38-8343-008ab39db5e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:11.163299 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d34b5b-ad02-4b38-8343-008ab39db5e6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:11.178676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 160/298] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:19:10 2022] GET /identity/v3/role_assignments?user.id=e677ebb81aeb40bba8ff966c9c58bcef&scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1&role.id=4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:11.178874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6af462fd-e3f6-453c-9a1c-2750c41766de None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:11.178968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6abef-161a-422f-bb25-cee546d9ef75 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:11.179074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6af462fd-e3f6-453c-9a1c-2750c41766de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:11.179173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6abef-161a-422f-bb25-cee546d9ef75 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:11.179173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6abef-161a-422f-bb25-cee546d9ef75 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:11.179173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 161/299] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:11.179173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6abef-161a-422f-bb25-cee546d9ef75 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:11.260181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 139/300] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:11.261628 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f9309-3284-4f9e-ba82-641fcc547eca None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:11.262035 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f9309-3284-4f9e-ba82-641fcc547eca None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:11.262399 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f9309-3284-4f9e-ba82-641fcc547eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:11.281496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3f2f9309-3284-4f9e-ba82-641fcc547eca None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:11.282957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3f2f9309-3284-4f9e-ba82-641fcc547eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:11.313727 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:11.332495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6abef-161a-422f-bb25-cee546d9ef75 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:11.375487 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 140/301] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:11.376891 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f9309-3284-4f9e-ba82-641fcc547eca None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:11.390449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5feedd-224b-4d48-931c-e664b69bf9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:11.391194 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5feedd-224b-4d48-931c-e664b69bf9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:11.391534 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5feedd-224b-4d48-931c-e664b69bf9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:11.391815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5feedd-224b-4d48-931c-e664b69bf9d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:11.392628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5feedd-224b-4d48-931c-e664b69bf9d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:11.392937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5feedd-224b-4d48-931c-e664b69bf9d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:11.395476 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5feedd-224b-4d48-931c-e664b69bf9d2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:11.413830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 162/302] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:11.413830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5feedd-224b-4d48-931c-e664b69bf9d2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:11.462441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:11.520685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f9309-3284-4f9e-ba82-641fcc547eca None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:11.553655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5feedd-224b-4d48-931c-e664b69bf9d2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:11.557791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1537f2-d3b7-43b3-b293-4932d83591e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:11.558620 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1537f2-d3b7-43b3-b293-4932d83591e6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:11.558904 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1537f2-d3b7-43b3-b293-4932d83591e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:11.559178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1537f2-d3b7-43b3-b293-4932d83591e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:11.571491 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1537f2-d3b7-43b3-b293-4932d83591e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-9f1537f2-d3b7-43b3-b293-4932d83591e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:11.579479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:11.580359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:11.581170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:11.581170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:11.581170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:11.581170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:11.581170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:11.581170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:11.581170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:11.581170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:11.581170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:11.581170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:11.581170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:11.581170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:11.581170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 141/303] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:11.581879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1537f2-d3b7-43b3-b293-4932d83591e6 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:11.599946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdca9c-5e6a-420d-b3f1-fc8662d4a873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:11.601353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdca9c-5e6a-420d-b3f1-fc8662d4a873 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:11.602199 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdca9c-5e6a-420d-b3f1-fc8662d4a873 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:11.602718 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdca9c-5e6a-420d-b3f1-fc8662d4a873 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:11.604101 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdca9c-5e6a-420d-b3f1-fc8662d4a873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:11.607131 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdca9c-5e6a-420d-b3f1-fc8662d4a873 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:11.609793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 163/304] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:11.610909 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdca9c-5e6a-420d-b3f1-fc8662d4a873 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:11.627160 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:11.694648 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1537f2-d3b7-43b3-b293-4932d83591e6 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:11.714893 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:11.724711 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdca9c-5e6a-420d-b3f1-fc8662d4a873 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:11.729503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123f60c-cf4b-4d21-a11d-ca4da96e4e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:11.730644 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123f60c-cf4b-4d21-a11d-ca4da96e4e74 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:11.731113 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123f60c-cf4b-4d21-a11d-ca4da96e4e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:11.731668 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123f60c-cf4b-4d21-a11d-ca4da96e4e74 None admin] PATH_INFO: `/v3/users/5b5860e2c2f943c6b93edd14993149ab` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:11.746480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123f60c-cf4b-4d21-a11d-ca4da96e4e74 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5860e2c2f943c6b93edd14993149ab)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:11.749278 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123f60c-cf4b-4d21-a11d-ca4da96e4e74 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:11.757104 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 142/305] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:19:11 2022] GET /identity/v3/users/5b5860e2c2f943c6b93edd14993149ab => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:11.758317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123f60c-cf4b-4d21-a11d-ca4da96e4e74 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:11.766007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b705736-d394-4b01-a2fa-4a8a6874fe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:11.766745 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b705736-d394-4b01-a2fa-4a8a6874fe4b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:11.767001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b705736-d394-4b01-a2fa-4a8a6874fe4b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:11.767278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b705736-d394-4b01-a2fa-4a8a6874fe4b None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:11.768028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b705736-d394-4b01-a2fa-4a8a6874fe4b None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:11.768339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b705736-d394-4b01-a2fa-4a8a6874fe4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:11.769733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b705736-d394-4b01-a2fa-4a8a6874fe4b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:11.780747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 164/306] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:11.786249 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b705736-d394-4b01-a2fa-4a8a6874fe4b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:11.875748 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:11.876914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123f60c-cf4b-4d21-a11d-ca4da96e4e74 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:11.902222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b705736-d394-4b01-a2fa-4a8a6874fe4b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:11.912844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6706c-abc9-4cfb-9ace-6646c2259b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:11.913523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6706c-abc9-4cfb-9ace-6646c2259b24 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:11.913808 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6706c-abc9-4cfb-9ace-6646c2259b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:11.914081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6706c-abc9-4cfb-9ace-6646c2259b24 None admin] PATH_INFO: `/v3/groups` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:11.915308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6706c-abc9-4cfb-9ace-6646c2259b24 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:11.917285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6706c-abc9-4cfb-9ace-6646c2259b24 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:11.942600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3841f0c-c9b5-4616-985f-6ea48fb1af3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:11.943250 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3841f0c-c9b5-4616-985f-6ea48fb1af3e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:11.943532 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3841f0c-c9b5-4616-985f-6ea48fb1af3e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:11.943825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3841f0c-c9b5-4616-985f-6ea48fb1af3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:11.949723 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3841f0c-c9b5-4616-985f-6ea48fb1af3e None admin] RBAC: Adding query filter params (role.id=ea3d8b70e23b44c0ba368fe1a3b9d04f, user.id=5b5860e2c2f943c6b93edd14993149ab, scope.system=all) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:11.949723 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3841f0c-c9b5-4616-985f-6ea48fb1af3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:11.949723 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3841f0c-c9b5-4616-985f-6ea48fb1af3e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:11.962502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 165/307] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jul 18 10:19:11 2022] GET /identity/v3/role_assignments?user.id=5b5860e2c2f943c6b93edd14993149ab&scope.system=all&role.id=ea3d8b70e23b44c0ba368fe1a3b9d04f => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:11.962502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3841f0c-c9b5-4616-985f-6ea48fb1af3e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:11.991114 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 143/308] 10.222.0.16 () {60 vars in 1134 bytes} [Mon Jul 18 10:19:11 2022] POST /identity/v3/groups => generated 229 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:19:12.107661 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3841f0c-c9b5-4616-985f-6ea48fb1af3e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:12.152245 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfbcb8-ab53-4d6c-a7dc-414f0eb859a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:12.153204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfbcb8-ab53-4d6c-a7dc-414f0eb859a6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:12.154167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfbcb8-ab53-4d6c-a7dc-414f0eb859a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:12.154490 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfbcb8-ab53-4d6c-a7dc-414f0eb859a6 None admin] PATH_INFO: `/v3/users/a78f210d17274d93897a73ed1501f06a` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:12.155826 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfbcb8-ab53-4d6c-a7dc-414f0eb859a6 None admin] RBAC: Authorizing `identity:get_user(user_id=a78f210d17274d93897a73ed1501f06a)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:12.157342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfbcb8-ab53-4d6c-a7dc-414f0eb859a6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:12.159503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 166/309] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:19:11 2022] GET /identity/v3/users/a78f210d17274d93897a73ed1501f06a => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:12.165661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6706c-abc9-4cfb-9ace-6646c2259b24 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:12.218973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:12.288309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6706c-abc9-4cfb-9ace-6646c2259b24 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:12.326625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ab30d-10bb-4370-9fbc-3ff8c519ea34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:12.327643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ab30d-10bb-4370-9fbc-3ff8c519ea34 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:12.327929 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ab30d-10bb-4370-9fbc-3ff8c519ea34 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:12.328203 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ab30d-10bb-4370-9fbc-3ff8c519ea34 None admin] PATH_INFO: `/v3/system/users/a78f210d17274d93897a73ed1501f06a/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:12.329886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ab30d-10bb-4370-9fbc-3ff8c519ea34 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a78f210d17274d93897a73ed1501f06a, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:12.331389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ab30d-10bb-4370-9fbc-3ff8c519ea34 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:12.353827 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63cedc-cd7c-401c-bf78-140c287b820c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:12.354180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63cedc-cd7c-401c-bf78-140c287b820c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:12.354481 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63cedc-cd7c-401c-bf78-140c287b820c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:12.358495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 167/310] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:19:12.361987 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c09d7-b18c-4377-9325-08e37bc985cb None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:12.362273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c09d7-b18c-4377-9325-08e37bc985cb None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:12.362599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c09d7-b18c-4377-9325-08e37bc985cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:12.374851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:12.380858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-da4c09d7-b18c-4377-9325-08e37bc985cb None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:12.382049 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-da4c09d7-b18c-4377-9325-08e37bc985cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:12.419376 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 144/311] 10.222.0.16 () {58 vars in 1334 bytes} [Mon Jul 18 10:19:12 2022] PUT /identity/v3/system/users/a78f210d17274d93897a73ed1501f06a/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:19:12.466681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 168/312] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:19:12.491970 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ab30d-10bb-4370-9fbc-3ff8c519ea34 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:12.617881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ab30d-10bb-4370-9fbc-3ff8c519ea34 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:12.620477 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:12.661889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cf700-9cd4-4f82-81ce-bd45220571a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:12.663177 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cf700-9cd4-4f82-81ce-bd45220571a2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:12.663691 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cf700-9cd4-4f82-81ce-bd45220571a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:12.664174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cf700-9cd4-4f82-81ce-bd45220571a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:12.676109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cf700-9cd4-4f82-81ce-bd45220571a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-201cf700-9cd4-4f82-81ce-bd45220571a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:12.684394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:12.685854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:12.686706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:12.686706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:12.686706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:12.686706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:12.686706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:12.686706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:12.686706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:12.686706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:12.686706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:12.686706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:12.686706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:19:12.686706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:12.689572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 145/313] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:12.694944 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c09d7-b18c-4377-9325-08e37bc985cb None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:12.806894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c09d7-b18c-4377-9325-08e37bc985cb None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:12.849447 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682e6b7-e7a5-4e3d-89f0-ec6d8c8c5d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:12.850594 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682e6b7-e7a5-4e3d-89f0-ec6d8c8c5d09 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:12.851103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682e6b7-e7a5-4e3d-89f0-ec6d8c8c5d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:12.851588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682e6b7-e7a5-4e3d-89f0-ec6d8c8c5d09 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:12.852590 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682e6b7-e7a5-4e3d-89f0-ec6d8c8c5d09 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:12.853096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682e6b7-e7a5-4e3d-89f0-ec6d8c8c5d09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:12.854818 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682e6b7-e7a5-4e3d-89f0-ec6d8c8c5d09 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:12.858444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:12.866550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 169/314] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:12.873089 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cf700-9cd4-4f82-81ce-bd45220571a2 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:12.985323 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cf700-9cd4-4f82-81ce-bd45220571a2 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:13.022582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28d984-48d5-44d6-b895-ccd6e8ab7422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:13.023463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28d984-48d5-44d6-b895-ccd6e8ab7422 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:13.023744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28d984-48d5-44d6-b895-ccd6e8ab7422 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:13.024019 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28d984-48d5-44d6-b895-ccd6e8ab7422 None admin] PATH_INFO: `/v3/users/6bbfc6cb9337478cbb90313e52550fff` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:13.025227 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28d984-48d5-44d6-b895-ccd6e8ab7422 None admin] RBAC: Authorizing `identity:get_user(user_id=6bbfc6cb9337478cbb90313e52550fff)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:13.026722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28d984-48d5-44d6-b895-ccd6e8ab7422 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:13.028713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 146/315] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:19:12 2022] GET /identity/v3/users/6bbfc6cb9337478cbb90313e52550fff => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:13.034525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682e6b7-e7a5-4e3d-89f0-ec6d8c8c5d09 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:13.150424 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682e6b7-e7a5-4e3d-89f0-ec6d8c8c5d09 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:13.189127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d570a-ac29-41f6-826f-8c7e32a332c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:13.189779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d570a-ac29-41f6-826f-8c7e32a332c2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:13.190060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d570a-ac29-41f6-826f-8c7e32a332c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:13.190350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d570a-ac29-41f6-826f-8c7e32a332c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:13.264175 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:13.269148 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d570a-ac29-41f6-826f-8c7e32a332c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:13.270702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d570a-ac29-41f6-826f-8c7e32a332c2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:13.381892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 170/316] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:13.387585 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28d984-48d5-44d6-b895-ccd6e8ab7422 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:13.425210 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:13.548404 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28d984-48d5-44d6-b895-ccd6e8ab7422 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:13.584533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6074e-fc79-478e-8cdc-cbb3fd90633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:13.585404 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6074e-fc79-478e-8cdc-cbb3fd90633f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:13.585688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6074e-fc79-478e-8cdc-cbb3fd90633f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:13.585966 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6074e-fc79-478e-8cdc-cbb3fd90633f None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:13.587202 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6074e-fc79-478e-8cdc-cbb3fd90633f None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:13.588673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6074e-fc79-478e-8cdc-cbb3fd90633f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:13.591312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 147/317] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:13 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:13.596928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d570a-ac29-41f6-826f-8c7e32a332c2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:13.712866 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:13.718140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d570a-ac29-41f6-826f-8c7e32a332c2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:13.760547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718baeb4-59df-4a7a-b4c9-096ab7a9e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:13.761285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718baeb4-59df-4a7a-b4c9-096ab7a9e1fe None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:13.761659 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718baeb4-59df-4a7a-b4c9-096ab7a9e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:13.761965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718baeb4-59df-4a7a-b4c9-096ab7a9e1fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:13.763125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718baeb4-59df-4a7a-b4c9-096ab7a9e1fe None admin] RBAC: Adding query filter params (role.id=ea3d8b70e23b44c0ba368fe1a3b9d04f, scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1, user.id=6bbfc6cb9337478cbb90313e52550fff) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:13.763622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718baeb4-59df-4a7a-b4c9-096ab7a9e1fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:13.765380 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718baeb4-59df-4a7a-b4c9-096ab7a9e1fe None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:13.773689 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 171/318] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:19:13 2022] GET /identity/v3/role_assignments?user.id=6bbfc6cb9337478cbb90313e52550fff&scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1&role.id=ea3d8b70e23b44c0ba368fe1a3b9d04f => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:14.096125 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961dfda-6aeb-4194-9578-adf398f3ca7f None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:14.096659 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961dfda-6aeb-4194-9578-adf398f3ca7f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:14.096741 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961dfda-6aeb-4194-9578-adf398f3ca7f None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:14.098418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 148/319] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:14.103950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7afc22-2377-4920-a617-571fc1e5958d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:14.104366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7afc22-2377-4920-a617-571fc1e5958d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:14.104548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7afc22-2377-4920-a617-571fc1e5958d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:14.123427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-9b7afc22-2377-4920-a617-571fc1e5958d None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:14.124738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9b7afc22-2377-4920-a617-571fc1e5958d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:14.205351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 172/320] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:14.227981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961dfda-6aeb-4194-9578-adf398f3ca7f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:14.239693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949b9f8-7c6c-4902-85c7-109d7537b75b None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:14.240037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949b9f8-7c6c-4902-85c7-109d7537b75b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:14.240280 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949b9f8-7c6c-4902-85c7-109d7537b75b None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:14.241859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 173/321] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:14.246886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54f69a-b13d-4602-bd83-e9652aaa3103 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:14.247206 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54f69a-b13d-4602-bd83-e9652aaa3103 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:14.247482 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54f69a-b13d-4602-bd83-e9652aaa3103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:14.264952 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-da54f69a-b13d-4602-bd83-e9652aaa3103 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:14.266128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-da54f69a-b13d-4602-bd83-e9652aaa3103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:14.342129 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 174/322] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:19:14.350504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:14.357302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961dfda-6aeb-4194-9578-adf398f3ca7f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:14.364988 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54f69a-b13d-4602-bd83-e9652aaa3103 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:14.391271 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:14.400430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e8605-ce3c-4979-bb10-1b9533746279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:14.401218 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8605-ce3c-4979-bb10-1b9533746279 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:14.401494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8605-ce3c-4979-bb10-1b9533746279 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:14.401828 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e8605-ce3c-4979-bb10-1b9533746279 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:14.414197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e8605-ce3c-4979-bb10-1b9533746279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-f25e8605-ce3c-4979-bb10-1b9533746279 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:14.422226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:14.423910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:14.424826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:14.424826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:14.424826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:14.424826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:14.424826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:14.424826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:14.424826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:14.424826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:14.424826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:14.424826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:14.424826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:19:14.424826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:14.424826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 149/323] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:19:14.430384 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e8605-ce3c-4979-bb10-1b9533746279 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:14.483993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54f69a-b13d-4602-bd83-e9652aaa3103 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:14.521591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb1533-3161-4215-bc3d-18975c5251c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:14.522657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb1533-3161-4215-bc3d-18975c5251c2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:14.522768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb1533-3161-4215-bc3d-18975c5251c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:14.523084 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb1533-3161-4215-bc3d-18975c5251c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:14.524465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb1533-3161-4215-bc3d-18975c5251c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:14.525963 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb1533-3161-4215-bc3d-18975c5251c2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:14.527729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 175/324] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:14.534197 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb1533-3161-4215-bc3d-18975c5251c2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:14.550741 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e8605-ce3c-4979-bb10-1b9533746279 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:14.591438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08965192-457d-4f37-a9cf-6abf78392c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:14.592351 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08965192-457d-4f37-a9cf-6abf78392c2f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:14.592641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08965192-457d-4f37-a9cf-6abf78392c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:14.592876 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08965192-457d-4f37-a9cf-6abf78392c2f None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:14.593633 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08965192-457d-4f37-a9cf-6abf78392c2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:14.593940 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08965192-457d-4f37-a9cf-6abf78392c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:14.595382 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08965192-457d-4f37-a9cf-6abf78392c2f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:14.603983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 150/325] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:14.605278 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d91d4c-5778-466b-8b7d-6a5ed9b7a290 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:14.605559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d91d4c-5778-466b-8b7d-6a5ed9b7a290 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:14.605833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d91d4c-5778-466b-8b7d-6a5ed9b7a290 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:14.607842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 151/326] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:14.610403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d91d4c-5778-466b-8b7d-6a5ed9b7a290 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:14.640154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:14.654473 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:14.663883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb1533-3161-4215-bc3d-18975c5251c2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:14.698445 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c49e5-8ffc-418b-8eac-9e8489769e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:14.699105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c49e5-8ffc-418b-8eac-9e8489769e9d None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:14.699407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c49e5-8ffc-418b-8eac-9e8489769e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:14.699734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c49e5-8ffc-418b-8eac-9e8489769e9d None admin] PATH_INFO: `/v3/groups` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:14.700491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c49e5-8ffc-418b-8eac-9e8489769e9d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:14.701952 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c49e5-8ffc-418b-8eac-9e8489769e9d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:14.723975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d91d4c-5778-466b-8b7d-6a5ed9b7a290 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:14.759140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f00a22-e6ec-4f79-ae59-f251ff3d8a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:14.760009 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f00a22-e6ec-4f79-ae59-f251ff3d8a94 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:14.760291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f00a22-e6ec-4f79-ae59-f251ff3d8a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:14.760567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f00a22-e6ec-4f79-ae59-f251ff3d8a94 None admin] PATH_INFO: `/v3/users/5b5860e2c2f943c6b93edd14993149ab` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:14.761808 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f00a22-e6ec-4f79-ae59-f251ff3d8a94 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5860e2c2f943c6b93edd14993149ab)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:14.763792 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f00a22-e6ec-4f79-ae59-f251ff3d8a94 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:14.765477 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 152/327] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:19:14 2022] GET /identity/v3/users/5b5860e2c2f943c6b93edd14993149ab => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:14.773593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 176/328] 10.222.0.16 () {60 vars in 1134 bytes} [Mon Jul 18 10:19:14 2022] POST /identity/v3/groups => generated 226 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:19:14.779992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcd6b0-c250-431d-ae8f-e57b829e355a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:14.779992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcd6b0-c250-431d-ae8f-e57b829e355a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:14.779992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcd6b0-c250-431d-ae8f-e57b829e355a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:14.780286 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c49e5-8ffc-418b-8eac-9e8489769e9d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:14.798232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c4dcd6b0-c250-431d-ae8f-e57b829e355a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:14.799518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c4dcd6b0-c250-431d-ae8f-e57b829e355a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:14.883512 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 153/329] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:14.904750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c49e5-8ffc-418b-8eac-9e8489769e9d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:14.907903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcd6b0-c250-431d-ae8f-e57b829e355a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:14.933415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:14.957360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e75a4-7fc0-43c8-bd8d-9abd6cbf8f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:14.957360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e75a4-7fc0-43c8-bd8d-9abd6cbf8f84 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:14.957360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e75a4-7fc0-43c8-bd8d-9abd6cbf8f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:14.957360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e75a4-7fc0-43c8-bd8d-9abd6cbf8f84 None admin] PATH_INFO: `/v3/system/users/5b5860e2c2f943c6b93edd14993149ab/roles/ea3d8b70e23b44c0ba368fe1a3b9d04f` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:14.958047 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e75a4-7fc0-43c8-bd8d-9abd6cbf8f84 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5b5860e2c2f943c6b93edd14993149ab, role_id=ea3d8b70e23b44c0ba368fe1a3b9d04f)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:14.959498 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e75a4-7fc0-43c8-bd8d-9abd6cbf8f84 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:15.025275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcd6b0-c250-431d-ae8f-e57b829e355a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:15.031156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 177/330] 10.222.0.16 () {58 vars in 1334 bytes} [Mon Jul 18 10:19:14 2022] PUT /identity/v3/system/users/5b5860e2c2f943c6b93edd14993149ab/roles/ea3d8b70e23b44c0ba368fe1a3b9d04f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:19:15.072288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64eaad-d4c0-4f54-9302-bdd1bda80518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:15.073171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64eaad-d4c0-4f54-9302-bdd1bda80518 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:15.073546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64eaad-d4c0-4f54-9302-bdd1bda80518 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:15.073818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64eaad-d4c0-4f54-9302-bdd1bda80518 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:15.086585 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64eaad-d4c0-4f54-9302-bdd1bda80518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-6c64eaad-d4c0-4f54-9302-bdd1bda80518 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:15.096623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:15.098017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:15.099208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:15.099208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:15.099208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:15.099208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:15.099208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:15.099208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:15.099208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:15.099208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:15.099208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:15.099208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:15.099208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:15.099208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:15.099208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 154/331] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:19:15.104435 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e75a4-7fc0-43c8-bd8d-9abd6cbf8f84 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:15.127163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:15.243396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e75a4-7fc0-43c8-bd8d-9abd6cbf8f84 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:15.290119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a275f-6054-4da1-850c-928cc06066dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:15.290835 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a275f-6054-4da1-850c-928cc06066dc None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:15.291121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a275f-6054-4da1-850c-928cc06066dc None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:15.291400 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a275f-6054-4da1-850c-928cc06066dc None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:15.292154 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a275f-6054-4da1-850c-928cc06066dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:15.292460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a275f-6054-4da1-850c-928cc06066dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:15.293863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a275f-6054-4da1-850c-928cc06066dc None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:15.303883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 178/332] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:15.309586 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64eaad-d4c0-4f54-9302-bdd1bda80518 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:15.418500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:15.442347 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64eaad-d4c0-4f54-9302-bdd1bda80518 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:15.488426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626560c-294d-4224-b193-2c6090ba10bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:15.489323 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626560c-294d-4224-b193-2c6090ba10bd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:15.489612 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626560c-294d-4224-b193-2c6090ba10bd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:15.489893 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626560c-294d-4224-b193-2c6090ba10bd None admin] PATH_INFO: `/v3/users/a78f210d17274d93897a73ed1501f06a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:15.491968 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626560c-294d-4224-b193-2c6090ba10bd None admin] RBAC: Authorizing `identity:get_user(user_id=a78f210d17274d93897a73ed1501f06a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:15.493567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626560c-294d-4224-b193-2c6090ba10bd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:15.495642 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 155/333] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:19:15 2022] GET /identity/v3/users/a78f210d17274d93897a73ed1501f06a => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:15.502593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a275f-6054-4da1-850c-928cc06066dc None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:15.602709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:15.623735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a275f-6054-4da1-850c-928cc06066dc None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:15.667502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6b00c-6769-4792-b825-0468fe9d74d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:15.668170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b00c-6769-4792-b825-0468fe9d74d9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:15.668458 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b00c-6769-4792-b825-0468fe9d74d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:15.668735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b00c-6769-4792-b825-0468fe9d74d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:15.669948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6b00c-6769-4792-b825-0468fe9d74d9 None admin] RBAC: Adding query filter params (role.id=4b6ddd50803f4f9bbf171c5c7cb9af63, user.id=a78f210d17274d93897a73ed1501f06a, scope.system=all) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:15.670261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6b00c-6769-4792-b825-0468fe9d74d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:15.671762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6b00c-6769-4792-b825-0468fe9d74d9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:15.689522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 179/334] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jul 18 10:19:15 2022] GET /identity/v3/role_assignments?user.id=a78f210d17274d93897a73ed1501f06a&scope.system=all&role.id=4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:17.444731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412779c7-4ac4-4a78-9d9b-6dcf58b80c32 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:17.445291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412779c7-4ac4-4a78-9d9b-6dcf58b80c32 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:17.445369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412779c7-4ac4-4a78-9d9b-6dcf58b80c32 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:17.447178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 156/335] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:17.454217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfbdbc-d865-4995-bb47-5afd47abd91a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:17.454752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfbdbc-d865-4995-bb47-5afd47abd91a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:17.458949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfbdbc-d865-4995-bb47-5afd47abd91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:17.481894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8fdfbdbc-d865-4995-bb47-5afd47abd91a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:17.483448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8fdfbdbc-d865-4995-bb47-5afd47abd91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:17.582097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 180/336] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:19:17.626904 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba51abd-e7b5-46ff-b944-8b6ba323a899 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:17.627368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba51abd-e7b5-46ff-b944-8b6ba323a899 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:17.627716 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba51abd-e7b5-46ff-b944-8b6ba323a899 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:17.630089 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 157/337] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:17.631661 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfbdbc-d865-4995-bb47-5afd47abd91a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:17.638574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae2cb5-0f95-4fa7-a361-a69557289aec None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:17.638574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae2cb5-0f95-4fa7-a361-a69557289aec None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:17.638574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae2cb5-0f95-4fa7-a361-a69557289aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:17.680139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0aae2cb5-0f95-4fa7-a361-a69557289aec None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:17.681703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0aae2cb5-0f95-4fa7-a361-a69557289aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:17.762970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:17.817711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 158/338] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:19:17.828238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfbdbc-d865-4995-bb47-5afd47abd91a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:17.858642 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae2cb5-0f95-4fa7-a361-a69557289aec None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:17.898641 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350d92b-a58c-4392-87d4-402f6e3572b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:17.899453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350d92b-a58c-4392-87d4-402f6e3572b5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:17.899737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350d92b-a58c-4392-87d4-402f6e3572b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:17.900015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350d92b-a58c-4392-87d4-402f6e3572b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:17.923974 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350d92b-a58c-4392-87d4-402f6e3572b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-a350d92b-a58c-4392-87d4-402f6e3572b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:17.931892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:17.932810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:17.933593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:17.933593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:17.933593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:17.933593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:17.933593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:17.933593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:17.933593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:17.933593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:17.933593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:17.933593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:17.933593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:17.933593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:17.933593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 181/339] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:17.937010 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0160eb4-5988-4437-a4f4-22d872401f70 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:17.938828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0160eb4-5988-4437-a4f4-22d872401f70 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:17.939928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0160eb4-5988-4437-a4f4-22d872401f70 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:17.951487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 182/340] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:17 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:17.952686 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0160eb4-5988-4437-a4f4-22d872401f70 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:18.043053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:18.093759 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae2cb5-0f95-4fa7-a361-a69557289aec None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:18.177039 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3605b-6a5a-4c1b-ae71-de3fe17fe215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:18.177858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3605b-6a5a-4c1b-ae71-de3fe17fe215 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:18.178145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3605b-6a5a-4c1b-ae71-de3fe17fe215 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:18.178453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3605b-6a5a-4c1b-ae71-de3fe17fe215 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:18.203376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0160eb4-5988-4437-a4f4-22d872401f70 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:18.206795 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3605b-6a5a-4c1b-ae71-de3fe17fe215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-36b3605b-6a5a-4c1b-ae71-de3fe17fe215 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:18.214912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:18.216798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:18.218133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:18.218133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:18.218133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:18.218133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:18.218133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:18.218133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:18.218133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:18.218133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:18.218133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:18.218133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:18.218133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:19:18.218133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:18.218133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 159/341] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:19:18.229129 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd5572-de2e-4786-afcc-0cd0eb894f08 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:18.229434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd5572-de2e-4786-afcc-0cd0eb894f08 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:18.229699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd5572-de2e-4786-afcc-0cd0eb894f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:18.258710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:18.265354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0cfd5572-de2e-4786-afcc-0cd0eb894f08 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:18.268929 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0cfd5572-de2e-4786-afcc-0cd0eb894f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:18.289660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc7a19-3818-4d6c-a232-a43f53127e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:18.292128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc7a19-3818-4d6c-a232-a43f53127e75 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:18.293335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc7a19-3818-4d6c-a232-a43f53127e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:18.294409 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc7a19-3818-4d6c-a232-a43f53127e75 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:18.296779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc7a19-3818-4d6c-a232-a43f53127e75 None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:18.298275 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc7a19-3818-4d6c-a232-a43f53127e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:18.301696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc7a19-3818-4d6c-a232-a43f53127e75 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:18.324485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 183/342] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:18.326489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc7a19-3818-4d6c-a232-a43f53127e75 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:18.425774 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 160/343] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:18.426717 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd5572-de2e-4786-afcc-0cd0eb894f08 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:18.545043 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc7a19-3818-4d6c-a232-a43f53127e75 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:18.581851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:18.610218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c177f11-619c-4e24-b84e-2ab62c116dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:18.610983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c177f11-619c-4e24-b84e-2ab62c116dac None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:18.611270 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c177f11-619c-4e24-b84e-2ab62c116dac None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:18.611669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c177f11-619c-4e24-b84e-2ab62c116dac None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:18.612452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c177f11-619c-4e24-b84e-2ab62c116dac None admin] RBAC: Adding query filter params (name=reader) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:18.612764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c177f11-619c-4e24-b84e-2ab62c116dac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:18.614197 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c177f11-619c-4e24-b84e-2ab62c116dac None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:18.624721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 184/344] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:18.625749 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c177f11-619c-4e24-b84e-2ab62c116dac None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:18.663126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd5572-de2e-4786-afcc-0cd0eb894f08 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:18.734561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:18.749947 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d511675-c9e3-4819-ab68-37a948d5572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:18.751145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d511675-c9e3-4819-ab68-37a948d5572a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:18.751456 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d511675-c9e3-4819-ab68-37a948d5572a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:18.751737 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d511675-c9e3-4819-ab68-37a948d5572a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:18.823163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c177f11-619c-4e24-b84e-2ab62c116dac None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:18.848489 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d511675-c9e3-4819-ab68-37a948d5572a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:18.849986 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d511675-c9e3-4819-ab68-37a948d5572a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:18.867753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae0c91-750c-4030-aeb5-de91f744687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:18.868929 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae0c91-750c-4030-aeb5-de91f744687d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:18.869412 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae0c91-750c-4030-aeb5-de91f744687d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:18.870018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae0c91-750c-4030-aeb5-de91f744687d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:18.883689 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae0c91-750c-4030-aeb5-de91f744687d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-1fae0c91-750c-4030-aeb5-de91f744687d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:18.893552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:18.894560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:18.895389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:18.895389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:18.895389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:18.895389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:18.895389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:18.895389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:18.895389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:18.895389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:18.895389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:18.895389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:18.895389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:18.895389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:18.898375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 185/345] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:19:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:18.899485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae0c91-750c-4030-aeb5-de91f744687d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:18.925504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:18.986912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 161/346] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:18.989420 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ae1e4-f46b-47c3-b2dd-1d568a7e2e5b None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:18.990200 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ae1e4-f46b-47c3-b2dd-1d568a7e2e5b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:18.990682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ae1e4-f46b-47c3-b2dd-1d568a7e2e5b None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:18.993602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 162/347] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:18.994628 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ae1e4-f46b-47c3-b2dd-1d568a7e2e5b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:19.058191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae0c91-750c-4030-aeb5-de91f744687d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:19.070955 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:19.107990 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446853b-1e7e-403b-a58e-254812cec528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:19.108796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446853b-1e7e-403b-a58e-254812cec528 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:19.109140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446853b-1e7e-403b-a58e-254812cec528 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:19.109371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446853b-1e7e-403b-a58e-254812cec528 None admin] PATH_INFO: `/v3/users/5b5860e2c2f943c6b93edd14993149ab` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:19.110728 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446853b-1e7e-403b-a58e-254812cec528 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5860e2c2f943c6b93edd14993149ab)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:19.113488 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446853b-1e7e-403b-a58e-254812cec528 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:19.118087 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 186/348] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:19:18 2022] GET /identity/v3/users/5b5860e2c2f943c6b93edd14993149ab => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:19.118087 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446853b-1e7e-403b-a58e-254812cec528 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:19.155322 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ae1e4-f46b-47c3-b2dd-1d568a7e2e5b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:19.225239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9190fe-4bb4-42c9-9716-246e5f285753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:19.225922 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9190fe-4bb4-42c9-9716-246e5f285753 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:19.226214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9190fe-4bb4-42c9-9716-246e5f285753 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:19.226541 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9190fe-4bb4-42c9-9716-246e5f285753 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:19.227303 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9190fe-4bb4-42c9-9716-246e5f285753 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:19.227613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9190fe-4bb4-42c9-9716-246e5f285753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:19.229017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9190fe-4bb4-42c9-9716-246e5f285753 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:19.241631 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 163/349] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:19.243294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f3d66-d3ba-4142-b985-da2676eef6ba None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:19.243694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f3d66-d3ba-4142-b985-da2676eef6ba None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:19.243978 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f3d66-d3ba-4142-b985-da2676eef6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:19.269033 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c10f3d66-d3ba-4142-b985-da2676eef6ba None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:19.270240 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c10f3d66-d3ba-4142-b985-da2676eef6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:19.272133 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446853b-1e7e-403b-a58e-254812cec528 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:19.304378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:19.318085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c0f25-d795-4326-997b-df89f01bab91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:19.319256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c0f25-d795-4326-997b-df89f01bab91 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:19.319673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c0f25-d795-4326-997b-df89f01bab91 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:19.325806 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c0f25-d795-4326-997b-df89f01bab91 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:19.325806 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c0f25-d795-4326-997b-df89f01bab91 None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:19.325806 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c0f25-d795-4326-997b-df89f01bab91 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:19.327638 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 187/350] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:19 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:19.329031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b88fbf-33aa-4abf-b555-723786244750 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:19.329318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b88fbf-33aa-4abf-b555-723786244750 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:19.329600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b88fbf-33aa-4abf-b555-723786244750 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:19.333102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 188/351] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:19.333102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b88fbf-33aa-4abf-b555-723786244750 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:19.392768 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 164/352] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:19.394340 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f3d66-d3ba-4142-b985-da2676eef6ba None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:19.424893 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:19.516917 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b88fbf-33aa-4abf-b555-723786244750 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:19.539870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f3d66-d3ba-4142-b985-da2676eef6ba None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:19.569205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68541b5-8252-4690-b27d-3f761b6a87a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:19.570867 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68541b5-8252-4690-b27d-3f761b6a87a6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:19.571343 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68541b5-8252-4690-b27d-3f761b6a87a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:19.572180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68541b5-8252-4690-b27d-3f761b6a87a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:19.574104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68541b5-8252-4690-b27d-3f761b6a87a6 None admin] RBAC: Adding query filter params (role.id=ea3d8b70e23b44c0ba368fe1a3b9d04f, user.id=5b5860e2c2f943c6b93edd14993149ab, scope.system=all) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:19.574641 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68541b5-8252-4690-b27d-3f761b6a87a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:19.578194 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68541b5-8252-4690-b27d-3f761b6a87a6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:19.585447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7dc77-42c1-4a0d-a46e-1a2ab90edf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:19.586109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7dc77-42c1-4a0d-a46e-1a2ab90edf5a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:19.586425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7dc77-42c1-4a0d-a46e-1a2ab90edf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:19.586698 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7dc77-42c1-4a0d-a46e-1a2ab90edf5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:19.601243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 189/353] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jul 18 10:19:19 2022] GET /identity/v3/role_assignments?user.id=5b5860e2c2f943c6b93edd14993149ab&scope.system=all&role.id=ea3d8b70e23b44c0ba368fe1a3b9d04f => generated 510 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:19.602346 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68541b5-8252-4690-b27d-3f761b6a87a6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:19.626547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:19.685705 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7dc77-42c1-4a0d-a46e-1a2ab90edf5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:19.689935 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7dc77-42c1-4a0d-a46e-1a2ab90edf5a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:19.772455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68541b5-8252-4690-b27d-3f761b6a87a6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:19.789622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:19.841538 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12eb23-9cef-45c1-af24-114d49e973ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:19.843012 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12eb23-9cef-45c1-af24-114d49e973ca None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:19.843519 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12eb23-9cef-45c1-af24-114d49e973ca None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:19.843894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12eb23-9cef-45c1-af24-114d49e973ca None admin] PATH_INFO: `/v3/groups/7609c84b665a40a2b957f750d8fd272e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:19.850824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12eb23-9cef-45c1-af24-114d49e973ca None admin] RBAC: Authorizing `identity:get_group(group_id=7609c84b665a40a2b957f750d8fd272e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:19.852889 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12eb23-9cef-45c1-af24-114d49e973ca None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:19.854659 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 190/354] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 18 10:19:19 2022] GET /identity/v3/groups/7609c84b665a40a2b957f750d8fd272e => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:19.855964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c5a4-4a94-48ea-b3eb-d060dedd7269 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:19.856267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c5a4-4a94-48ea-b3eb-d060dedd7269 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:19.857252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c5a4-4a94-48ea-b3eb-d060dedd7269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:19.859594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 165/355] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:19.860442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7dc77-42c1-4a0d-a46e-1a2ab90edf5a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:19.879684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b579c5a4-4a94-48ea-b3eb-d060dedd7269 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:19.881304 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b579c5a4-4a94-48ea-b3eb-d060dedd7269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:19.933125 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:19.980882 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 191/356] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:19.982727 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ab0fc-9b9a-4565-9e71-86e424a979b6 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:19.983234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ab0fc-9b9a-4565-9e71-86e424a979b6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:19.983710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ab0fc-9b9a-4565-9e71-86e424a979b6 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:19.985301 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 192/357] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:19.986276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ab0fc-9b9a-4565-9e71-86e424a979b6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:20.000275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7dc77-42c1-4a0d-a46e-1a2ab90edf5a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:20.050180 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c020090-29e8-4c5e-a378-d77c502b7a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:20.051018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c020090-29e8-4c5e-a378-d77c502b7a1c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:20.051300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c020090-29e8-4c5e-a378-d77c502b7a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:20.051584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c020090-29e8-4c5e-a378-d77c502b7a1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:20.067086 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c020090-29e8-4c5e-a378-d77c502b7a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-9c020090-29e8-4c5e-a378-d77c502b7a1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:20.074958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:20.076969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:20.077752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:20.077752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:20.077752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:20.077752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:20.077752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:20.077752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:20.077752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:20.077752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:20.077752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:20.077752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:20.077752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:20.077752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:20.077752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 166/358] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:20.077752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c020090-29e8-4c5e-a378-d77c502b7a1c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:20.130644 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:20.139857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ab0fc-9b9a-4565-9e71-86e424a979b6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:20.202599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05aaa6-273c-4f1b-9b22-b74708ba2b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:20.202599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05aaa6-273c-4f1b-9b22-b74708ba2b64 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:20.202599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05aaa6-273c-4f1b-9b22-b74708ba2b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:20.202974 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05aaa6-273c-4f1b-9b22-b74708ba2b64 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:20.204312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05aaa6-273c-4f1b-9b22-b74708ba2b64 None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:20.205483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05aaa6-273c-4f1b-9b22-b74708ba2b64 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:20.207647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 193/359] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:19 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:20.208827 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807edc5-3adb-4396-9f94-fa9f2629118d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:20.209117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807edc5-3adb-4396-9f94-fa9f2629118d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:20.209397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807edc5-3adb-4396-9f94-fa9f2629118d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:20.227558 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-4807edc5-3adb-4396-9f94-fa9f2629118d None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:20.228778 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4807edc5-3adb-4396-9f94-fa9f2629118d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:20.231604 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c020090-29e8-4c5e-a378-d77c502b7a1c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:20.259503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:20.290215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9a374-f242-4119-98f6-28615edf59c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:20.290992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9a374-f242-4119-98f6-28615edf59c1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:20.291364 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9a374-f242-4119-98f6-28615edf59c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:20.291622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9a374-f242-4119-98f6-28615edf59c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:20.292482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9a374-f242-4119-98f6-28615edf59c1 None admin] RBAC: Adding query filter params (group.id=7609c84b665a40a2b957f750d8fd272e, role.id=4b6ddd50803f4f9bbf171c5c7cb9af63, scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:20.293370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9a374-f242-4119-98f6-28615edf59c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:20.295989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9a374-f242-4119-98f6-28615edf59c1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:20.304291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 167/360] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 18 10:19:20 2022] GET /identity/v3/role_assignments?group.id=7609c84b665a40a2b957f750d8fd272e&scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f&role.id=4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:20.305963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9a374-f242-4119-98f6-28615edf59c1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:20.313796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 194/361] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:20.314915 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807edc5-3adb-4396-9f94-fa9f2629118d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:20.471421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9a374-f242-4119-98f6-28615edf59c1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:20.482875 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:20.494867 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807edc5-3adb-4396-9f94-fa9f2629118d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:20.529365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b8e23-7b9a-4931-bc80-f28632ce228f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:20.530224 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b8e23-7b9a-4931-bc80-f28632ce228f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:20.530602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b8e23-7b9a-4931-bc80-f28632ce228f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:20.530852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b8e23-7b9a-4931-bc80-f28632ce228f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:20.542568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b8e23-7b9a-4931-bc80-f28632ce228f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-945b8e23-7b9a-4931-bc80-f28632ce228f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:20.551077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:20.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:20.554531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:20.554531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:20.554531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:20.554531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:20.554531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:20.554531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:20.554531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:20.554531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:20.554531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:20.554531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:20.554531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:20.554531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:20.554531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 168/362] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:19:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:20.554531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b8e23-7b9a-4931-bc80-f28632ce228f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:20.563940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca730d50-9fbc-446f-8ec2-4e2e5ce17a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:20.564630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca730d50-9fbc-446f-8ec2-4e2e5ce17a06 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:20.564911 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca730d50-9fbc-446f-8ec2-4e2e5ce17a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:20.565181 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca730d50-9fbc-446f-8ec2-4e2e5ce17a06 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:20.565942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca730d50-9fbc-446f-8ec2-4e2e5ce17a06 None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:20.566397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca730d50-9fbc-446f-8ec2-4e2e5ce17a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:20.567823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca730d50-9fbc-446f-8ec2-4e2e5ce17a06 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:20.581408 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 195/363] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:20.583122 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca730d50-9fbc-446f-8ec2-4e2e5ce17a06 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:20.633339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:20.719828 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b8e23-7b9a-4931-bc80-f28632ce228f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:20.731460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca730d50-9fbc-446f-8ec2-4e2e5ce17a06 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:20.775462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff1625-43ad-4a29-8f27-82cc71779924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:20.775706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff1625-43ad-4a29-8f27-82cc71779924 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:20.776099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff1625-43ad-4a29-8f27-82cc71779924 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:20.776239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff1625-43ad-4a29-8f27-82cc71779924 None admin] PATH_INFO: `/v3/groups/7609c84b665a40a2b957f750d8fd272e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:20.777411 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff1625-43ad-4a29-8f27-82cc71779924 None admin] RBAC: Authorizing `identity:get_group(group_id=7609c84b665a40a2b957f750d8fd272e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:20.779064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171c3cf-4796-4c71-9aa5-56f711d0358f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:20.779486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff1625-43ad-4a29-8f27-82cc71779924 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:20.779912 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171c3cf-4796-4c71-9aa5-56f711d0358f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:20.780192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171c3cf-4796-4c71-9aa5-56f711d0358f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:20.780469 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171c3cf-4796-4c71-9aa5-56f711d0358f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:20.781262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 169/364] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 18 10:19:20 2022] GET /identity/v3/groups/7609c84b665a40a2b957f750d8fd272e => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:20.787349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff1625-43ad-4a29-8f27-82cc71779924 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:20.796269 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171c3cf-4796-4c71-9aa5-56f711d0358f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-b171c3cf-4796-4c71-9aa5-56f711d0358f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:20.805060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:20.807680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:20.809082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:20.809082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:20.809082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:20.809082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:20.809082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:20.809082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:20.809082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:20.809082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:20.809082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:20.809082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:20.809082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:19:20.809082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:20.809082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 196/365] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:19:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:20.809082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171c3cf-4796-4c71-9aa5-56f711d0358f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:20.833197 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:20.969912 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171c3cf-4796-4c71-9aa5-56f711d0358f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:20.970137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff1625-43ad-4a29-8f27-82cc71779924 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:20.988987 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:21.008398 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24637fa7-a80b-4a16-a871-7ea1c46044f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:21.009249 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24637fa7-a80b-4a16-a871-7ea1c46044f3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:21.009634 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24637fa7-a80b-4a16-a871-7ea1c46044f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:21.009912 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24637fa7-a80b-4a16-a871-7ea1c46044f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:21.011842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724ce91-0ad3-4d35-9c4a-7bc68fee3873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:21.013402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724ce91-0ad3-4d35-9c4a-7bc68fee3873 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:21.013402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724ce91-0ad3-4d35-9c4a-7bc68fee3873 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:21.013843 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724ce91-0ad3-4d35-9c4a-7bc68fee3873 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:21.015691 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724ce91-0ad3-4d35-9c4a-7bc68fee3873 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:21.016064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724ce91-0ad3-4d35-9c4a-7bc68fee3873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:21.017476 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724ce91-0ad3-4d35-9c4a-7bc68fee3873 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:21.028958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 170/366] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:21.030254 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724ce91-0ad3-4d35-9c4a-7bc68fee3873 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:21.115448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24637fa7-a80b-4a16-a871-7ea1c46044f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:21.117757 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24637fa7-a80b-4a16-a871-7ea1c46044f3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:21.145304 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:21.164981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724ce91-0ad3-4d35-9c4a-7bc68fee3873 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:21.221366 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b341f09-aab1-4c07-8c8c-afb9d76e72e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:21.222038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b341f09-aab1-4c07-8c8c-afb9d76e72e5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:21.222317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b341f09-aab1-4c07-8c8c-afb9d76e72e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:21.222614 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b341f09-aab1-4c07-8c8c-afb9d76e72e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:21.223819 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b341f09-aab1-4c07-8c8c-afb9d76e72e5 None admin] RBAC: Adding query filter params (group.id=7609c84b665a40a2b957f750d8fd272e, role.id=575c54955d4a474e9c687a0100991d1d, scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:21.224126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b341f09-aab1-4c07-8c8c-afb9d76e72e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:21.225896 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b341f09-aab1-4c07-8c8c-afb9d76e72e5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:21.233174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 171/367] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 18 10:19:21 2022] GET /identity/v3/role_assignments?group.id=7609c84b665a40a2b957f750d8fd272e&scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f&role.id=575c54955d4a474e9c687a0100991d1d => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:21.233940 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b341f09-aab1-4c07-8c8c-afb9d76e72e5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:21.273370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 197/368] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:21.279971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24637fa7-a80b-4a16-a871-7ea1c46044f3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:21.285967 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:21.387611 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b341f09-aab1-4c07-8c8c-afb9d76e72e5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:21.425731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24637fa7-a80b-4a16-a871-7ea1c46044f3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:21.433423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812d9ac-77a8-4830-94ff-00af852838dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:21.434199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812d9ac-77a8-4830-94ff-00af852838dd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:21.435068 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812d9ac-77a8-4830-94ff-00af852838dd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:21.435377 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812d9ac-77a8-4830-94ff-00af852838dd None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:21.436819 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812d9ac-77a8-4830-94ff-00af852838dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:21.437052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812d9ac-77a8-4830-94ff-00af852838dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:21.439079 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812d9ac-77a8-4830-94ff-00af852838dd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:21.451850 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:21.453603 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 172/369] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:21.454906 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812d9ac-77a8-4830-94ff-00af852838dd None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:21.483089 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278c2e7-4b2c-4563-902e-06ce1ecfc612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:21.484125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278c2e7-4b2c-4563-902e-06ce1ecfc612 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:21.484635 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278c2e7-4b2c-4563-902e-06ce1ecfc612 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:21.485124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278c2e7-4b2c-4563-902e-06ce1ecfc612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:21.587717 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:21.595493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278c2e7-4b2c-4563-902e-06ce1ecfc612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:21.595985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812d9ac-77a8-4830-94ff-00af852838dd None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:21.597722 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278c2e7-4b2c-4563-902e-06ce1ecfc612 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:21.668070 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaeeeb-4414-4491-b07f-529fd299a95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:21.670093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaeeeb-4414-4491-b07f-529fd299a95b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:21.670619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaeeeb-4414-4491-b07f-529fd299a95b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:21.671107 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaeeeb-4414-4491-b07f-529fd299a95b None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:21.673363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baaeeeb-4414-4491-b07f-529fd299a95b None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:21.676438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baaeeeb-4414-4491-b07f-529fd299a95b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:21.681623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 173/370] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:21 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:21.683254 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaeeeb-4414-4491-b07f-529fd299a95b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:21.728540 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 198/371] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:21.729388 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278c2e7-4b2c-4563-902e-06ce1ecfc612 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:21.749832 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:21.862655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaeeeb-4414-4491-b07f-529fd299a95b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:21.866694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278c2e7-4b2c-4563-902e-06ce1ecfc612 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:21.900547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00ee92-47c4-4be6-849e-76b471166347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:21.901196 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00ee92-47c4-4be6-849e-76b471166347 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:21.901476 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00ee92-47c4-4be6-849e-76b471166347 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:21.901747 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00ee92-47c4-4be6-849e-76b471166347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:21.910172 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdd76e-0e4d-41de-8b86-c9a7b0d78b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:21.911049 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdd76e-0e4d-41de-8b86-c9a7b0d78b98 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:21.911328 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdd76e-0e4d-41de-8b86-c9a7b0d78b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:21.911600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdd76e-0e4d-41de-8b86-c9a7b0d78b98 None admin] PATH_INFO: `/v3/groups/7609c84b665a40a2b957f750d8fd272e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:21.912790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdd76e-0e4d-41de-8b86-c9a7b0d78b98 None admin] RBAC: Authorizing `identity:get_group(group_id=7609c84b665a40a2b957f750d8fd272e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:21.914229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdd76e-0e4d-41de-8b86-c9a7b0d78b98 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:21.916114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 199/372] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 18 10:19:21 2022] GET /identity/v3/groups/7609c84b665a40a2b957f750d8fd272e => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:21.916651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdd76e-0e4d-41de-8b86-c9a7b0d78b98 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:21.966843 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:22.008364 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00ee92-47c4-4be6-849e-76b471166347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:22.011196 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00ee92-47c4-4be6-849e-76b471166347 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:22.047756 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:22.069408 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdd76e-0e4d-41de-8b86-c9a7b0d78b98 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:22.110861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775d565-93b0-4ccb-91cc-7386220b9294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:22.112032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775d565-93b0-4ccb-91cc-7386220b9294 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:22.112490 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775d565-93b0-4ccb-91cc-7386220b9294 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:22.112996 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775d565-93b0-4ccb-91cc-7386220b9294 None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:22.114477 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775d565-93b0-4ccb-91cc-7386220b9294 None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:22.116272 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775d565-93b0-4ccb-91cc-7386220b9294 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:22.118534 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 200/373] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:21 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:22.119510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775d565-93b0-4ccb-91cc-7386220b9294 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:22.146932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 174/374] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:22.148070 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00ee92-47c4-4be6-849e-76b471166347 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:22.225367 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:22.227411 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775d565-93b0-4ccb-91cc-7386220b9294 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:22.265702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48cd92-c99f-41c1-834e-721bb6afdde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:22.266509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00ee92-47c4-4be6-849e-76b471166347 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:22.266922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48cd92-c99f-41c1-834e-721bb6afdde8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:22.267395 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48cd92-c99f-41c1-834e-721bb6afdde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:22.267836 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48cd92-c99f-41c1-834e-721bb6afdde8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:22.268843 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48cd92-c99f-41c1-834e-721bb6afdde8 None admin] RBAC: Adding query filter params (group.id=7609c84b665a40a2b957f750d8fd272e, role.id=4b6ddd50803f4f9bbf171c5c7cb9af63, scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:22.269342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48cd92-c99f-41c1-834e-721bb6afdde8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:22.271033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48cd92-c99f-41c1-834e-721bb6afdde8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:22.277706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 201/375] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 18 10:19:22 2022] GET /identity/v3/role_assignments?group.id=7609c84b665a40a2b957f750d8fd272e&scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1&role.id=4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:22.279448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48cd92-c99f-41c1-834e-721bb6afdde8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:22.300056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:22.329396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172df1dc-838b-4f13-b29f-0d31845168f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:22.330529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172df1dc-838b-4f13-b29f-0d31845168f5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:22.334829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172df1dc-838b-4f13-b29f-0d31845168f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:22.335126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172df1dc-838b-4f13-b29f-0d31845168f5 None admin] PATH_INFO: `/v3/groups/7609c84b665a40a2b957f750d8fd272e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:22.336771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172df1dc-838b-4f13-b29f-0d31845168f5 None admin] RBAC: Authorizing `identity:get_group(group_id=7609c84b665a40a2b957f750d8fd272e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:22.342357 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172df1dc-838b-4f13-b29f-0d31845168f5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:22.343707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 175/376] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 18 10:19:22 2022] GET /identity/v3/groups/7609c84b665a40a2b957f750d8fd272e => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:22.348663 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172df1dc-838b-4f13-b29f-0d31845168f5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:22.429869 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48cd92-c99f-41c1-834e-721bb6afdde8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:22.500522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a461a-6e73-4d24-bf7d-46dc0dafe034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:22.501407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a461a-6e73-4d24-bf7d-46dc0dafe034 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:22.501689 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a461a-6e73-4d24-bf7d-46dc0dafe034 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:22.506802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a461a-6e73-4d24-bf7d-46dc0dafe034 None admin] PATH_INFO: `/v3/projects/bd97299e4fa148ce8ed40c106d7096bc` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:22.508534 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a461a-6e73-4d24-bf7d-46dc0dafe034 None admin] RBAC: Authorizing `identity:get_project(project_id=bd97299e4fa148ce8ed40c106d7096bc)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:22.510070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a461a-6e73-4d24-bf7d-46dc0dafe034 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:22.512138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 202/377] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:22 2022] GET /identity/v3/projects/bd97299e4fa148ce8ed40c106d7096bc => generated 344 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:22.519410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a461a-6e73-4d24-bf7d-46dc0dafe034 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:22.544181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172df1dc-838b-4f13-b29f-0d31845168f5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:22.592142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ea31f-e05c-48ac-a3fc-8637a27bf10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:22.593519 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ea31f-e05c-48ac-a3fc-8637a27bf10b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:22.594593 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ea31f-e05c-48ac-a3fc-8637a27bf10b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:22.595366 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ea31f-e05c-48ac-a3fc-8637a27bf10b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:22.596521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ea31f-e05c-48ac-a3fc-8637a27bf10b None admin] RBAC: Adding query filter params (group.id=7609c84b665a40a2b957f750d8fd272e, role.id=575c54955d4a474e9c687a0100991d1d, scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:22.597050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ea31f-e05c-48ac-a3fc-8637a27bf10b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:22.599050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ea31f-e05c-48ac-a3fc-8637a27bf10b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:22.601547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:22.607958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 176/378] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 18 10:19:22 2022] GET /identity/v3/role_assignments?group.id=7609c84b665a40a2b957f750d8fd272e&scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1&role.id=575c54955d4a474e9c687a0100991d1d => generated 260 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:22.672289 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:22.691988 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a461a-6e73-4d24-bf7d-46dc0dafe034 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:22.724528 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef78d5b-2e61-44d6-b37e-2bdb363990ec None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:22.725510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef78d5b-2e61-44d6-b37e-2bdb363990ec None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:22.725986 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef78d5b-2e61-44d6-b37e-2bdb363990ec None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:22.727723 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 177/379] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:22.734569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05152d6-5e70-4490-9b81-f89cc903fba0 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:22.735222 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05152d6-5e70-4490-9b81-f89cc903fba0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:22.735801 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05152d6-5e70-4490-9b81-f89cc903fba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:22.738282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581400c-d10f-46c7-af70-67284ca9787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:22.738282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581400c-d10f-46c7-af70-67284ca9787f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:22.738282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581400c-d10f-46c7-af70-67284ca9787f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:22.738282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581400c-d10f-46c7-af70-67284ca9787f None admin] PATH_INFO: `/v3/groups/2b83e9b5249b4b6bb3f2f23c8868f790` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:22.744692 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581400c-d10f-46c7-af70-67284ca9787f None admin] RBAC: Authorizing `identity:get_group(group_id=2b83e9b5249b4b6bb3f2f23c8868f790)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:22.746196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581400c-d10f-46c7-af70-67284ca9787f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:22.749194 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 203/380] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 18 10:19:22 2022] GET /identity/v3/groups/2b83e9b5249b4b6bb3f2f23c8868f790 => generated 229 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:22.766388 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581400c-d10f-46c7-af70-67284ca9787f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:22.770060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d05152d6-5e70-4490-9b81-f89cc903fba0 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:22.771629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d05152d6-5e70-4490-9b81-f89cc903fba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:22.866929 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 178/381] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:19:22.891352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05152d6-5e70-4490-9b81-f89cc903fba0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:22.977191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581400c-d10f-46c7-af70-67284ca9787f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:23.018463 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051d8f9-8070-4206-a40f-0575539ac37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:23.019297 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051d8f9-8070-4206-a40f-0575539ac37a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:23.019630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051d8f9-8070-4206-a40f-0575539ac37a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:23.019941 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051d8f9-8070-4206-a40f-0575539ac37a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:23.020976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051d8f9-8070-4206-a40f-0575539ac37a None admin] RBAC: Adding query filter params (group.id=2b83e9b5249b4b6bb3f2f23c8868f790, role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=bd97299e4fa148ce8ed40c106d7096bc) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:23.021286 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051d8f9-8070-4206-a40f-0575539ac37a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:23.023201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051d8f9-8070-4206-a40f-0575539ac37a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:23.030923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 204/382] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 18 10:19:22 2022] GET /identity/v3/role_assignments?group.id=2b83e9b5249b4b6bb3f2f23c8868f790&scope.project.id=bd97299e4fa148ce8ed40c106d7096bc&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:23.144499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05152d6-5e70-4490-9b81-f89cc903fba0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:23.191566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:23.202055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb185a52-5944-418a-a080-e6f079e1e8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:23.202905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb185a52-5944-418a-a080-e6f079e1e8cf None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:23.203186 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb185a52-5944-418a-a080-e6f079e1e8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:23.210089 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb185a52-5944-418a-a080-e6f079e1e8cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:23.219620 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb185a52-5944-418a-a080-e6f079e1e8cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-eb185a52-5944-418a-a080-e6f079e1e8cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:23.227563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:23.228637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:23.229417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:23.229417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:23.229417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:23.229417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:23.229417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:23.229417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:23.229417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:23.229417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:23.229417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:23.229417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:23.229417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:23.229417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:23.229417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 179/383] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:19:23.235397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051d8f9-8070-4206-a40f-0575539ac37a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:23.256345 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:23.384431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051d8f9-8070-4206-a40f-0575539ac37a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:23.443960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05551c8-8d6c-44e1-a7b6-aa23e03d8fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:23.445109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05551c8-8d6c-44e1-a7b6-aa23e03d8fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:23.445654 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05551c8-8d6c-44e1-a7b6-aa23e03d8fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:23.446233 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05551c8-8d6c-44e1-a7b6-aa23e03d8fb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:23.447305 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05551c8-8d6c-44e1-a7b6-aa23e03d8fb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:23.447866 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05551c8-8d6c-44e1-a7b6-aa23e03d8fb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:23.449544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05551c8-8d6c-44e1-a7b6-aa23e03d8fb6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:23.469676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 205/384] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:23.475418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb185a52-5944-418a-a080-e6f079e1e8cf None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:23.570065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724fa7-e961-45bf-bbe4-d403d1904e1f None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:23.571040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724fa7-e961-45bf-bbe4-d403d1904e1f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:23.571565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724fa7-e961-45bf-bbe4-d403d1904e1f None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:23.574386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 206/385] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:19:23.587224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48f0f6-c94f-454f-9f58-dfd1831cc21e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:23.588784 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48f0f6-c94f-454f-9f58-dfd1831cc21e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:23.589305 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48f0f6-c94f-454f-9f58-dfd1831cc21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:23.629787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6b48f0f6-c94f-454f-9f58-dfd1831cc21e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:23.631269 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6b48f0f6-c94f-454f-9f58-dfd1831cc21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:23.652735 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb185a52-5944-418a-a080-e6f079e1e8cf None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:23.692558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d9aef-e6d6-409e-93af-65ab57f124f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:23.693459 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d9aef-e6d6-409e-93af-65ab57f124f4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:23.693743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d9aef-e6d6-409e-93af-65ab57f124f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:23.694024 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d9aef-e6d6-409e-93af-65ab57f124f4 None admin] PATH_INFO: `/v3/groups/7609c84b665a40a2b957f750d8fd272e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:23.695246 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d9aef-e6d6-409e-93af-65ab57f124f4 None admin] RBAC: Authorizing `identity:get_group(group_id=7609c84b665a40a2b957f750d8fd272e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:23.696694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d9aef-e6d6-409e-93af-65ab57f124f4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:23.698524 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 180/386] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 18 10:19:23 2022] GET /identity/v3/groups/7609c84b665a40a2b957f750d8fd272e => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:23.704775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d9aef-e6d6-409e-93af-65ab57f124f4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:23.769002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:23.783480 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 207/387] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:23.834823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d9aef-e6d6-409e-93af-65ab57f124f4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:23.864044 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48f0f6-c94f-454f-9f58-dfd1831cc21e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:23.867419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:23.879437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59426c3a-079a-45ab-a40f-e33ef2e3e530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:23.880422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59426c3a-079a-45ab-a40f-e33ef2e3e530 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:23.880712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59426c3a-079a-45ab-a40f-e33ef2e3e530 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:23.880988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59426c3a-079a-45ab-a40f-e33ef2e3e530 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:23.882197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59426c3a-079a-45ab-a40f-e33ef2e3e530 None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:23.884034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59426c3a-079a-45ab-a40f-e33ef2e3e530 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:23.890621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 181/388] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:23 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:23.892647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59426c3a-079a-45ab-a40f-e33ef2e3e530 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:24.008641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59426c3a-079a-45ab-a40f-e33ef2e3e530 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:24.037077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:24.058473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0e2bf-73cc-4ca3-a89c-b99178413f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:24.060449 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0e2bf-73cc-4ca3-a89c-b99178413f14 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:24.060740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0e2bf-73cc-4ca3-a89c-b99178413f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:24.061026 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0e2bf-73cc-4ca3-a89c-b99178413f14 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f/groups/7609c84b665a40a2b957f750d8fd272e/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:24.066181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0e2bf-73cc-4ca3-a89c-b99178413f14 None admin] RBAC: Authorizing `identity:create_grant(project_id=b99807a59bdf4c95bc2a8e8af4d5974f, group_id=7609c84b665a40a2b957f750d8fd272e, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:24.069713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0e2bf-73cc-4ca3-a89c-b99178413f14 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:24.085802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48f0f6-c94f-454f-9f58-dfd1831cc21e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:24.125193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636bf3f-2006-4a70-bed8-25c68c0da67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:24.126009 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636bf3f-2006-4a70-bed8-25c68c0da67e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:24.126293 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636bf3f-2006-4a70-bed8-25c68c0da67e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:24.126633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636bf3f-2006-4a70-bed8-25c68c0da67e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:24.139878 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636bf3f-2006-4a70-bed8-25c68c0da67e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-0636bf3f-2006-4a70-bed8-25c68c0da67e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:24.148977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:24.149880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:24.150738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:24.150738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:24.150738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:24.150738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:24.150738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:24.150738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:24.150738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:24.150738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:24.150738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:24.150738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:24.150738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:24.150738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:24.154885 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 208/389] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:19:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:24.157702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636bf3f-2006-4a70-bed8-25c68c0da67e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:24.168547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 182/390] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jul 18 10:19:23 2022] PUT /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f/groups/7609c84b665a40a2b957f750d8fd272e/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:19:24.232146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:24.275353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636bf3f-2006-4a70-bed8-25c68c0da67e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:24.314191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca0543-94ad-4d9e-88f5-7b666ba4398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:24.314844 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca0543-94ad-4d9e-88f5-7b666ba4398a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:24.315102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca0543-94ad-4d9e-88f5-7b666ba4398a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:24.315382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca0543-94ad-4d9e-88f5-7b666ba4398a None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:24.316128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca0543-94ad-4d9e-88f5-7b666ba4398a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:24.316434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca0543-94ad-4d9e-88f5-7b666ba4398a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:24.317837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca0543-94ad-4d9e-88f5-7b666ba4398a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:24.332268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 209/391] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:24.333735 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0e2bf-73cc-4ca3-a89c-b99178413f14 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:24.499418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0e2bf-73cc-4ca3-a89c-b99178413f14 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:24.552332 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6a6fc-97f8-4932-ad8d-037d310c66b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:24.553400 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6a6fc-97f8-4932-ad8d-037d310c66b1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:24.553730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6a6fc-97f8-4932-ad8d-037d310c66b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:24.554049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6a6fc-97f8-4932-ad8d-037d310c66b1 None admin] PATH_INFO: `/v3/groups/7609c84b665a40a2b957f750d8fd272e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:24.555444 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6a6fc-97f8-4932-ad8d-037d310c66b1 None admin] RBAC: Authorizing `identity:get_group(group_id=7609c84b665a40a2b957f750d8fd272e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:24.557021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6a6fc-97f8-4932-ad8d-037d310c66b1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:24.559301 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 183/392] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 18 10:19:24 2022] GET /identity/v3/groups/7609c84b665a40a2b957f750d8fd272e => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:24.566039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca0543-94ad-4d9e-88f5-7b666ba4398a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:24.746164 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca0543-94ad-4d9e-88f5-7b666ba4398a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:24.784582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:24.794227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cc246-b512-4a4a-bb86-ea8e43ee9d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:24.795420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cc246-b512-4a4a-bb86-ea8e43ee9d12 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:24.795696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cc246-b512-4a4a-bb86-ea8e43ee9d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:24.795964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cc246-b512-4a4a-bb86-ea8e43ee9d12 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:24.803104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cc246-b512-4a4a-bb86-ea8e43ee9d12 None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:24.804552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cc246-b512-4a4a-bb86-ea8e43ee9d12 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:24.806628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 210/393] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:24 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:24.813673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6a6fc-97f8-4932-ad8d-037d310c66b1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:24.941142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:25.014842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6a6fc-97f8-4932-ad8d-037d310c66b1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:25.060274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be3ec2-c6d0-463e-98c8-95a243a59c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:25.061165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be3ec2-c6d0-463e-98c8-95a243a59c37 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:25.061452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be3ec2-c6d0-463e-98c8-95a243a59c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:25.061729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be3ec2-c6d0-463e-98c8-95a243a59c37 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f/groups/7609c84b665a40a2b957f750d8fd272e/roles/575c54955d4a474e9c687a0100991d1d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:25.064010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be3ec2-c6d0-463e-98c8-95a243a59c37 None admin] RBAC: Authorizing `identity:create_grant(project_id=b99807a59bdf4c95bc2a8e8af4d5974f, group_id=7609c84b665a40a2b957f750d8fd272e, role_id=575c54955d4a474e9c687a0100991d1d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:25.065496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be3ec2-c6d0-463e-98c8-95a243a59c37 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:25.106083 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21b3ea-ed8a-47bd-807c-070a6d2c03ba None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:25.110346 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21b3ea-ed8a-47bd-807c-070a6d2c03ba None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:25.110346 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21b3ea-ed8a-47bd-807c-070a6d2c03ba None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:25.110917 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 211/394] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:25.116064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0fd73-ced1-4923-b528-dffbe7e4e1b5 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:25.116572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0fd73-ced1-4923-b528-dffbe7e4e1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:25.117702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0fd73-ced1-4923-b528-dffbe7e4e1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:25.135741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-40e0fd73-ced1-4923-b528-dffbe7e4e1b5 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:25.137266 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-40e0fd73-ced1-4923-b528-dffbe7e4e1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:25.150207 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 184/395] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jul 18 10:19:24 2022] PUT /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f/groups/7609c84b665a40a2b957f750d8fd272e/roles/575c54955d4a474e9c687a0100991d1d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:19:25.242004 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 212/396] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:19:25.275626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be3ec2-c6d0-463e-98c8-95a243a59c37 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:25.390192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849e006-2ea3-4df7-928c-7451dfae09a1 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:25.390897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849e006-2ea3-4df7-928c-7451dfae09a1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:25.391371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849e006-2ea3-4df7-928c-7451dfae09a1 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:25.393534 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 213/397] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:19:25.405937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527cfe-67da-46c3-8771-752fc94eb61e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:25.406582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527cfe-67da-46c3-8771-752fc94eb61e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:25.407078 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527cfe-67da-46c3-8771-752fc94eb61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:25.432729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ab527cfe-67da-46c3-8771-752fc94eb61e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:25.435032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ab527cfe-67da-46c3-8771-752fc94eb61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:25.437669 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be3ec2-c6d0-463e-98c8-95a243a59c37 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:25.459005 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:25.492688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f858b7-9f24-4946-87b5-4f9b9f1e47eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:25.494364 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f858b7-9f24-4946-87b5-4f9b9f1e47eb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:25.502269 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f858b7-9f24-4946-87b5-4f9b9f1e47eb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:25.502269 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f858b7-9f24-4946-87b5-4f9b9f1e47eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:25.513020 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f858b7-9f24-4946-87b5-4f9b9f1e47eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-a2f858b7-9f24-4946-87b5-4f9b9f1e47eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:25.523428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:25.524343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:25.525150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:25.525150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:25.525150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:25.525150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:25.525150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:25.525150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:25.525150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:25.525150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:25.525150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:25.525150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:25.525150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:25.525150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:25.528768 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 185/398] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:25.536173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f858b7-9f24-4946-87b5-4f9b9f1e47eb None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:25.553917 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 214/399] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:25.591919 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab527cfe-67da-46c3-8771-752fc94eb61e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:25.691081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f858b7-9f24-4946-87b5-4f9b9f1e47eb None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:25.702108 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:25.779768 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359aae7-cda5-4cf8-8eca-ae8744ed9075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:25.780361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359aae7-cda5-4cf8-8eca-ae8744ed9075 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:25.780647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359aae7-cda5-4cf8-8eca-ae8744ed9075 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:25.780926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359aae7-cda5-4cf8-8eca-ae8744ed9075 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:25.781685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359aae7-cda5-4cf8-8eca-ae8744ed9075 None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:25.781996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359aae7-cda5-4cf8-8eca-ae8744ed9075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:25.783471 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359aae7-cda5-4cf8-8eca-ae8744ed9075 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:25.787216 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab527cfe-67da-46c3-8771-752fc94eb61e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:25.793072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 186/400] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:25.799766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55237b6d-db70-43e8-be1e-4f2293d3d9e2 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:25.799766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55237b6d-db70-43e8-be1e-4f2293d3d9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:25.799766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55237b6d-db70-43e8-be1e-4f2293d3d9e2 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:25.799766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 187/401] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:25.803400 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55237b6d-db70-43e8-be1e-4f2293d3d9e2 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:25.835046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d33ce-07de-4542-9827-5e07ed62a35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:25.835851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d33ce-07de-4542-9827-5e07ed62a35e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:25.836127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d33ce-07de-4542-9827-5e07ed62a35e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:25.836405 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d33ce-07de-4542-9827-5e07ed62a35e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:25.850914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d33ce-07de-4542-9827-5e07ed62a35e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:25.855787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-855d33ce-07de-4542-9827-5e07ed62a35e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:25.862503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:25.874874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:25.875859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:25.875859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:25.875859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:25.875859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:25.875859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:25.875859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:25.875859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:25.875859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:25.875859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:25.875859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:25.875859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:25.875859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:25.875859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 215/402] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:19:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:25.875859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa58c0b-b1d3-4b03-9e0a-b5e321ac7ab2 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:25.876579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa58c0b-b1d3-4b03-9e0a-b5e321ac7ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:25.876579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa58c0b-b1d3-4b03-9e0a-b5e321ac7ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:25.894149 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3fa58c0b-b1d3-4b03-9e0a-b5e321ac7ab2 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:25.895736 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3fa58c0b-b1d3-4b03-9e0a-b5e321ac7ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:25.956031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55237b6d-db70-43e8-be1e-4f2293d3d9e2 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:25.992910 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 216/403] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:25.994099 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa58c0b-b1d3-4b03-9e0a-b5e321ac7ab2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:26.005897 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8ee0a-f087-4959-91c5-0e8cda267317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:26.007011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8ee0a-f087-4959-91c5-0e8cda267317 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:26.007423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8ee0a-f087-4959-91c5-0e8cda267317 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:26.008590 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8ee0a-f087-4959-91c5-0e8cda267317 None admin] PATH_INFO: `/v3/groups/7609c84b665a40a2b957f750d8fd272e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:26.010043 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8ee0a-f087-4959-91c5-0e8cda267317 None admin] RBAC: Authorizing `identity:get_group(group_id=7609c84b665a40a2b957f750d8fd272e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:26.012095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8ee0a-f087-4959-91c5-0e8cda267317 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:26.015379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 188/404] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 18 10:19:25 2022] GET /identity/v3/groups/7609c84b665a40a2b957f750d8fd272e => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:26.021136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8ee0a-f087-4959-91c5-0e8cda267317 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:26.065594 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:26.141421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8ee0a-f087-4959-91c5-0e8cda267317 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:26.143341 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:26.145811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa58c0b-b1d3-4b03-9e0a-b5e321ac7ab2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:26.188163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468800e-e0ea-4d85-8037-152d9f857b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:26.188995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468800e-e0ea-4d85-8037-152d9f857b8a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:26.189360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468800e-e0ea-4d85-8037-152d9f857b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:26.189693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468800e-e0ea-4d85-8037-152d9f857b8a None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:26.190607 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468800e-e0ea-4d85-8037-152d9f857b8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:26.190982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468800e-e0ea-4d85-8037-152d9f857b8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:26.191310 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dddcd-c756-4b14-a143-03e0b0ee2ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:26.192497 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dddcd-c756-4b14-a143-03e0b0ee2ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:26.192612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468800e-e0ea-4d85-8037-152d9f857b8a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:26.193017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dddcd-c756-4b14-a143-03e0b0ee2ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:26.193593 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dddcd-c756-4b14-a143-03e0b0ee2ef1 None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:26.195813 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5dddcd-c756-4b14-a143-03e0b0ee2ef1 None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:26.197455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5dddcd-c756-4b14-a143-03e0b0ee2ef1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:26.200808 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 189/405] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:26 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:26.201855 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dddcd-c756-4b14-a143-03e0b0ee2ef1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:26.209555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 217/406] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:26.214281 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468800e-e0ea-4d85-8037-152d9f857b8a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:26.340395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dddcd-c756-4b14-a143-03e0b0ee2ef1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:26.345464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468800e-e0ea-4d85-8037-152d9f857b8a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:26.354196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:26.385059 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83febda-9874-47e3-b95e-36e6fa4d0571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:26.385963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83febda-9874-47e3-b95e-36e6fa4d0571 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:26.386316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83febda-9874-47e3-b95e-36e6fa4d0571 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:26.386919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83febda-9874-47e3-b95e-36e6fa4d0571 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:26.393607 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a49cb0-d0d8-4058-a826-4e26ce5e8cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:26.394951 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a49cb0-d0d8-4058-a826-4e26ce5e8cd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:26.395377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a49cb0-d0d8-4058-a826-4e26ce5e8cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:26.396167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a49cb0-d0d8-4058-a826-4e26ce5e8cd2 None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1/groups/7609c84b665a40a2b957f750d8fd272e/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:26.398612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a49cb0-d0d8-4058-a826-4e26ce5e8cd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f94f6141c04458d8c29d2f3bddeaaa1, group_id=7609c84b665a40a2b957f750d8fd272e, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:26.398814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83febda-9874-47e3-b95e-36e6fa4d0571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:26.401655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a49cb0-d0d8-4058-a826-4e26ce5e8cd2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-e83febda-9874-47e3-b95e-36e6fa4d0571 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:26.407787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:26.408738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:26.409543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:26.409543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:26.409543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:26.409543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:26.409543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:26.409543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:26.409543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:26.409543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:26.409543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:26.409543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:26.409543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:19:26.409543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:26.409543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 190/407] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:26.410749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83febda-9874-47e3-b95e-36e6fa4d0571 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:26.444031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:26.523266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83febda-9874-47e3-b95e-36e6fa4d0571 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:26.555162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 218/408] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jul 18 10:19:26 2022] PUT /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1/groups/7609c84b665a40a2b957f750d8fd272e/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:19:26.556359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a49cb0-d0d8-4058-a826-4e26ce5e8cd2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:26.597445 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052504f7-a59e-4aab-b3a0-8c874927e222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:26.600240 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052504f7-a59e-4aab-b3a0-8c874927e222 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:26.600815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052504f7-a59e-4aab-b3a0-8c874927e222 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:26.601694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052504f7-a59e-4aab-b3a0-8c874927e222 None admin] PATH_INFO: `/v3/groups/7609c84b665a40a2b957f750d8fd272e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:26.606896 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052504f7-a59e-4aab-b3a0-8c874927e222 None admin] RBAC: Authorizing `identity:get_group(group_id=7609c84b665a40a2b957f750d8fd272e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:26.611523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052504f7-a59e-4aab-b3a0-8c874927e222 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:26.617621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 191/409] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 18 10:19:26 2022] GET /identity/v3/groups/7609c84b665a40a2b957f750d8fd272e => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:26.635521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052504f7-a59e-4aab-b3a0-8c874927e222 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:26.784648 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a49cb0-d0d8-4058-a826-4e26ce5e8cd2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:26.806866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:26.812580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052504f7-a59e-4aab-b3a0-8c874927e222 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:26.833089 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f87be-cd20-4daa-9ed7-25619172ac48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:26.833814 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f87be-cd20-4daa-9ed7-25619172ac48 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:26.834097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f87be-cd20-4daa-9ed7-25619172ac48 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:26.834395 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f87be-cd20-4daa-9ed7-25619172ac48 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:26.835149 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f87be-cd20-4daa-9ed7-25619172ac48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:26.835450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f87be-cd20-4daa-9ed7-25619172ac48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:26.836881 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f87be-cd20-4daa-9ed7-25619172ac48 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:26.846764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 219/410] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:26.848344 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc441e7-6743-482e-9795-5040039740f0 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:26.848573 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc441e7-6743-482e-9795-5040039740f0 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:26.848849 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc441e7-6743-482e-9795-5040039740f0 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:26.850293 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 220/411] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:26.852342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc441e7-6743-482e-9795-5040039740f0 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:26.861307 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe78827-034f-426f-8134-56e2b47f99a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:26.862799 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe78827-034f-426f-8134-56e2b47f99a6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:26.863812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe78827-034f-426f-8134-56e2b47f99a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:26.864267 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe78827-034f-426f-8134-56e2b47f99a6 None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:26.866162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe78827-034f-426f-8134-56e2b47f99a6 None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:26.868577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe78827-034f-426f-8134-56e2b47f99a6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:26.876697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 192/412] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:26 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:26.876697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675895c-ebfc-4346-ac2c-017cf54fbf82 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:26.878570 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675895c-ebfc-4346-ac2c-017cf54fbf82 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:26.879356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675895c-ebfc-4346-ac2c-017cf54fbf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:26.892665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:26.903247 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9675895c-ebfc-4346-ac2c-017cf54fbf82 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:26.904787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9675895c-ebfc-4346-ac2c-017cf54fbf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:26.986762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc441e7-6743-482e-9795-5040039740f0 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:27.000074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 193/413] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:27.001022 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675895c-ebfc-4346-ac2c-017cf54fbf82 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:27.035257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085f2d5-b428-432a-9240-5a1a655c32e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:27.036233 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085f2d5-b428-432a-9240-5a1a655c32e8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:27.036634 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085f2d5-b428-432a-9240-5a1a655c32e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:27.036976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085f2d5-b428-432a-9240-5a1a655c32e8 None admin] PATH_INFO: `/v3/groups/2b83e9b5249b4b6bb3f2f23c8868f790` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:27.038278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085f2d5-b428-432a-9240-5a1a655c32e8 None admin] RBAC: Authorizing `identity:get_group(group_id=2b83e9b5249b4b6bb3f2f23c8868f790)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:27.039898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085f2d5-b428-432a-9240-5a1a655c32e8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:27.041953 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 221/414] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 18 10:19:26 2022] GET /identity/v3/groups/2b83e9b5249b4b6bb3f2f23c8868f790 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:27.042835 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085f2d5-b428-432a-9240-5a1a655c32e8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:27.141002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:27.149573 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675895c-ebfc-4346-ac2c-017cf54fbf82 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:27.158496 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:27.164939 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085f2d5-b428-432a-9240-5a1a655c32e8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:27.196616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5e2ad-1351-46eb-991c-9f12e12c5ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:27.197971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5e2ad-1351-46eb-991c-9f12e12c5ee1 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:27.198704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5e2ad-1351-46eb-991c-9f12e12c5ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:27.198986 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5e2ad-1351-46eb-991c-9f12e12c5ee1 None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1/groups/7609c84b665a40a2b957f750d8fd272e/roles/575c54955d4a474e9c687a0100991d1d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:27.205400 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5e2ad-1351-46eb-991c-9f12e12c5ee1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f94f6141c04458d8c29d2f3bddeaaa1, group_id=7609c84b665a40a2b957f750d8fd272e, role_id=575c54955d4a474e9c687a0100991d1d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:27.209051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5e2ad-1351-46eb-991c-9f12e12c5ee1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:27.220020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a423bd5-c877-4b20-81d2-6c472a16c8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:27.220970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a423bd5-c877-4b20-81d2-6c472a16c8fb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:27.221258 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a423bd5-c877-4b20-81d2-6c472a16c8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:27.221521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a423bd5-c877-4b20-81d2-6c472a16c8fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:27.234842 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a423bd5-c877-4b20-81d2-6c472a16c8fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-9a423bd5-c877-4b20-81d2-6c472a16c8fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:27.245508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:27.246494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:27.247564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:27.247564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:27.247564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:27.247564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:27.247564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:27.247564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:27.247564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:27.247564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:27.247564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:27.247564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:27.247564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:27.247564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:27.248935 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 222/415] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:27.248935 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a423bd5-c877-4b20-81d2-6c472a16c8fb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:27.318493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 194/416] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jul 18 10:19:27 2022] PUT /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1/groups/7609c84b665a40a2b957f750d8fd272e/roles/575c54955d4a474e9c687a0100991d1d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:19:27.319740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5e2ad-1351-46eb-991c-9f12e12c5ee1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:27.395095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a423bd5-c877-4b20-81d2-6c472a16c8fb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:27.442303 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ef048-9c3a-4f0c-861c-411bb97e8314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:27.443691 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ef048-9c3a-4f0c-861c-411bb97e8314 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:27.443971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ef048-9c3a-4f0c-861c-411bb97e8314 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:27.444242 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ef048-9c3a-4f0c-861c-411bb97e8314 None admin] PATH_INFO: `/v3/projects/bd97299e4fa148ce8ed40c106d7096bc` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:27.445563 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ef048-9c3a-4f0c-861c-411bb97e8314 None admin] RBAC: Authorizing `identity:get_project(project_id=bd97299e4fa148ce8ed40c106d7096bc)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:27.447163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ef048-9c3a-4f0c-861c-411bb97e8314 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:27.449986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 223/417] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:27 2022] GET /identity/v3/projects/bd97299e4fa148ce8ed40c106d7096bc => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:27.456152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ef048-9c3a-4f0c-861c-411bb97e8314 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:27.489899 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:27.546813 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5e2ad-1351-46eb-991c-9f12e12c5ee1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:27.590413 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee73c9-965e-411f-8eb9-8e257919574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:27.591709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee73c9-965e-411f-8eb9-8e257919574a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:27.591989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee73c9-965e-411f-8eb9-8e257919574a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:27.592287 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee73c9-965e-411f-8eb9-8e257919574a None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:27.593113 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee73c9-965e-411f-8eb9-8e257919574a None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:27.593422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee73c9-965e-411f-8eb9-8e257919574a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:27.594837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee73c9-965e-411f-8eb9-8e257919574a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:27.604310 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 195/418] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:27.605716 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fafeed-882e-40f7-91a7-b8619eda83c2 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:27.606005 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fafeed-882e-40f7-91a7-b8619eda83c2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:27.611638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fafeed-882e-40f7-91a7-b8619eda83c2 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:27.613417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 196/419] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:27.614288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fafeed-882e-40f7-91a7-b8619eda83c2 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:27.636628 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:27.654440 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ef048-9c3a-4f0c-861c-411bb97e8314 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:27.703487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c76d89-d6e1-4dd1-8210-0a4912619c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:27.704618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c76d89-d6e1-4dd1-8210-0a4912619c94 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:27.704897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c76d89-d6e1-4dd1-8210-0a4912619c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:27.705172 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c76d89-d6e1-4dd1-8210-0a4912619c94 None admin] PATH_INFO: `/v3/projects/bd97299e4fa148ce8ed40c106d7096bc/groups/2b83e9b5249b4b6bb3f2f23c8868f790/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:27.708295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c76d89-d6e1-4dd1-8210-0a4912619c94 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd97299e4fa148ce8ed40c106d7096bc, group_id=2b83e9b5249b4b6bb3f2f23c8868f790, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:27.709752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c76d89-d6e1-4dd1-8210-0a4912619c94 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:27.741955 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fafeed-882e-40f7-91a7-b8619eda83c2 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:27.780975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a4005-6ea1-476f-a738-98072368cf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:27.781760 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a4005-6ea1-476f-a738-98072368cf30 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:27.782128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a4005-6ea1-476f-a738-98072368cf30 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:27.782518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a4005-6ea1-476f-a738-98072368cf30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:27.783043 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 224/420] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jul 18 10:19:27 2022] PUT /identity/v3/projects/bd97299e4fa148ce8ed40c106d7096bc/groups/2b83e9b5249b4b6bb3f2f23c8868f790/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:19:27.784678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b724f-c39c-43ac-86ca-c8cc9cf07ffe None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:27.785179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b724f-c39c-43ac-86ca-c8cc9cf07ffe None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:27.785691 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b724f-c39c-43ac-86ca-c8cc9cf07ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:27.807228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-554b724f-c39c-43ac-86ca-c8cc9cf07ffe None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:27.808774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-554b724f-c39c-43ac-86ca-c8cc9cf07ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:27.909696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 225/421] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:27.919899 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a4005-6ea1-476f-a738-98072368cf30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:27.922428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a4005-6ea1-476f-a738-98072368cf30 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:27.945642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b724f-c39c-43ac-86ca-c8cc9cf07ffe None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:27.966718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:27.975696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:28.100223 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b724f-c39c-43ac-86ca-c8cc9cf07ffe None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:28.102756 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 197/422] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:28.111581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a4005-6ea1-476f-a738-98072368cf30 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:28.145548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0a9e9-3962-4194-a666-24b137176718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:28.146539 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0a9e9-3962-4194-a666-24b137176718 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:28.146825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0a9e9-3962-4194-a666-24b137176718 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:28.147104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0a9e9-3962-4194-a666-24b137176718 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:28.160361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0a9e9-3962-4194-a666-24b137176718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-dfa0a9e9-3962-4194-a666-24b137176718 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:28.170150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:28.171179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:28.172018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:28.172018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:28.172018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:28.172018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:28.172018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:28.172018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:28.172018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:28.172018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:28.172018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:28.172018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:28.172018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:28.172018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:28.172018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 226/423] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:19:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:19:28.179274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0a9e9-3962-4194-a666-24b137176718 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:28.254150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a4005-6ea1-476f-a738-98072368cf30 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:28.273895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:28.292641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062c94-1ee5-41d1-8829-89d091d590bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:28.293857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062c94-1ee5-41d1-8829-89d091d590bb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:28.294289 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062c94-1ee5-41d1-8829-89d091d590bb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:28.294727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062c94-1ee5-41d1-8829-89d091d590bb None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:28.296072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de062c94-1ee5-41d1-8829-89d091d590bb None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:28.297709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de062c94-1ee5-41d1-8829-89d091d590bb None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:28.299880 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 198/424] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:28 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:28.305292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062c94-1ee5-41d1-8829-89d091d590bb None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:28.415768 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062c94-1ee5-41d1-8829-89d091d590bb None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:28.416545 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:28.465514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0a9e9-3962-4194-a666-24b137176718 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:28.474799 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbf35c-0d52-49ed-8dbb-44e442989dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:28.475738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbf35c-0d52-49ed-8dbb-44e442989dad None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:28.476076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbf35c-0d52-49ed-8dbb-44e442989dad None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:28.476349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbf35c-0d52-49ed-8dbb-44e442989dad None admin] PATH_INFO: `/v3/groups/7609c84b665a40a2b957f750d8fd272e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:28.477589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbf35c-0d52-49ed-8dbb-44e442989dad None admin] RBAC: Authorizing `identity:get_group(group_id=7609c84b665a40a2b957f750d8fd272e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:28.479088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbf35c-0d52-49ed-8dbb-44e442989dad None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:28.480755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 199/425] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 18 10:19:28 2022] GET /identity/v3/groups/7609c84b665a40a2b957f750d8fd272e => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:28.490684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbf35c-0d52-49ed-8dbb-44e442989dad None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:28.543253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b262b01-537f-49db-a312-5bc67537fd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:28.543971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b262b01-537f-49db-a312-5bc67537fd7b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:28.544255 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b262b01-537f-49db-a312-5bc67537fd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:28.544607 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b262b01-537f-49db-a312-5bc67537fd7b None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:28.548743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b262b01-537f-49db-a312-5bc67537fd7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:28.549066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b262b01-537f-49db-a312-5bc67537fd7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:28.550492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b262b01-537f-49db-a312-5bc67537fd7b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:28.572259 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 227/426] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:28.578023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b262b01-537f-49db-a312-5bc67537fd7b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:28.601929 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:28.677727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbf35c-0d52-49ed-8dbb-44e442989dad None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:28.715931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2ed5a-678b-4910-ac42-08fa7b5c427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:28.716736 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2ed5a-678b-4910-ac42-08fa7b5c427b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:28.717030 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2ed5a-678b-4910-ac42-08fa7b5c427b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:28.717306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2ed5a-678b-4910-ac42-08fa7b5c427b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:28.718150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2ed5a-678b-4910-ac42-08fa7b5c427b None admin] RBAC: Adding query filter params (group.id=7609c84b665a40a2b957f750d8fd272e, role.id=4b6ddd50803f4f9bbf171c5c7cb9af63, scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:28.718516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2ed5a-678b-4910-ac42-08fa7b5c427b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:28.719974 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2ed5a-678b-4910-ac42-08fa7b5c427b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:28.726671 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 200/427] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 18 10:19:28 2022] GET /identity/v3/role_assignments?group.id=7609c84b665a40a2b957f750d8fd272e&scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f&role.id=4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 611 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:28.769755 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b262b01-537f-49db-a312-5bc67537fd7b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:28.842468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5541930-3ce5-4c7f-beb6-84f7032ee698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:28.843495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5541930-3ce5-4c7f-beb6-84f7032ee698 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:28.843943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5541930-3ce5-4c7f-beb6-84f7032ee698 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:28.844391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5541930-3ce5-4c7f-beb6-84f7032ee698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:28.855259 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:28.996628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5541930-3ce5-4c7f-beb6-84f7032ee698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:29.001260 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5541930-3ce5-4c7f-beb6-84f7032ee698 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:29.151064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 228/428] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 10:19:29.157479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2ed5a-678b-4910-ac42-08fa7b5c427b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:29.289224 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2ed5a-678b-4910-ac42-08fa7b5c427b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:29.312429 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22822caf-ad66-4e20-80df-5662854edb94 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:29.312803 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22822caf-ad66-4e20-80df-5662854edb94 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:29.313165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22822caf-ad66-4e20-80df-5662854edb94 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:29.314825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 229/429] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:29.316824 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:29.329373 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae9735-2e31-41f1-b84d-3c7e41d8a6fd None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:29.330991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae9735-2e31-41f1-b84d-3c7e41d8a6fd None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:29.330991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae9735-2e31-41f1-b84d-3c7e41d8a6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:29.342305 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f900b0b-e8b2-4f51-9768-a0a9f346f219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:29.343496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f900b0b-e8b2-4f51-9768-a0a9f346f219 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:29.343790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f900b0b-e8b2-4f51-9768-a0a9f346f219 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:29.344064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f900b0b-e8b2-4f51-9768-a0a9f346f219 None admin] PATH_INFO: `/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:29.348036 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f900b0b-e8b2-4f51-9768-a0a9f346f219 None admin] RBAC: Authorizing `identity:get_project(project_id=b99807a59bdf4c95bc2a8e8af4d5974f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:29.349745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f900b0b-e8b2-4f51-9768-a0a9f346f219 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:29.353355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 201/430] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:29 2022] GET /identity/v3/projects/b99807a59bdf4c95bc2a8e8af4d5974f => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:29.354478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5fae9735-2e31-41f1-b84d-3c7e41d8a6fd None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:29.355857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5fae9735-2e31-41f1-b84d-3c7e41d8a6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:29.359503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f900b0b-e8b2-4f51-9768-a0a9f346f219 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:29.397593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:29.443887 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 230/431] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:29.472403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae9735-2e31-41f1-b84d-3c7e41d8a6fd None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:29.490946 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f900b0b-e8b2-4f51-9768-a0a9f346f219 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:29.534662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801820a-104f-4e78-97aa-e24d2665bffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:29.535526 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801820a-104f-4e78-97aa-e24d2665bffa None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:29.535805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801820a-104f-4e78-97aa-e24d2665bffa None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:29.536076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801820a-104f-4e78-97aa-e24d2665bffa None admin] PATH_INFO: `/v3/groups/7609c84b665a40a2b957f750d8fd272e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:29.537261 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801820a-104f-4e78-97aa-e24d2665bffa None admin] RBAC: Authorizing `identity:get_group(group_id=7609c84b665a40a2b957f750d8fd272e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:29.538728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801820a-104f-4e78-97aa-e24d2665bffa None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:29.540587 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 202/432] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 18 10:19:29 2022] GET /identity/v3/groups/7609c84b665a40a2b957f750d8fd272e => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:29.546892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801820a-104f-4e78-97aa-e24d2665bffa None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:29.609546 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae9735-2e31-41f1-b84d-3c7e41d8a6fd None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:29.615018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:29.650345 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c9a8f-d4c3-4050-93c2-14f0fdc10035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:29.651526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c9a8f-d4c3-4050-93c2-14f0fdc10035 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:29.652002 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c9a8f-d4c3-4050-93c2-14f0fdc10035 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:29.652474 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c9a8f-d4c3-4050-93c2-14f0fdc10035 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:29.666645 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c9a8f-d4c3-4050-93c2-14f0fdc10035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:29.669270 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801820a-104f-4e78-97aa-e24d2665bffa None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-740c9a8f-d4c3-4050-93c2-14f0fdc10035 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:29.676254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:29.677268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:29.678170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:29.678170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:29.678170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:29.678170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:29.678170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:29.678170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:29.678170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:29.678170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:29.678170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:29.678170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:29.678170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:19:29.678170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:29.681167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 231/433] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:29.688172 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c9a8f-d4c3-4050-93c2-14f0fdc10035 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:29.725670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c9957-1928-4211-be3d-4f4789a7c014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:29.726871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c9957-1928-4211-be3d-4f4789a7c014 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:29.727768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:29.727914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c9957-1928-4211-be3d-4f4789a7c014 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:29.728855 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c9957-1928-4211-be3d-4f4789a7c014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:29.730309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c9957-1928-4211-be3d-4f4789a7c014 None admin] RBAC: Adding query filter params (group.id=7609c84b665a40a2b957f750d8fd272e, role.id=575c54955d4a474e9c687a0100991d1d, scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:29.732694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c9957-1928-4211-be3d-4f4789a7c014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:29.734645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c9957-1928-4211-be3d-4f4789a7c014 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:29.744212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 203/434] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 18 10:19:29 2022] GET /identity/v3/role_assignments?group.id=7609c84b665a40a2b957f750d8fd272e&scope.project.id=b99807a59bdf4c95bc2a8e8af4d5974f&role.id=575c54955d4a474e9c687a0100991d1d => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:29.836237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c9a8f-d4c3-4050-93c2-14f0fdc10035 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:29.881399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50f510-e8fa-4a8c-9496-100eb22fe37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:29.882382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50f510-e8fa-4a8c-9496-100eb22fe37e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:29.883076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50f510-e8fa-4a8c-9496-100eb22fe37e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:29.883610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50f510-e8fa-4a8c-9496-100eb22fe37e None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:29.884519 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50f510-e8fa-4a8c-9496-100eb22fe37e None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:29.884982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50f510-e8fa-4a8c-9496-100eb22fe37e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:29.886653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50f510-e8fa-4a8c-9496-100eb22fe37e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:29.898363 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 232/435] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:19:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:29.907712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c9957-1928-4211-be3d-4f4789a7c014 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:30.028670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c9957-1928-4211-be3d-4f4789a7c014 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:30.047824 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:30.066426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1a658-d92a-44ae-92ef-710b58046cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:30.067326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1a658-d92a-44ae-92ef-710b58046cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:30.067783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1a658-d92a-44ae-92ef-710b58046cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:30.068216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1a658-d92a-44ae-92ef-710b58046cc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:30.145553 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1a658-d92a-44ae-92ef-710b58046cc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:30.147299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1a658-d92a-44ae-92ef-710b58046cc0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:30.155116 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa01df-8af9-4465-af91-81b41dbe6ab0 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:30.155635 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa01df-8af9-4465-af91-81b41dbe6ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:30.155722 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa01df-8af9-4465-af91-81b41dbe6ab0 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:30.157040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 233/436] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:30.162911 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fde49-9cea-48e0-9568-39ee59ec094b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:30.163199 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fde49-9cea-48e0-9568-39ee59ec094b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:30.163475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fde49-9cea-48e0-9568-39ee59ec094b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:30.189631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c99fde49-9cea-48e0-9568-39ee59ec094b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:30.190848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c99fde49-9cea-48e0-9568-39ee59ec094b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:30.267829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 204/437] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:30.269847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901e4d7-227a-4739-840d-c9123df2b19b None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:30.270040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 234/438] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:19:30.270153 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901e4d7-227a-4739-840d-c9123df2b19b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:30.270528 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901e4d7-227a-4739-840d-c9123df2b19b None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:30.271860 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 205/439] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:30.273371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fde49-9cea-48e0-9568-39ee59ec094b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:30.277060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e7ac1-ab70-42dd-8564-961f5ccd5f8f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:30.277344 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e7ac1-ab70-42dd-8564-961f5ccd5f8f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:30.277621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e7ac1-ab70-42dd-8564-961f5ccd5f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:30.295866 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:30.297754 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a29e7ac1-ab70-42dd-8564-961f5ccd5f8f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:30.298982 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a29e7ac1-ab70-42dd-8564-961f5ccd5f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:30.313282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:30.366040 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 206/440] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:19:30.366937 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e7ac1-ab70-42dd-8564-961f5ccd5f8f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:30.391179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fde49-9cea-48e0-9568-39ee59ec094b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:30.428261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022b7fb-f3f2-42cc-afcb-c403af32d957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:30.429034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022b7fb-f3f2-42cc-afcb-c403af32d957 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:30.429311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022b7fb-f3f2-42cc-afcb-c403af32d957 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:30.429579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022b7fb-f3f2-42cc-afcb-c403af32d957 None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:30.430796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022b7fb-f3f2-42cc-afcb-c403af32d957 None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:30.432250 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022b7fb-f3f2-42cc-afcb-c403af32d957 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:30.434095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 235/441] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:30 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:30.434095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022b7fb-f3f2-42cc-afcb-c403af32d957 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:30.483583 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e7ac1-ab70-42dd-8564-961f5ccd5f8f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:30.520120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30311694-1414-47ed-aa08-ccefb36292c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:30.521235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30311694-1414-47ed-aa08-ccefb36292c1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:30.521592 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30311694-1414-47ed-aa08-ccefb36292c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:30.522093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30311694-1414-47ed-aa08-ccefb36292c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:30.533473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30311694-1414-47ed-aa08-ccefb36292c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:30.534276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-30311694-1414-47ed-aa08-ccefb36292c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:30.541719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:30.542869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:30.546010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:30.546010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:30.546010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:30.546010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:30.546010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:30.546010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:30.546010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:30.546010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:30.546010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:30.546010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:30.546010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:30.546010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:30.546010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 207/442] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:19:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:30.546010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30311694-1414-47ed-aa08-ccefb36292c1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:30.552479 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022b7fb-f3f2-42cc-afcb-c403af32d957 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:30.559057 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:30.587661 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab8387-8d50-492e-b257-2a2bb09163bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:30.588444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8387-8d50-492e-b257-2a2bb09163bd None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:30.588722 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8387-8d50-492e-b257-2a2bb09163bd None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:30.589040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8387-8d50-492e-b257-2a2bb09163bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:30.599704 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab8387-8d50-492e-b257-2a2bb09163bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-5dab8387-8d50-492e-b257-2a2bb09163bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:30.607930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:30.608969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:30.609865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:30.609865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:30.609865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:30.609865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:30.609865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:30.609865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:30.609865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:30.609865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:30.609865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:30.609865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:30.609865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:19:30.609865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:30.609865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 236/443] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:19:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:30.610602 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab8387-8d50-492e-b257-2a2bb09163bd None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:30.651715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30311694-1414-47ed-aa08-ccefb36292c1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:30.687522 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2658b8-d276-46ca-b9fc-a11797559a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:30.688285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2658b8-d276-46ca-b9fc-a11797559a82 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:30.688570 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2658b8-d276-46ca-b9fc-a11797559a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:30.688861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2658b8-d276-46ca-b9fc-a11797559a82 None admin] PATH_INFO: `/v3/groups/7609c84b665a40a2b957f750d8fd272e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:30.690051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2658b8-d276-46ca-b9fc-a11797559a82 None admin] RBAC: Authorizing `identity:get_group(group_id=7609c84b665a40a2b957f750d8fd272e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:30.691531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2658b8-d276-46ca-b9fc-a11797559a82 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:30.693164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 208/444] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 18 10:19:30 2022] GET /identity/v3/groups/7609c84b665a40a2b957f750d8fd272e => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:30.693932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2658b8-d276-46ca-b9fc-a11797559a82 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:30.719893 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab8387-8d50-492e-b257-2a2bb09163bd None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:30.760141 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5501843-04a4-431e-b15d-eae2134aca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:30.760808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5501843-04a4-431e-b15d-eae2134aca59 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:30.761092 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5501843-04a4-431e-b15d-eae2134aca59 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:30.761373 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5501843-04a4-431e-b15d-eae2134aca59 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:30.762119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5501843-04a4-431e-b15d-eae2134aca59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:30.763073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5501843-04a4-431e-b15d-eae2134aca59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:30.764453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5501843-04a4-431e-b15d-eae2134aca59 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:30.773120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 237/445] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:30.773840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:30.774020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5501843-04a4-431e-b15d-eae2134aca59 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:30.785249 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:30.800826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2658b8-d276-46ca-b9fc-a11797559a82 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:30.836350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929be8a7-e6fd-49e4-a3ca-69780699458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:30.837019 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929be8a7-e6fd-49e4-a3ca-69780699458c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:30.837296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929be8a7-e6fd-49e4-a3ca-69780699458c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:30.837573 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929be8a7-e6fd-49e4-a3ca-69780699458c None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:30.838311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929be8a7-e6fd-49e4-a3ca-69780699458c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:30.838641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929be8a7-e6fd-49e4-a3ca-69780699458c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:30.840003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929be8a7-e6fd-49e4-a3ca-69780699458c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:30.848351 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 209/446] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:30.849158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929be8a7-e6fd-49e4-a3ca-69780699458c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:30.882435 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5501843-04a4-431e-b15d-eae2134aca59 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:30.917165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a98a6-8ce2-40e9-bbf1-2d729f9afe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:30.917811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a98a6-8ce2-40e9-bbf1-2d729f9afe73 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:30.918089 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a98a6-8ce2-40e9-bbf1-2d729f9afe73 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:30.918381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a98a6-8ce2-40e9-bbf1-2d729f9afe73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:30.919722 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a98a6-8ce2-40e9-bbf1-2d729f9afe73 None admin] RBAC: Adding query filter params (group.id=7609c84b665a40a2b957f750d8fd272e, role.id=4b6ddd50803f4f9bbf171c5c7cb9af63, scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:30.920031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a98a6-8ce2-40e9-bbf1-2d729f9afe73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:30.921459 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a98a6-8ce2-40e9-bbf1-2d729f9afe73 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:30.927669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 238/447] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 18 10:19:30 2022] GET /identity/v3/role_assignments?group.id=7609c84b665a40a2b957f750d8fd272e&scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1&role.id=4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:30.928470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a98a6-8ce2-40e9-bbf1-2d729f9afe73 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:30.969592 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929be8a7-e6fd-49e4-a3ca-69780699458c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:31.010424 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a552e-8bac-4b51-a105-091eff5dec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:31.011091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a552e-8bac-4b51-a105-091eff5dec94 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:31.011376 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a552e-8bac-4b51-a105-091eff5dec94 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:31.011654 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a552e-8bac-4b51-a105-091eff5dec94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:31.022668 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:31.030021 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:31.069951 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a98a6-8ce2-40e9-bbf1-2d729f9afe73 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:31.109152 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a552e-8bac-4b51-a105-091eff5dec94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:31.112380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a552e-8bac-4b51-a105-091eff5dec94 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:31.114167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9093e1-5a35-4467-8b34-0e767a060f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:31.114860 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9093e1-5a35-4467-8b34-0e767a060f99 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:31.115144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9093e1-5a35-4467-8b34-0e767a060f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:31.115420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9093e1-5a35-4467-8b34-0e767a060f99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:31.212549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9093e1-5a35-4467-8b34-0e767a060f99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:31.213958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9093e1-5a35-4467-8b34-0e767a060f99 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:31.243563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 210/448] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:31.244800 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a552e-8bac-4b51-a105-091eff5dec94 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:31.292063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:31.312994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:31.347921 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 239/449] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:31.353550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9093e1-5a35-4467-8b34-0e767a060f99 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:31.362182 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a552e-8bac-4b51-a105-091eff5dec94 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:31.398628 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8e335-f1e5-4b50-b361-dd611ecdd4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:31.401680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8e335-f1e5-4b50-b361-dd611ecdd4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:31.401680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8e335-f1e5-4b50-b361-dd611ecdd4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:31.401680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8e335-f1e5-4b50-b361-dd611ecdd4c3 None admin] PATH_INFO: `/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:31.401680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8e335-f1e5-4b50-b361-dd611ecdd4c3 None admin] RBAC: Authorizing `identity:get_project(project_id=9f94f6141c04458d8c29d2f3bddeaaa1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:31.402944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8e335-f1e5-4b50-b361-dd611ecdd4c3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:31.404638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 211/450] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:31 2022] GET /identity/v3/projects/9f94f6141c04458d8c29d2f3bddeaaa1 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:31.411297 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8e335-f1e5-4b50-b361-dd611ecdd4c3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:31.469125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9093e1-5a35-4467-8b34-0e767a060f99 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:31.505594 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c40561-adbd-4ff5-b8aa-4d195cf11800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:31.506693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c40561-adbd-4ff5-b8aa-4d195cf11800 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:31.507089 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c40561-adbd-4ff5-b8aa-4d195cf11800 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:31.507477 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c40561-adbd-4ff5-b8aa-4d195cf11800 None admin] PATH_INFO: `/v3/projects/bd97299e4fa148ce8ed40c106d7096bc` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:31.509070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c40561-adbd-4ff5-b8aa-4d195cf11800 None admin] RBAC: Authorizing `identity:get_project(project_id=bd97299e4fa148ce8ed40c106d7096bc)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:31.510742 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c40561-adbd-4ff5-b8aa-4d195cf11800 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:31.513214 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 240/451] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:19:31 2022] GET /identity/v3/projects/bd97299e4fa148ce8ed40c106d7096bc => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:31.518924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c40561-adbd-4ff5-b8aa-4d195cf11800 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:31.522921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8e335-f1e5-4b50-b361-dd611ecdd4c3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:31.531964 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:31.561967 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcccade-4f89-4c6e-aad0-571f16d4f59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:31.562860 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcccade-4f89-4c6e-aad0-571f16d4f59a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:31.563142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcccade-4f89-4c6e-aad0-571f16d4f59a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:31.563423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcccade-4f89-4c6e-aad0-571f16d4f59a None admin] PATH_INFO: `/v3/groups/7609c84b665a40a2b957f750d8fd272e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:31.564619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcccade-4f89-4c6e-aad0-571f16d4f59a None admin] RBAC: Authorizing `identity:get_group(group_id=7609c84b665a40a2b957f750d8fd272e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:31.565483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:31.566065 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcccade-4f89-4c6e-aad0-571f16d4f59a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:31.567729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 212/452] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 18 10:19:31 2022] GET /identity/v3/groups/7609c84b665a40a2b957f750d8fd272e => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:31.573874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcccade-4f89-4c6e-aad0-571f16d4f59a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:31.630589 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c40561-adbd-4ff5-b8aa-4d195cf11800 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:31.669116 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388f4fe-ef70-4497-9d44-46349ff6051e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:31.669958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388f4fe-ef70-4497-9d44-46349ff6051e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:31.670235 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388f4fe-ef70-4497-9d44-46349ff6051e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:31.670527 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388f4fe-ef70-4497-9d44-46349ff6051e None admin] PATH_INFO: `/v3/groups/2b83e9b5249b4b6bb3f2f23c8868f790` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:31.671685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388f4fe-ef70-4497-9d44-46349ff6051e None admin] RBAC: Authorizing `identity:get_group(group_id=2b83e9b5249b4b6bb3f2f23c8868f790)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:31.673120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388f4fe-ef70-4497-9d44-46349ff6051e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:31.674920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 241/453] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 18 10:19:31 2022] GET /identity/v3/groups/2b83e9b5249b4b6bb3f2f23c8868f790 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:31.678549 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcccade-4f89-4c6e-aad0-571f16d4f59a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:31.680712 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388f4fe-ef70-4497-9d44-46349ff6051e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:31.713928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff06b6b-8d57-4238-928d-1794a3ff165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:31.714640 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff06b6b-8d57-4238-928d-1794a3ff165d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:31.714922 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff06b6b-8d57-4238-928d-1794a3ff165d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:31.715203 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff06b6b-8d57-4238-928d-1794a3ff165d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:31.716114 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff06b6b-8d57-4238-928d-1794a3ff165d None admin] RBAC: Adding query filter params (group.id=7609c84b665a40a2b957f750d8fd272e, role.id=575c54955d4a474e9c687a0100991d1d, scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:31.716421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff06b6b-8d57-4238-928d-1794a3ff165d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:31.717865 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff06b6b-8d57-4238-928d-1794a3ff165d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:31.724144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 213/454] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 18 10:19:31 2022] GET /identity/v3/role_assignments?group.id=7609c84b665a40a2b957f750d8fd272e&scope.project.id=9f94f6141c04458d8c29d2f3bddeaaa1&role.id=575c54955d4a474e9c687a0100991d1d => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:31.789958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388f4fe-ef70-4497-9d44-46349ff6051e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:31.802559 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:31.832099 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a20b3-1b05-4816-8146-a0466651ace2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:31.832844 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a20b3-1b05-4816-8146-a0466651ace2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:31.833115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a20b3-1b05-4816-8146-a0466651ace2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:31.833396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a20b3-1b05-4816-8146-a0466651ace2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:31.834249 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a20b3-1b05-4816-8146-a0466651ace2 None admin] RBAC: Adding query filter params (group.id=2b83e9b5249b4b6bb3f2f23c8868f790, role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=bd97299e4fa148ce8ed40c106d7096bc) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:31.834608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a20b3-1b05-4816-8146-a0466651ace2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:31.836111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a20b3-1b05-4816-8146-a0466651ace2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:31.843204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 242/455] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 18 10:19:31 2022] GET /identity/v3/role_assignments?group.id=2b83e9b5249b4b6bb3f2f23c8868f790&scope.project.id=bd97299e4fa148ce8ed40c106d7096bc&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:34.646135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f5e56-e5ab-4016-9826-b2165619712d None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:34.646679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f5e56-e5ab-4016-9826-b2165619712d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:34.646791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f5e56-e5ab-4016-9826-b2165619712d None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:34.648353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 214/456] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:34.655429 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc24788-1640-49b2-859d-b911f4b1d494 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:34.655908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc24788-1640-49b2-859d-b911f4b1d494 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:34.656061 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc24788-1640-49b2-859d-b911f4b1d494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:34.682629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7dc24788-1640-49b2-859d-b911f4b1d494 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:34.684362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7dc24788-1640-49b2-859d-b911f4b1d494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:34.785312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 243/457] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:34.827119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f5e56-e5ab-4016-9826-b2165619712d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:34.885788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:34.987065 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f5e56-e5ab-4016-9826-b2165619712d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:35.045727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0b204-495a-45d4-a262-bd536adf7bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:35.046553 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0b204-495a-45d4-a262-bd536adf7bba None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:35.046835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0b204-495a-45d4-a262-bd536adf7bba None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:35.047106 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0b204-495a-45d4-a262-bd536adf7bba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:35.066536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0b204-495a-45d4-a262-bd536adf7bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:35.068017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0b204-495a-45d4-a262-bd536adf7bba None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:35.094559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-4ce0b204-495a-45d4-a262-bd536adf7bba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:35.094559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:35.094559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:35.094559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:35.094559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:35.094559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:35.094559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:35.094559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:35.094559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:35.094559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:35.094559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:35.094559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:35.094559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:35.094559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:35.094559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:35.095498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:35.096414 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:35.096414 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:35.096414 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:35.096414 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:35.102433 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 215/458] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:35.108193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc24788-1640-49b2-859d-b911f4b1d494 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:35.273862 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc24788-1640-49b2-859d-b911f4b1d494 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:35.286879 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:35.338049 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddff9c-2891-4ef5-b853-cf1ae4b788c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:35.338803 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddff9c-2891-4ef5-b853-cf1ae4b788c6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:35.339087 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddff9c-2891-4ef5-b853-cf1ae4b788c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:35.339357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddff9c-2891-4ef5-b853-cf1ae4b788c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:35.340087 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddff9c-2891-4ef5-b853-cf1ae4b788c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:35.341084 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddff9c-2891-4ef5-b853-cf1ae4b788c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:35.342938 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddff9c-2891-4ef5-b853-cf1ae4b788c6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:35.362553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 244/459] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:35.368286 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0b204-495a-45d4-a262-bd536adf7bba None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:35.393980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fd0d6-cb82-4539-9fb5-f006e99057c0 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:35.394296 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fd0d6-cb82-4539-9fb5-f006e99057c0 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:35.394573 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fd0d6-cb82-4539-9fb5-f006e99057c0 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:35.396205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 245/460] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:35.401758 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa6672-10c2-4436-a1aa-54aa596235cc None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:35.402048 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa6672-10c2-4436-a1aa-54aa596235cc None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:35.402349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa6672-10c2-4436-a1aa-54aa596235cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:35.435834 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-26aa6672-10c2-4436-a1aa-54aa596235cc None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:35.437036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-26aa6672-10c2-4436-a1aa-54aa596235cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:35.548269 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:35.562231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 246/461] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:19:35.563589 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80f9e9-5395-48c8-bc12-6dc801f7f1e7 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:35.563876 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80f9e9-5395-48c8-bc12-6dc801f7f1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:35.564169 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80f9e9-5395-48c8-bc12-6dc801f7f1e7 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:35.570366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 247/462] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:35.574051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0b204-495a-45d4-a262-bd536adf7bba None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:35.577383 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4fa4f-0c66-4c95-8925-29ffbee07971 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:35.577701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4fa4f-0c66-4c95-8925-29ffbee07971 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:35.577905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4fa4f-0c66-4c95-8925-29ffbee07971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:35.611468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e6f4fa4f-0c66-4c95-8925-29ffbee07971 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:35.614019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e6f4fa4f-0c66-4c95-8925-29ffbee07971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:35.626711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b515aca-2dc2-4a36-8ed8-5ea260176419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:35.627481 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b515aca-2dc2-4a36-8ed8-5ea260176419 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:35.627840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b515aca-2dc2-4a36-8ed8-5ea260176419 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:35.628122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b515aca-2dc2-4a36-8ed8-5ea260176419 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:35.628969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b515aca-2dc2-4a36-8ed8-5ea260176419 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:35.630609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b515aca-2dc2-4a36-8ed8-5ea260176419 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:35.702188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 248/463] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:35.710930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4fa4f-0c66-4c95-8925-29ffbee07971 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:35.729277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:35.751152 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 216/464] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:19:35 2022] POST /identity/v3/users => generated 246 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:19:35.752550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455ed77-f107-4d5f-b2e5-3199b6efc0aa None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:35.752838 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455ed77-f107-4d5f-b2e5-3199b6efc0aa None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:35.753170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455ed77-f107-4d5f-b2e5-3199b6efc0aa None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:35.754585 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 217/465] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:35.755345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455ed77-f107-4d5f-b2e5-3199b6efc0aa None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:35.890726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4fa4f-0c66-4c95-8925-29ffbee07971 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:35.960592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22c359-4bde-41b1-8c36-8ad7cb4864a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:35.961446 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22c359-4bde-41b1-8c36-8ad7cb4864a4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:35.961728 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22c359-4bde-41b1-8c36-8ad7cb4864a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:35.962293 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22c359-4bde-41b1-8c36-8ad7cb4864a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:35.976379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22c359-4bde-41b1-8c36-8ad7cb4864a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:35.976618 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455ed77-f107-4d5f-b2e5-3199b6efc0aa None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:35.977932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22c359-4bde-41b1-8c36-8ad7cb4864a4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:36.000591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-cf22c359-4bde-41b1-8c36-8ad7cb4864a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:36.000591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:36.000591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:36.000591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:36.000591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:36.000591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:36.000591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:36.000591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:36.000591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:36.000591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:36.000591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:36.000591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:36.000591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:36.000591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:36.000591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:36.002212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:36.004397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:36.004397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:36.004397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:36.004397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:36.004397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 249/466] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:36.004397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03a3f3-521c-44a4-a623-11aebd67ac08 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:36.004397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03a3f3-521c-44a4-a623-11aebd67ac08 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:36.004397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03a3f3-521c-44a4-a623-11aebd67ac08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:36.028703 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6d03a3f3-521c-44a4-a623-11aebd67ac08 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:36.030266 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6d03a3f3-521c-44a4-a623-11aebd67ac08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:36.038231 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d95135-4c38-4441-a991-d6c69a88d452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:36.039144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d95135-4c38-4441-a991-d6c69a88d452 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:36.039426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d95135-4c38-4441-a991-d6c69a88d452 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:36.039704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d95135-4c38-4441-a991-d6c69a88d452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:36.055664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d95135-4c38-4441-a991-d6c69a88d452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:36.058846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d95135-4c38-4441-a991-d6c69a88d452 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:36.070455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:36.101607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-87d95135-4c38-4441-a991-d6c69a88d452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:36.101607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:36.101607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:36.101607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:36.101607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:36.101607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:36.101607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:36.101607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:36.101607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:36.101607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:36.101607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:36.101607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:36.101607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:36.101607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:36.101607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:36.103385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:36.105036 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:36.105036 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:36.105036 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:36.105036 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:36.108733 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 218/467] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:36.109358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d95135-4c38-4441-a991-d6c69a88d452 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:36.144264 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 250/468] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:36.144264 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03a3f3-521c-44a4-a623-11aebd67ac08 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:36.147445 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:36.297745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d95135-4c38-4441-a991-d6c69a88d452 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:36.305570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03a3f3-521c-44a4-a623-11aebd67ac08 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:36.352483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78510bf7-13e4-49aa-a51e-65811daca0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:36.353472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78510bf7-13e4-49aa-a51e-65811daca0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:36.353937 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78510bf7-13e4-49aa-a51e-65811daca0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:36.354502 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78510bf7-13e4-49aa-a51e-65811daca0c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:36.355360 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78510bf7-13e4-49aa-a51e-65811daca0c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:36.355864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78510bf7-13e4-49aa-a51e-65811daca0c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:36.358250 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78510bf7-13e4-49aa-a51e-65811daca0c3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:36.361499 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9954fc-06b9-4e57-be9c-98a2e99eef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:36.362491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9954fc-06b9-4e57-be9c-98a2e99eef92 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:36.362940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9954fc-06b9-4e57-be9c-98a2e99eef92 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:36.363403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9954fc-06b9-4e57-be9c-98a2e99eef92 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:36.364637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9954fc-06b9-4e57-be9c-98a2e99eef92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:36.365165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9954fc-06b9-4e57-be9c-98a2e99eef92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:36.367589 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9954fc-06b9-4e57-be9c-98a2e99eef92 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:36.380296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 219/469] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:36.381946 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78510bf7-13e4-49aa-a51e-65811daca0c3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:36.391240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 251/470] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:36.392671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4cd87-9eaf-4206-99a3-92da1b2e637c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:36.393020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4cd87-9eaf-4206-99a3-92da1b2e637c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:36.393353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4cd87-9eaf-4206-99a3-92da1b2e637c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:36.395008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 252/471] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:36.399790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4cd87-9eaf-4206-99a3-92da1b2e637c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:36.469664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:36.484952 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:36.531697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78510bf7-13e4-49aa-a51e-65811daca0c3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:36.541854 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4cd87-9eaf-4206-99a3-92da1b2e637c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:36.573115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304361d7-96f4-498f-8537-314b8af04355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:36.574039 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304361d7-96f4-498f-8537-314b8af04355 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:36.574337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304361d7-96f4-498f-8537-314b8af04355 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:36.574622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304361d7-96f4-498f-8537-314b8af04355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:36.586389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304361d7-96f4-498f-8537-314b8af04355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:36.587133 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614b0aa-50c8-4ba8-9cc8-2891aa85abf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:36.587889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304361d7-96f4-498f-8537-314b8af04355 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:36.588056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614b0aa-50c8-4ba8-9cc8-2891aa85abf3 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:36.588421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614b0aa-50c8-4ba8-9cc8-2891aa85abf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:36.588864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614b0aa-50c8-4ba8-9cc8-2891aa85abf3 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:36.589738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614b0aa-50c8-4ba8-9cc8-2891aa85abf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:36.592067 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614b0aa-50c8-4ba8-9cc8-2891aa85abf3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:36.607552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-304361d7-96f4-498f-8537-314b8af04355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:36.607552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:36.607552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:36.607552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:36.607552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:36.607552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:36.607552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:36.607552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:36.607552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:36.607552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:36.607552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:36.607552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:36.607552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:36.607552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:36.607552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:36.609144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:36.611343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:36.611343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:36.611343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:36.611343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:36.611343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 220/472] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:36.611343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81d0a6-148e-4073-9440-f95fe872cea0 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:36.611343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81d0a6-148e-4073-9440-f95fe872cea0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:36.611343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81d0a6-148e-4073-9440-f95fe872cea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:36.629497 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1b81d0a6-148e-4073-9440-f95fe872cea0 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:36.631024 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1b81d0a6-148e-4073-9440-f95fe872cea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:36.676991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 253/473] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:19:36 2022] POST /identity/v3/users => generated 248 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:19:36.677708 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614b0aa-50c8-4ba8-9cc8-2891aa85abf3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:36.743045 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 221/474] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:36.745196 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81d0a6-148e-4073-9440-f95fe872cea0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:36.843036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614b0aa-50c8-4ba8-9cc8-2891aa85abf3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:36.844325 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:36.885369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:36.909653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5407cb-08df-4a26-b837-6597abecf194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:36.910368 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5407cb-08df-4a26-b837-6597abecf194 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:36.910662 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5407cb-08df-4a26-b837-6597abecf194 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:36.910943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5407cb-08df-4a26-b837-6597abecf194 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:36.911697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5407cb-08df-4a26-b837-6597abecf194 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:36.913264 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5407cb-08df-4a26-b837-6597abecf194 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:36.960913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81d0a6-148e-4073-9440-f95fe872cea0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:37.001615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a40fa6-4bfc-405a-bd53-aab6a341e7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:37.002284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a40fa6-4bfc-405a-bd53-aab6a341e7ad None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:37.002591 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a40fa6-4bfc-405a-bd53-aab6a341e7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:37.002920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a40fa6-4bfc-405a-bd53-aab6a341e7ad None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:37.003663 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a40fa6-4bfc-405a-bd53-aab6a341e7ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:37.003965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a40fa6-4bfc-405a-bd53-aab6a341e7ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:37.005358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a40fa6-4bfc-405a-bd53-aab6a341e7ad None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:37.018829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 222/475] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:37.019674 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a40fa6-4bfc-405a-bd53-aab6a341e7ad None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:37.031465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 254/476] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:19:36 2022] POST /identity/v3/users => generated 248 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:19:37.032377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5407cb-08df-4a26-b837-6597abecf194 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:37.289006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5407cb-08df-4a26-b837-6597abecf194 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:37.289918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:37.296899 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a40fa6-4bfc-405a-bd53-aab6a341e7ad None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:37.366386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb89c5-891c-46c7-8168-a8d588f5cb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:37.367762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb89c5-891c-46c7-8168-a8d588f5cb91 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:37.368489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb89c5-891c-46c7-8168-a8d588f5cb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:37.368982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb89c5-891c-46c7-8168-a8d588f5cb91 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:37.370455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb89c5-891c-46c7-8168-a8d588f5cb91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:37.371235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a05ce-b6cd-47b6-93ac-f8bea88d2933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:37.373184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a05ce-b6cd-47b6-93ac-f8bea88d2933 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:37.373513 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a05ce-b6cd-47b6-93ac-f8bea88d2933 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:37.373811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb89c5-891c-46c7-8168-a8d588f5cb91 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:37.374058 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a05ce-b6cd-47b6-93ac-f8bea88d2933 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:37.375391 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a05ce-b6cd-47b6-93ac-f8bea88d2933 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:37.377853 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a05ce-b6cd-47b6-93ac-f8bea88d2933 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:37.420373 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.sql.core [None req-df1a05ce-b6cd-47b6-93ac-f8bea88d2933 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 10:19:37.420373 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 10:19:37.420373 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [parameters: {'id': 'dcee771020ae465e9e7ff9fb041892c0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 10:19:37.420373 dv-cinder-849498-1-smb devstack@keystone.service[80336]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80336) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 10:19:37.440356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-df1a05ce-b6cd-47b6-93ac-f8bea88d2933 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 10:19:37.440356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:37.440356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 10:19:37.440356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 10:19:37.440356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 10:19:37.440356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 10:19:37.440356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 10:19:37.440356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 10:19:37.440356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 10:19:37.440356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application conn.query(q) Jul 18 10:19:37.440356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 10:19:37.440356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 10:19:37.440356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 10:19:37.440356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result.read() Jul 18 10:19:37.440356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return ref.to_dict() Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 10:19:37.442016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application next(self.gen) Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application yield resource Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application next(self.gen) Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise self.value Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application session.commit() Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 10:19:37.451405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.session.flush() Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application compat.raise_( Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 10:19:37.453386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 10:19:37.455510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application conn.query(q) Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result.read() Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 10:19:37.460328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [parameters: {'id': 'dcee771020ae465e9e7ff9fb041892c0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:37.463765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 10:19:37.464552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:37.465462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 223/477] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jul 18 10:19:37 2022] POST /identity/v3/roles => generated 144 bytes in 422 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:37.465462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a05ce-b6cd-47b6-93ac-f8bea88d2933 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:37.472126 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 255/478] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:19:37 2022] POST /identity/v3/users => generated 249 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:19:37.680375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a05ce-b6cd-47b6-93ac-f8bea88d2933 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:37.745111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca0a98-495a-4edf-bfb7-2728db4baa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:37.746494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca0a98-495a-4edf-bfb7-2728db4baa51 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:37.747561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca0a98-495a-4edf-bfb7-2728db4baa51 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:37.748061 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca0a98-495a-4edf-bfb7-2728db4baa51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:37.767840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca0a98-495a-4edf-bfb7-2728db4baa51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-c9ca0a98-495a-4edf-bfb7-2728db4baa51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:37.784492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:37.785632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:37.786546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:37.786546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:37.786546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:37.786546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:37.786546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:37.786546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:37.786546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:37.786546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:37.786546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:37.786546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:37.786546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:19:37.786546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:37.787619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 224/479] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:19:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:19:37.794649 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb89c5-891c-46c7-8168-a8d588f5cb91 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:37.851999 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:37.978537 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb89c5-891c-46c7-8168-a8d588f5cb91 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:38.025358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd36411-c54f-43f7-a96f-6d2bb4508273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:38.026031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd36411-c54f-43f7-a96f-6d2bb4508273 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:38.026308 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd36411-c54f-43f7-a96f-6d2bb4508273 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:38.026745 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd36411-c54f-43f7-a96f-6d2bb4508273 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:38.027558 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd36411-c54f-43f7-a96f-6d2bb4508273 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:38.028335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd36411-c54f-43f7-a96f-6d2bb4508273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:38.030458 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd36411-c54f-43f7-a96f-6d2bb4508273 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:38.040548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 256/480] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:38.126912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229758c-1e30-4dd3-af94-c72517566d01 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:38.127768 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229758c-1e30-4dd3-af94-c72517566d01 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:38.128150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229758c-1e30-4dd3-af94-c72517566d01 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:38.130934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 225/481] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:38.137914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d6ee5-c741-43aa-a225-9b90ab86e493 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:38.138285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d6ee5-c741-43aa-a225-9b90ab86e493 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:38.138805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d6ee5-c741-43aa-a225-9b90ab86e493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:38.163947 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-333d6ee5-c741-43aa-a225-9b90ab86e493 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:38.165125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-333d6ee5-c741-43aa-a225-9b90ab86e493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:38.314247 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 257/482] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:38.338486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229758c-1e30-4dd3-af94-c72517566d01 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:38.392957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:38.581131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229758c-1e30-4dd3-af94-c72517566d01 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:38.666096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5362df-d6f5-456a-a068-9a596f9d3210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:38.667786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5362df-d6f5-456a-a068-9a596f9d3210 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:38.668995 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5362df-d6f5-456a-a068-9a596f9d3210 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:38.670632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5362df-d6f5-456a-a068-9a596f9d3210 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:38.698724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5362df-d6f5-456a-a068-9a596f9d3210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-9b5362df-d6f5-456a-a068-9a596f9d3210 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:38.720349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:38.722345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:38.724169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:38.724169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:38.724169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:38.724169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:38.724169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:38.724169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:38.724169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:38.724169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:38.724169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:38.724169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:38.724169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:38.724169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:38.728305 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 226/483] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:38.734381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d6ee5-c741-43aa-a225-9b90ab86e493 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:38.782906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:38.904221 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d6ee5-c741-43aa-a225-9b90ab86e493 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:38.967347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857401c-61d4-4764-bb51-c5cf92b5643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:38.968049 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857401c-61d4-4764-bb51-c5cf92b5643b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:38.968319 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857401c-61d4-4764-bb51-c5cf92b5643b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:38.968592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857401c-61d4-4764-bb51-c5cf92b5643b None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:38.969350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857401c-61d4-4764-bb51-c5cf92b5643b None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:38.969652 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857401c-61d4-4764-bb51-c5cf92b5643b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:38.971194 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857401c-61d4-4764-bb51-c5cf92b5643b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:38.980699 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 258/484] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:19:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:38.987017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5362df-d6f5-456a-a068-9a596f9d3210 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:39.147366 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:39.175437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5362df-d6f5-456a-a068-9a596f9d3210 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:39.219592 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a3176-21d3-4318-9af4-5960ac371461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:39.220776 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a3176-21d3-4318-9af4-5960ac371461 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:39.221273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a3176-21d3-4318-9af4-5960ac371461 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:39.221742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a3176-21d3-4318-9af4-5960ac371461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:39.242648 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a3176-21d3-4318-9af4-5960ac371461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:39.244506 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a3176-21d3-4318-9af4-5960ac371461 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:39.266003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-5b6a3176-21d3-4318-9af4-5960ac371461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:39.266003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:39.266003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:39.266003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:39.266003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:39.266003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:39.266003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:39.266003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:39.266003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:39.266003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:39.266003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:39.266003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:39.266003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:39.266003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:39.266003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:39.266910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:39.267766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:39.267766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:39.267766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:39.267766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:39.269951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 227/485] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:39.278798 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857401c-61d4-4764-bb51-c5cf92b5643b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:39.438696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:39.461443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857401c-61d4-4764-bb51-c5cf92b5643b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:39.509119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922ce5a-7a2a-4625-a597-4c4add171adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:39.509792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922ce5a-7a2a-4625-a597-4c4add171adb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:39.510072 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922ce5a-7a2a-4625-a597-4c4add171adb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:39.510359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922ce5a-7a2a-4625-a597-4c4add171adb None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:39.511085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922ce5a-7a2a-4625-a597-4c4add171adb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:39.511386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922ce5a-7a2a-4625-a597-4c4add171adb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:39.513017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922ce5a-7a2a-4625-a597-4c4add171adb None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:39.525951 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 259/486] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:39.535545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a3176-21d3-4318-9af4-5960ac371461 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:39.688635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a3176-21d3-4318-9af4-5960ac371461 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:39.739219 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f2b69-c88f-4fcb-899e-7b07394eb4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:39.740018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f2b69-c88f-4fcb-899e-7b07394eb4ac None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:39.740302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f2b69-c88f-4fcb-899e-7b07394eb4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:39.740579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f2b69-c88f-4fcb-899e-7b07394eb4ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:39.748498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:39.764021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f2b69-c88f-4fcb-899e-7b07394eb4ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:39.765501 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f2b69-c88f-4fcb-899e-7b07394eb4ac None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-899f2b69-c88f-4fcb-899e-7b07394eb4ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:19:39.783658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:39.784606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:39.785514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:39.785514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:39.785514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:19:39.785514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:19:39.785514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:19:39.785514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:19:39.785514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:19:39.785514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:19:39.785514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:19:39.785514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:39.785514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 228/487] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 18 10:19:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:39.795066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922ce5a-7a2a-4625-a597-4c4add171adb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:40.061184 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922ce5a-7a2a-4625-a597-4c4add171adb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:40.146349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75007d84-a9f0-40d3-b4b0-0344d73939e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:40.147535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75007d84-a9f0-40d3-b4b0-0344d73939e1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:40.148054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75007d84-a9f0-40d3-b4b0-0344d73939e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:40.148564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75007d84-a9f0-40d3-b4b0-0344d73939e1 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:40.150225 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75007d84-a9f0-40d3-b4b0-0344d73939e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:40.150805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75007d84-a9f0-40d3-b4b0-0344d73939e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:40.154176 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75007d84-a9f0-40d3-b4b0-0344d73939e1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:40.188530 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546f84b-7907-4f95-9a7d-3b25f59d7b49 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:40.189447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546f84b-7907-4f95-9a7d-3b25f59d7b49 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:40.189798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546f84b-7907-4f95-9a7d-3b25f59d7b49 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:40.191561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 229/488] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:40.197676 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a57a6-84aa-4a1b-a711-4b73bf4f2831 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:40.198188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a57a6-84aa-4a1b-a711-4b73bf4f2831 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:40.198730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a57a6-84aa-4a1b-a711-4b73bf4f2831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:40.205849 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 260/489] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 18 10:19:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:40.227818 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75007d84-a9f0-40d3-b4b0-0344d73939e1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:40.232772 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:40.241043 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-418a57a6-84aa-4a1b-a711-4b73bf4f2831 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:40.243201 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-418a57a6-84aa-4a1b-a711-4b73bf4f2831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:40.409276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 230/490] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:40.433189 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75007d84-a9f0-40d3-b4b0-0344d73939e1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:40.444111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a57a6-84aa-4a1b-a711-4b73bf4f2831 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:40.478995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc63b3-9783-45a8-a30d-69349ef136d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:40.480057 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc63b3-9783-45a8-a30d-69349ef136d6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:40.480533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc63b3-9783-45a8-a30d-69349ef136d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:40.481031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc63b3-9783-45a8-a30d-69349ef136d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:40.586688 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc63b3-9783-45a8-a30d-69349ef136d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:40.588622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc63b3-9783-45a8-a30d-69349ef136d6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:40.592346 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:40.623228 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a57a6-84aa-4a1b-a711-4b73bf4f2831 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:40.657334 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:40.669474 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb5e56-6345-4773-9f91-44069583812d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:40.670813 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb5e56-6345-4773-9f91-44069583812d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:40.671102 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb5e56-6345-4773-9f91-44069583812d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:40.671544 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb5e56-6345-4773-9f91-44069583812d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:40.687118 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb5e56-6345-4773-9f91-44069583812d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-71fb5e56-6345-4773-9f91-44069583812d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:40.697810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:40.698766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:40.699572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:40.699572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:40.699572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:40.699572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:40.699572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:40.699572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:40.699572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:40.699572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:40.699572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:40.699572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:40.699572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:40.699572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:40.700510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 231/491] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:40.702371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0f013-b666-4d05-8603-afec00ebc9f5 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:40.702371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0f013-b666-4d05-8603-afec00ebc9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:40.702371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0f013-b666-4d05-8603-afec00ebc9f5 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:40.704051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 232/492] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:40.709042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0f013-b666-4d05-8603-afec00ebc9f5 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:40.733053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 261/493] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 10:19:40.734426 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d097c1-35c3-4d05-8382-4e4a168d41d5 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:40.734673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d097c1-35c3-4d05-8382-4e4a168d41d5 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:40.734946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d097c1-35c3-4d05-8382-4e4a168d41d5 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:40.742544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 262/494] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:40.742544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a83b6-15ef-4061-8079-0ccd76da1dc2 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:40.742544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a83b6-15ef-4061-8079-0ccd76da1dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:40.742544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a83b6-15ef-4061-8079-0ccd76da1dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:40.762472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c63a83b6-15ef-4061-8079-0ccd76da1dc2 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:40.764313 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c63a83b6-15ef-4061-8079-0ccd76da1dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:40.838838 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 263/495] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:40.839688 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a83b6-15ef-4061-8079-0ccd76da1dc2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:40.860536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0f013-b666-4d05-8603-afec00ebc9f5 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:40.884846 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:40.900668 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11851ab-36bc-46d1-a129-bd24d89e91b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:40.901347 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11851ab-36bc-46d1-a129-bd24d89e91b7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:40.901628 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11851ab-36bc-46d1-a129-bd24d89e91b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:40.901913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11851ab-36bc-46d1-a129-bd24d89e91b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:40.902693 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11851ab-36bc-46d1-a129-bd24d89e91b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:40.903053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11851ab-36bc-46d1-a129-bd24d89e91b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:40.904473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11851ab-36bc-46d1-a129-bd24d89e91b7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:40.917757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 233/496] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:19:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:40.920069 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65413d-4ab1-4151-881b-9c8348173298 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:40.920310 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65413d-4ab1-4151-881b-9c8348173298 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:40.920595 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65413d-4ab1-4151-881b-9c8348173298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:40.939028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ee65413d-4ab1-4151-881b-9c8348173298 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:40.940230 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ee65413d-4ab1-4151-881b-9c8348173298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:40.963053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a83b6-15ef-4061-8079-0ccd76da1dc2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:40.988415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:40.998282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0d9d6-14e9-42ae-912a-17081827d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:41.004585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0d9d6-14e9-42ae-912a-17081827d519 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:41.004585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0d9d6-14e9-42ae-912a-17081827d519 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:41.004585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0d9d6-14e9-42ae-912a-17081827d519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:41.010455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0d9d6-14e9-42ae-912a-17081827d519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:41.011552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 234/497] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:41.011935 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0d9d6-14e9-42ae-912a-17081827d519 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:41.012478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65413d-4ab1-4151-881b-9c8348173298 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:41.032379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-91d0d9d6-14e9-42ae-912a-17081827d519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:41.032379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:41.032379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:41.032379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:41.032379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:41.032379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:41.032379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:41.032379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:41.032379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:41.032379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:41.032379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:41.032379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:41.032379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:41.032379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:41.032379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:41.033315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:41.034615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:41.034615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:41.034615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:41.034615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:41.034615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 264/498] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:41.034615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0d9d6-14e9-42ae-912a-17081827d519 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:41.121170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65413d-4ab1-4151-881b-9c8348173298 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:41.128763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:41.144213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0d9d6-14e9-42ae-912a-17081827d519 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:41.159397 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceb5f9-90e9-4cb6-9a00-ca09df022c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:41.160197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceb5f9-90e9-4cb6-9a00-ca09df022c72 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:41.160517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceb5f9-90e9-4cb6-9a00-ca09df022c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:41.160796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceb5f9-90e9-4cb6-9a00-ca09df022c72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:41.172819 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ceb5f9-90e9-4cb6-9a00-ca09df022c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-74ceb5f9-90e9-4cb6-9a00-ca09df022c72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:41.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:41.181447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:41.182315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:41.182315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:41.182315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:41.182315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:41.182315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:41.182315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:41.182315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:41.182315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:41.182315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:41.182315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:41.182315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:41.182315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:41.182957 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cead1-9493-4392-911f-10e5e8f11250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:41.183045 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 235/499] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:41.183111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cead1-9493-4392-911f-10e5e8f11250 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:41.183111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cead1-9493-4392-911f-10e5e8f11250 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:41.183111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cead1-9493-4392-911f-10e5e8f11250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:41.183288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d6479-9753-4ff4-a926-3b28a0184f1d None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:41.183288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d6479-9753-4ff4-a926-3b28a0184f1d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:41.183680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d6479-9753-4ff4-a926-3b28a0184f1d None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:41.185974 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 236/500] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:41.186576 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d6479-9753-4ff4-a926-3b28a0184f1d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:41.197825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cead1-9493-4392-911f-10e5e8f11250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:41.199310 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cead1-9493-4392-911f-10e5e8f11250 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:41.218582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-462cead1-9493-4392-911f-10e5e8f11250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:41.218582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:41.218582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:41.218582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:41.218582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:41.218582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:41.218582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:41.218582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:41.218582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:41.218582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:41.218582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:41.218582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:41.218582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:41.218582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:41.218582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:41.219541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:41.220367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:41.220367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:41.220367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:41.220367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:41.220367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 265/501] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:41.220642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cead1-9493-4392-911f-10e5e8f11250 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:41.234369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:41.296779 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d6479-9753-4ff4-a926-3b28a0184f1d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:41.326913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cead1-9493-4392-911f-10e5e8f11250 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:41.331986 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57256033-05d4-4ba4-a0bb-67b814457161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:41.332652 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57256033-05d4-4ba4-a0bb-67b814457161 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:41.332932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57256033-05d4-4ba4-a0bb-67b814457161 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:41.333204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57256033-05d4-4ba4-a0bb-67b814457161 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:41.333923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57256033-05d4-4ba4-a0bb-67b814457161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:41.334231 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57256033-05d4-4ba4-a0bb-67b814457161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:41.335661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57256033-05d4-4ba4-a0bb-67b814457161 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:41.348316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 237/502] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:41.349159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57256033-05d4-4ba4-a0bb-67b814457161 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:41.362675 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e26fcd-ad3b-48b1-b49a-cd3275a6e74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:41.363469 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e26fcd-ad3b-48b1-b49a-cd3275a6e74a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:41.363745 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e26fcd-ad3b-48b1-b49a-cd3275a6e74a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:41.364013 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e26fcd-ad3b-48b1-b49a-cd3275a6e74a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:41.371147 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:41.375673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e26fcd-ad3b-48b1-b49a-cd3275a6e74a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-02e26fcd-ad3b-48b1-b49a-cd3275a6e74a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:41.383693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:41.388036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:41.388933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:41.388933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:41.388933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:41.388933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:41.388933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:41.388933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:41.388933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:41.388933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:41.388933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:41.388933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:41.388933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:41.388933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:41.388933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 266/503] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:41.388933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394cfb7-f169-4c19-b8a1-ce3532ec8926 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:41.389685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394cfb7-f169-4c19-b8a1-ce3532ec8926 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:41.389685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394cfb7-f169-4c19-b8a1-ce3532ec8926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:41.406886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a394cfb7-f169-4c19-b8a1-ce3532ec8926 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:41.408207 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a394cfb7-f169-4c19-b8a1-ce3532ec8926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:41.464063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:41.469046 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57256033-05d4-4ba4-a0bb-67b814457161 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:41.491722 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 267/504] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:41.492565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394cfb7-f169-4c19-b8a1-ce3532ec8926 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:41.515965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd26bcb-c60a-48a7-abb5-c59d7ccf71e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:41.516644 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd26bcb-c60a-48a7-abb5-c59d7ccf71e3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:41.516922 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd26bcb-c60a-48a7-abb5-c59d7ccf71e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:41.517350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd26bcb-c60a-48a7-abb5-c59d7ccf71e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:41.518086 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd26bcb-c60a-48a7-abb5-c59d7ccf71e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:41.518412 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd26bcb-c60a-48a7-abb5-c59d7ccf71e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:41.519794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd26bcb-c60a-48a7-abb5-c59d7ccf71e3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:41.530473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 238/505] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:19:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:41.533350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd26bcb-c60a-48a7-abb5-c59d7ccf71e3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:41.616254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394cfb7-f169-4c19-b8a1-ce3532ec8926 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:41.645516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:41.647658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd26bcb-c60a-48a7-abb5-c59d7ccf71e3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:41.653654 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea87b33-c171-4e40-a16f-d253ddc76ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:41.654315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea87b33-c171-4e40-a16f-d253ddc76ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:41.654630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea87b33-c171-4e40-a16f-d253ddc76ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:41.654920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea87b33-c171-4e40-a16f-d253ddc76ee1 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:41.655640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea87b33-c171-4e40-a16f-d253ddc76ee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:41.656002 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea87b33-c171-4e40-a16f-d253ddc76ee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:41.661620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea87b33-c171-4e40-a16f-d253ddc76ee1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:41.670410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 268/506] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:41.671260 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea87b33-c171-4e40-a16f-d253ddc76ee1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:41.687049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f482aa7-bf10-4c07-8154-ea139eb23a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:41.687850 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f482aa7-bf10-4c07-8154-ea139eb23a58 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:41.688140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f482aa7-bf10-4c07-8154-ea139eb23a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:41.688399 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f482aa7-bf10-4c07-8154-ea139eb23a58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:41.695396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f482aa7-bf10-4c07-8154-ea139eb23a58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:41.696867 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f482aa7-bf10-4c07-8154-ea139eb23a58 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:41.713370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-1f482aa7-bf10-4c07-8154-ea139eb23a58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:41.713370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:41.713370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:41.713370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:41.713370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:41.713370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:41.713370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:41.713370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:41.713370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:41.713370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:41.713370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:41.713370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:41.713370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:19:41.713370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:19:41.713370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:41.721622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:41.723395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:19:41.723395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:19:41.723395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:19:41.723395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:19:41.723395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:19:41.723395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:19:41.723395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:41.723395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:41.723395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 239/507] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:41.723395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f482aa7-bf10-4c07-8154-ea139eb23a58 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:41.739604 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:41.782061 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea87b33-c171-4e40-a16f-d253ddc76ee1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:41.820474 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26863be7-9404-46f9-a579-a86bbe73b4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:41.821142 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26863be7-9404-46f9-a579-a86bbe73b4fb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:41.821428 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26863be7-9404-46f9-a579-a86bbe73b4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:41.821708 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26863be7-9404-46f9-a579-a86bbe73b4fb None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:41.822513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26863be7-9404-46f9-a579-a86bbe73b4fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:41.822826 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26863be7-9404-46f9-a579-a86bbe73b4fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:41.824205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26863be7-9404-46f9-a579-a86bbe73b4fb None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:41.830055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f482aa7-bf10-4c07-8154-ea139eb23a58 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:41.833640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 269/508] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:19:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:41.834515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26863be7-9404-46f9-a579-a86bbe73b4fb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:41.870300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc226e-57ea-4cfe-a79c-cbbc9f22f165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:41.871307 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc226e-57ea-4cfe-a79c-cbbc9f22f165 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:41.871748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc226e-57ea-4cfe-a79c-cbbc9f22f165 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:41.872228 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc226e-57ea-4cfe-a79c-cbbc9f22f165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:41.884977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc226e-57ea-4cfe-a79c-cbbc9f22f165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:41.886604 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc226e-57ea-4cfe-a79c-cbbc9f22f165 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:41.890452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:41.914417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-03dc226e-57ea-4cfe-a79c-cbbc9f22f165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:41.914417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:41.914417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:41.914417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:41.914417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:41.914417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:41.914417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:41.914417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:41.914417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:41.914417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:41.914417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:41.914417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:41.914417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:41.914417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:41.914417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:41.915417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:41.916268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:41.916268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:41.916268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:41.916268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:41.916900 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 240/509] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:41.917791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc226e-57ea-4cfe-a79c-cbbc9f22f165 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:41.959212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26863be7-9404-46f9-a579-a86bbe73b4fb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:41.998191 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:42.002271 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b120e6-78d1-4b67-8e76-6928d43faf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:42.003229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b120e6-78d1-4b67-8e76-6928d43faf74 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:42.003705 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b120e6-78d1-4b67-8e76-6928d43faf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:42.004069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b120e6-78d1-4b67-8e76-6928d43faf74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:42.016520 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b120e6-78d1-4b67-8e76-6928d43faf74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:42.018173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b120e6-78d1-4b67-8e76-6928d43faf74 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:42.029612 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc226e-57ea-4cfe-a79c-cbbc9f22f165 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:42.036743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-72b120e6-78d1-4b67-8e76-6928d43faf74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:42.036743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:42.036743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:42.036743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:42.036743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:42.036743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:42.036743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:42.036743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:42.036743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:42.036743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:42.036743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:42.036743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:42.036743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:42.036743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:42.036743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:42.038300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:42.039978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:42.039978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:42.039978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:42.039978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:42.039978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 270/510] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:42.039978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b120e6-78d1-4b67-8e76-6928d43faf74 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:42.069479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe16a4-67a9-4080-b947-0b4a9cf82486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:42.070272 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe16a4-67a9-4080-b947-0b4a9cf82486 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:42.070581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe16a4-67a9-4080-b947-0b4a9cf82486 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:42.070857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe16a4-67a9-4080-b947-0b4a9cf82486 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:42.078463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe16a4-67a9-4080-b947-0b4a9cf82486 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:42.079920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe16a4-67a9-4080-b947-0b4a9cf82486 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-76fe16a4-67a9-4080-b947-0b4a9cf82486 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:19:42.095521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:42.096503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:42.097368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:42.097368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:42.097368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:19:42.097368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:19:42.097368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:19:42.097368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:19:42.097368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:19:42.097368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:19:42.097368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 10:19:42.097368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:42.097368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 241/511] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:42.098425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe16a4-67a9-4080-b947-0b4a9cf82486 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:42.193201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b120e6-78d1-4b67-8e76-6928d43faf74 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:42.194891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:42.203016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe16a4-67a9-4080-b947-0b4a9cf82486 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:42.231415 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180728bf-b18f-4241-b1ef-d31161f228e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:42.232425 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180728bf-b18f-4241-b1ef-d31161f228e0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:42.233157 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180728bf-b18f-4241-b1ef-d31161f228e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:42.233623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180728bf-b18f-4241-b1ef-d31161f228e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:42.235171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180728bf-b18f-4241-b1ef-d31161f228e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:42.235585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180728bf-b18f-4241-b1ef-d31161f228e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:42.238078 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180728bf-b18f-4241-b1ef-d31161f228e0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:42.241006 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:42.253743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e38cdf-3e9e-4d11-ad50-726693610905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:42.253743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e38cdf-3e9e-4d11-ad50-726693610905 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:42.253743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e38cdf-3e9e-4d11-ad50-726693610905 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:42.253743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e38cdf-3e9e-4d11-ad50-726693610905 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:42.264066 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e38cdf-3e9e-4d11-ad50-726693610905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:42.264561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 271/512] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:42.265418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180728bf-b18f-4241-b1ef-d31161f228e0 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:42.265569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e38cdf-3e9e-4d11-ad50-726693610905 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:42.299159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-f8e38cdf-3e9e-4d11-ad50-726693610905 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:42.299159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:42.299159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:42.299159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:42.299159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:42.299159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:42.299159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:42.299159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:42.299159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:42.299159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:42.299159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:42.299159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:42.299159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:42.299159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:42.299159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:42.300119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:42.300989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:42.300989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:42.300989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:42.300989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:42.301198 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 242/513] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:42.302185 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e38cdf-3e9e-4d11-ad50-726693610905 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:42.395265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180728bf-b18f-4241-b1ef-d31161f228e0 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:42.432110 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e38cdf-3e9e-4d11-ad50-726693610905 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:42.443166 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90ac76-f0c0-4029-a36d-496812e8f599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:42.443822 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90ac76-f0c0-4029-a36d-496812e8f599 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:42.444101 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90ac76-f0c0-4029-a36d-496812e8f599 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:42.444372 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90ac76-f0c0-4029-a36d-496812e8f599 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:42.445084 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90ac76-f0c0-4029-a36d-496812e8f599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:42.445421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90ac76-f0c0-4029-a36d-496812e8f599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:42.446816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90ac76-f0c0-4029-a36d-496812e8f599 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:42.459095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 272/514] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:42.459944 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90ac76-f0c0-4029-a36d-496812e8f599 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:42.476862 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1d2d8-031e-4a56-84a4-115ef611327e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:42.477525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1d2d8-031e-4a56-84a4-115ef611327e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:42.477802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1d2d8-031e-4a56-84a4-115ef611327e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:42.478081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1d2d8-031e-4a56-84a4-115ef611327e None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:42.478836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1d2d8-031e-4a56-84a4-115ef611327e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:42.479136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1d2d8-031e-4a56-84a4-115ef611327e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:42.480516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1d2d8-031e-4a56-84a4-115ef611327e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:42.487420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:42.492753 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 243/515] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:42.493586 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1d2d8-031e-4a56-84a4-115ef611327e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:42.544406 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:42.570435 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90ac76-f0c0-4029-a36d-496812e8f599 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:42.603351 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1d2d8-031e-4a56-84a4-115ef611327e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:42.610037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdbc5f-907e-4092-937a-ffe01e007219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:42.610737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdbc5f-907e-4092-937a-ffe01e007219 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:42.611007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdbc5f-907e-4092-937a-ffe01e007219 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:42.611287 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdbc5f-907e-4092-937a-ffe01e007219 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:42.612112 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdbc5f-907e-4092-937a-ffe01e007219 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:42.612416 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdbc5f-907e-4092-937a-ffe01e007219 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:42.613875 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdbc5f-907e-4092-937a-ffe01e007219 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:42.631893 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 273/516] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 18 10:19:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:42.632970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdbc5f-907e-4092-937a-ffe01e007219 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:42.645142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95622e3-0bb4-4db3-bb33-44b9bce4adc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:42.645828 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95622e3-0bb4-4db3-bb33-44b9bce4adc9 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:42.646111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95622e3-0bb4-4db3-bb33-44b9bce4adc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:42.646412 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95622e3-0bb4-4db3-bb33-44b9bce4adc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:42.647274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95622e3-0bb4-4db3-bb33-44b9bce4adc9 None admin] RBAC: Adding query filter params (role.id=509fcb6f06144cdd9803fb3910eb80bf, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=f7abf6b71ac3454ca547a750cef9220a) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:42.647587 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95622e3-0bb4-4db3-bb33-44b9bce4adc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:42.649092 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95622e3-0bb4-4db3-bb33-44b9bce4adc9 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:42.655669 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 244/517] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:19:42 2022] GET /identity/v3/role_assignments?user.id=f7abf6b71ac3454ca547a750cef9220a&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=509fcb6f06144cdd9803fb3910eb80bf => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:42.656469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95622e3-0bb4-4db3-bb33-44b9bce4adc9 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:42.739932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:42.771904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdbc5f-907e-4092-937a-ffe01e007219 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:42.807300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95622e3-0bb4-4db3-bb33-44b9bce4adc9 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:42.818811 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:42.836839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ca087-0918-4c57-b154-fda9e00e9547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:42.838069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ca087-0918-4c57-b154-fda9e00e9547 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:42.838784 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ca087-0918-4c57-b154-fda9e00e9547 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:42.839707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ca087-0918-4c57-b154-fda9e00e9547 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:42.841871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ca087-0918-4c57-b154-fda9e00e9547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:42.842372 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ca087-0918-4c57-b154-fda9e00e9547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:42.845859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ca087-0918-4c57-b154-fda9e00e9547 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:42.848599 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c770e5-c29c-45a5-a210-ca17626d4485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:42.849420 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c770e5-c29c-45a5-a210-ca17626d4485 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:42.849790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c770e5-c29c-45a5-a210-ca17626d4485 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:42.850178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c770e5-c29c-45a5-a210-ca17626d4485 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:42.851010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c770e5-c29c-45a5-a210-ca17626d4485 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:42.852753 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c770e5-c29c-45a5-a210-ca17626d4485 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:42.873873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 274/518] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:42.873873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ca087-0918-4c57-b154-fda9e00e9547 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:42.970375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 245/519] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:19:42 2022] POST /identity/v3/users => generated 247 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:19:42.970375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c770e5-c29c-45a5-a210-ca17626d4485 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:43.014632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ca087-0918-4c57-b154-fda9e00e9547 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:43.082558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c770e5-c29c-45a5-a210-ca17626d4485 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:43.092557 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdad0f-a538-4663-aafe-9cf974a1632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:43.094438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdad0f-a538-4663-aafe-9cf974a1632c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:43.095658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdad0f-a538-4663-aafe-9cf974a1632c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:43.096325 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdad0f-a538-4663-aafe-9cf974a1632c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:43.111905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdad0f-a538-4663-aafe-9cf974a1632c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:43.115726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdad0f-a538-4663-aafe-9cf974a1632c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:43.123796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:43.130473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15322603-0b9a-45d9-8857-7fd8bdfbd409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:43.131515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15322603-0b9a-45d9-8857-7fd8bdfbd409 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:43.131960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15322603-0b9a-45d9-8857-7fd8bdfbd409 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:43.132412 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15322603-0b9a-45d9-8857-7fd8bdfbd409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-f5bdad0f-a538-4663-aafe-9cf974a1632c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:19:43.143897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:43.144845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:43.145729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:43.145729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:43.145729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:19:43.145729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:19:43.145729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:19:43.145729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:19:43.145729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:19:43.145729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:19:43.145729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 10:19:43.145729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:43.148445 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 275/520] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:43.149507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdad0f-a538-4663-aafe-9cf974a1632c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:43.198934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:43.258630 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15322603-0b9a-45d9-8857-7fd8bdfbd409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:43.260732 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15322603-0b9a-45d9-8857-7fd8bdfbd409 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:43.281465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdad0f-a538-4663-aafe-9cf974a1632c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:43.335493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65457efe-ee9d-4ea7-b515-053fb921c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:43.336474 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65457efe-ee9d-4ea7-b515-053fb921c171 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:43.336955 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65457efe-ee9d-4ea7-b515-053fb921c171 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:43.337421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65457efe-ee9d-4ea7-b515-053fb921c171 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:43.351373 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65457efe-ee9d-4ea7-b515-053fb921c171 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:43.353732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65457efe-ee9d-4ea7-b515-053fb921c171 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-65457efe-ee9d-4ea7-b515-053fb921c171 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:19:43.380907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:43.381992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:43.383243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:43.383243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:43.383243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:19:43.383243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:19:43.383243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:19:43.383243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:19:43.383243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:19:43.383243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:19:43.383243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:19:43.383243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:43.383243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 276/521] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:43.384321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65457efe-ee9d-4ea7-b515-053fb921c171 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:43.411680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 246/522] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:43.412917 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15322603-0b9a-45d9-8857-7fd8bdfbd409 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:43.494841 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:43.533128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:43.535203 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15322603-0b9a-45d9-8857-7fd8bdfbd409 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:43.576750 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e87b74-eeb1-462a-84a8-608aca816ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:43.577944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e87b74-eeb1-462a-84a8-608aca816ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:43.578462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e87b74-eeb1-462a-84a8-608aca816ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:43.578976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e87b74-eeb1-462a-84a8-608aca816ff5 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:43.580057 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e87b74-eeb1-462a-84a8-608aca816ff5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:43.580571 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e87b74-eeb1-462a-84a8-608aca816ff5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:43.582567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e87b74-eeb1-462a-84a8-608aca816ff5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:43.616682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65457efe-ee9d-4ea7-b515-053fb921c171 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:43.634235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 247/523] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 18 10:19:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:43.636359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e87b74-eeb1-462a-84a8-608aca816ff5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:43.670850 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2586ef5-63d2-4f2a-8d7a-de056530c25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:43.671549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2586ef5-63d2-4f2a-8d7a-de056530c25c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:43.671831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2586ef5-63d2-4f2a-8d7a-de056530c25c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:43.672136 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2586ef5-63d2-4f2a-8d7a-de056530c25c None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:43.672950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2586ef5-63d2-4f2a-8d7a-de056530c25c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:43.673262 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2586ef5-63d2-4f2a-8d7a-de056530c25c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:43.674792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2586ef5-63d2-4f2a-8d7a-de056530c25c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:43.702374 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 277/524] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Jul 18 10:19:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:43.702374 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2586ef5-63d2-4f2a-8d7a-de056530c25c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:43.813296 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2586ef5-63d2-4f2a-8d7a-de056530c25c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:43.833652 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:43.853167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedee3ec-52c8-4b80-9d60-27254a4c4bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:43.853968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedee3ec-52c8-4b80-9d60-27254a4c4bfd None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:43.856982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedee3ec-52c8-4b80-9d60-27254a4c4bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:43.856982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedee3ec-52c8-4b80-9d60-27254a4c4bfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:43.864976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e87b74-eeb1-462a-84a8-608aca816ff5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:43.920471 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:43.941981 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedee3ec-52c8-4b80-9d60-27254a4c4bfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:43.943713 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedee3ec-52c8-4b80-9d60-27254a4c4bfd None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:43.948359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79765d0b-d6ad-47c4-8370-ac44accd35cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:43.950777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79765d0b-d6ad-47c4-8370-ac44accd35cf None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:43.951596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79765d0b-d6ad-47c4-8370-ac44accd35cf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:43.952366 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79765d0b-d6ad-47c4-8370-ac44accd35cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:43.976386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79765d0b-d6ad-47c4-8370-ac44accd35cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:43.980128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79765d0b-d6ad-47c4-8370-ac44accd35cf None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:44.022223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-79765d0b-d6ad-47c4-8370-ac44accd35cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:44.022223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:44.022223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:44.022223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:44.022223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:44.022223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:44.022223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:44.022223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:44.022223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:44.022223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:44.022223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:44.022223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:44.022223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:44.022223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:44.022223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:44.024163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:44.026103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:44.026103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:44.026103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:44.026103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:44.038157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 248/525] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:44.040240 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79765d0b-d6ad-47c4-8370-ac44accd35cf None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:44.058705 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 278/526] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:44.065079 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedee3ec-52c8-4b80-9d60-27254a4c4bfd None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:44.085355 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:44.179433 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79765d0b-d6ad-47c4-8370-ac44accd35cf None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:44.197158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedee3ec-52c8-4b80-9d60-27254a4c4bfd None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:44.227554 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4097818-0a9a-43dc-bf2d-3fd5671ba4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:44.228684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4097818-0a9a-43dc-bf2d-3fd5671ba4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:44.229361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4097818-0a9a-43dc-bf2d-3fd5671ba4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:44.229827 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4097818-0a9a-43dc-bf2d-3fd5671ba4c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:44.236340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa05cb9-4c8e-4336-b577-3a048033965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:44.236944 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa05cb9-4c8e-4336-b577-3a048033965e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:44.237298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa05cb9-4c8e-4336-b577-3a048033965e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:44.237670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa05cb9-4c8e-4336-b577-3a048033965e None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:44.238522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa05cb9-4c8e-4336-b577-3a048033965e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:44.238897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa05cb9-4c8e-4336-b577-3a048033965e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:44.240444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa05cb9-4c8e-4336-b577-3a048033965e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:44.253734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 279/527] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:44.254691 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa05cb9-4c8e-4336-b577-3a048033965e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:44.292408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:44.328834 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4097818-0a9a-43dc-bf2d-3fd5671ba4c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:44.330365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4097818-0a9a-43dc-bf2d-3fd5671ba4c3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:44.366804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:44.388737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa05cb9-4c8e-4336-b577-3a048033965e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:44.428364 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383e999-573b-4757-a119-b0df4a4b3ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:44.429572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383e999-573b-4757-a119-b0df4a4b3ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:44.430036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383e999-573b-4757-a119-b0df4a4b3ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:44.430626 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383e999-573b-4757-a119-b0df4a4b3ce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:44.443919 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383e999-573b-4757-a119-b0df4a4b3ce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:44.445869 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383e999-573b-4757-a119-b0df4a4b3ce0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:44.455505 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 249/528] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:44.455505 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4097818-0a9a-43dc-bf2d-3fd5671ba4c3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:44.472441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-1383e999-573b-4757-a119-b0df4a4b3ce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:44.472441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:44.472441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:44.472441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:44.472441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:44.472441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:44.472441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:44.472441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:44.472441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:44.472441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:44.472441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:44.472441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:44.472441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:44.472441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:44.472441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:44.473403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:44.474240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:44.474240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:44.474240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:44.474240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:44.476568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 280/529] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:44.477715 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383e999-573b-4757-a119-b0df4a4b3ce0 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:44.537211 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:44.566275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4097818-0a9a-43dc-bf2d-3fd5671ba4c3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:44.596758 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383e999-573b-4757-a119-b0df4a4b3ce0 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:44.604647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ef36e-ec01-4d61-ac71-f8f5e61e1668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:44.605851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ef36e-ec01-4d61-ac71-f8f5e61e1668 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:44.605851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ef36e-ec01-4d61-ac71-f8f5e61e1668 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:44.606647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ef36e-ec01-4d61-ac71-f8f5e61e1668 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:44.614689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ef36e-ec01-4d61-ac71-f8f5e61e1668 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:44.616162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ef36e-ec01-4d61-ac71-f8f5e61e1668 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:44.631188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:44.633664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-a53ef36e-ec01-4d61-ac71-f8f5e61e1668 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:44.633664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:44.633664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:44.633664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:44.633664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:44.633664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:44.633664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:44.633664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:44.633664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:44.633664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:44.633664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:44.633664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:44.633664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:19:44.633664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:19:44.633664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:44.634563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:44.635509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:19:44.635509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:19:44.635509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:19:44.635509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:19:44.635509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:19:44.635509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:19:44.635509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:44.635509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:44.635509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 250/530] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:44.636410 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ef36e-ec01-4d61-ac71-f8f5e61e1668 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:44.641530 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10481f8-c74d-4d1f-aba3-fc4c8f64e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:44.642664 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10481f8-c74d-4d1f-aba3-fc4c8f64e91b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:44.643114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10481f8-c74d-4d1f-aba3-fc4c8f64e91b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:44.643549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10481f8-c74d-4d1f-aba3-fc4c8f64e91b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:44.656348 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10481f8-c74d-4d1f-aba3-fc4c8f64e91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:44.658312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10481f8-c74d-4d1f-aba3-fc4c8f64e91b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:44.686940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-f10481f8-c74d-4d1f-aba3-fc4c8f64e91b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:44.686940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:44.686940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:44.686940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:44.686940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:44.686940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:44.686940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:44.686940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:44.686940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:44.686940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:44.686940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:44.686940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:44.686940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:44.686940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:44.686940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:44.687848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:44.688712 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:44.688712 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:44.688712 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:44.688712 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:44.694615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 281/531] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:44.695796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10481f8-c74d-4d1f-aba3-fc4c8f64e91b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:44.750157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ef36e-ec01-4d61-ac71-f8f5e61e1668 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:44.788617 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4881c69-ca19-4aff-9b36-561183b28d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:44.789287 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4881c69-ca19-4aff-9b36-561183b28d85 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:44.789570 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4881c69-ca19-4aff-9b36-561183b28d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:44.789917 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4881c69-ca19-4aff-9b36-561183b28d85 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:44.790584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4881c69-ca19-4aff-9b36-561183b28d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:44.790887 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4881c69-ca19-4aff-9b36-561183b28d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:44.792363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4881c69-ca19-4aff-9b36-561183b28d85 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:44.794153 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:44.806291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 251/532] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:44.807258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4881c69-ca19-4aff-9b36-561183b28d85 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:44.815668 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10481f8-c74d-4d1f-aba3-fc4c8f64e91b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:44.854356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0db9ee-4cf1-4246-8ffa-8c5f482e0956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:44.855354 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0db9ee-4cf1-4246-8ffa-8c5f482e0956 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:44.855780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0db9ee-4cf1-4246-8ffa-8c5f482e0956 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:44.857022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0db9ee-4cf1-4246-8ffa-8c5f482e0956 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:44.858084 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0db9ee-4cf1-4246-8ffa-8c5f482e0956 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:44.858565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0db9ee-4cf1-4246-8ffa-8c5f482e0956 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:44.860297 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0db9ee-4cf1-4246-8ffa-8c5f482e0956 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:44.875468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 282/533] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:19:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:44.876697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0db9ee-4cf1-4246-8ffa-8c5f482e0956 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:44.924344 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4881c69-ca19-4aff-9b36-561183b28d85 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:44.927785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:44.966630 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f557b-992c-4022-a1fe-70dbdbd2023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:44.967317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f557b-992c-4022-a1fe-70dbdbd2023c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:44.967707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f557b-992c-4022-a1fe-70dbdbd2023c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:44.967984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f557b-992c-4022-a1fe-70dbdbd2023c None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:44.968708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f557b-992c-4022-a1fe-70dbdbd2023c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:44.969012 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f557b-992c-4022-a1fe-70dbdbd2023c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:44.970446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f557b-992c-4022-a1fe-70dbdbd2023c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:44.983503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 252/534] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:44.984301 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f557b-992c-4022-a1fe-70dbdbd2023c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:44.999426 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0db9ee-4cf1-4246-8ffa-8c5f482e0956 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:45.038816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8b2aa-caa7-44b7-ae3c-7e01058e5089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:45.039611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8b2aa-caa7-44b7-ae3c-7e01058e5089 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:45.039888 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8b2aa-caa7-44b7-ae3c-7e01058e5089 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:45.040159 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8b2aa-caa7-44b7-ae3c-7e01058e5089 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:45.047966 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:45.048170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8b2aa-caa7-44b7-ae3c-7e01058e5089 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:45.049759 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8b2aa-caa7-44b7-ae3c-7e01058e5089 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:45.066486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-f0e8b2aa-caa7-44b7-ae3c-7e01058e5089 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:45.066486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:45.066486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:45.066486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:45.066486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:45.066486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:45.066486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:45.066486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:45.066486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:45.066486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:45.066486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:45.066486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:45.066486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:19:45.066486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:19:45.066486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:45.067406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:45.068339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:19:45.068339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:19:45.068339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:19:45.068339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:19:45.068339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:19:45.068339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:19:45.068339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:45.068339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:45.068339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 283/535] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:45.069759 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2092f-3f04-453e-84b0-fad2b5057f18 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:45.069759 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2092f-3f04-453e-84b0-fad2b5057f18 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:45.069759 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2092f-3f04-453e-84b0-fad2b5057f18 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:45.076565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 284/536] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:45.076565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2092f-3f04-453e-84b0-fad2b5057f18 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:45.111665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f557b-992c-4022-a1fe-70dbdbd2023c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:45.161723 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13b6d6-fec6-45a7-9363-425e84e39777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:45.162440 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13b6d6-fec6-45a7-9363-425e84e39777 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:45.162737 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13b6d6-fec6-45a7-9363-425e84e39777 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:45.163014 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13b6d6-fec6-45a7-9363-425e84e39777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:45.163819 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13b6d6-fec6-45a7-9363-425e84e39777 None admin] RBAC: Adding query filter params (role.id=509fcb6f06144cdd9803fb3910eb80bf, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=7f93de99555742ca9bd99d707d1cdbee) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:45.164125 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13b6d6-fec6-45a7-9363-425e84e39777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:45.166054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13b6d6-fec6-45a7-9363-425e84e39777 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:45.173771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 253/537] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:19:44 2022] GET /identity/v3/role_assignments?user.id=7f93de99555742ca9bd99d707d1cdbee&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=509fcb6f06144cdd9803fb3910eb80bf => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:45.174706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13b6d6-fec6-45a7-9363-425e84e39777 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:45.216400 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2092f-3f04-453e-84b0-fad2b5057f18 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:45.219001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:45.270180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d581085-a804-4c2c-969d-8e0c4ce44420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:45.271678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d581085-a804-4c2c-969d-8e0c4ce44420 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:45.272232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d581085-a804-4c2c-969d-8e0c4ce44420 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:45.272710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d581085-a804-4c2c-969d-8e0c4ce44420 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:45.284774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d581085-a804-4c2c-969d-8e0c4ce44420 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:45.287925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d581085-a804-4c2c-969d-8e0c4ce44420 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:45.309001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-0d581085-a804-4c2c-969d-8e0c4ce44420 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:45.309001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:45.309001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:45.309001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:45.309001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:45.309001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:45.309001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:45.309001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:45.309001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:45.309001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:45.309001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:45.309001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:45.309001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:19:45.309001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:19:45.309001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:45.310472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:45.311332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:19:45.311332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:19:45.311332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:19:45.311332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:19:45.311332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:19:45.311332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:19:45.311332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:45.311332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:45.311812 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 285/538] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:45.313005 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed398d1-e7c6-4cc8-8667-3cd5a5bd2c06 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:45.313197 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed398d1-e7c6-4cc8-8667-3cd5a5bd2c06 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:45.313435 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed398d1-e7c6-4cc8-8667-3cd5a5bd2c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:45.333167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-bed398d1-e7c6-4cc8-8667-3cd5a5bd2c06 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:45.334445 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-bed398d1-e7c6-4cc8-8667-3cd5a5bd2c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:45.347581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13b6d6-fec6-45a7-9363-425e84e39777 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:45.369020 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:45.409425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872b5f5-7f07-46e6-84c2-e3ef72812ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:45.410095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872b5f5-7f07-46e6-84c2-e3ef72812ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:45.410446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872b5f5-7f07-46e6-84c2-e3ef72812ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:45.410721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872b5f5-7f07-46e6-84c2-e3ef72812ed4 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:45.411511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872b5f5-7f07-46e6-84c2-e3ef72812ed4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:45.411819 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872b5f5-7f07-46e6-84c2-e3ef72812ed4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:45.413259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872b5f5-7f07-46e6-84c2-e3ef72812ed4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:45.436834 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 286/539] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:45.437727 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed398d1-e7c6-4cc8-8667-3cd5a5bd2c06 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:45.462020 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 254/540] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:19:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:45.469820 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872b5f5-7f07-46e6-84c2-e3ef72812ed4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:45.557814 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:45.569638 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed398d1-e7c6-4cc8-8667-3cd5a5bd2c06 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:45.640508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916d425-0c8c-4b77-b5fe-24ec3b9ba25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:45.641568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916d425-0c8c-4b77-b5fe-24ec3b9ba25e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:45.642048 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916d425-0c8c-4b77-b5fe-24ec3b9ba25e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:45.642531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916d425-0c8c-4b77-b5fe-24ec3b9ba25e None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:45.643915 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916d425-0c8c-4b77-b5fe-24ec3b9ba25e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:45.644502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916d425-0c8c-4b77-b5fe-24ec3b9ba25e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:45.647421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916d425-0c8c-4b77-b5fe-24ec3b9ba25e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:45.670953 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 287/541] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:19:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:45.670953 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916d425-0c8c-4b77-b5fe-24ec3b9ba25e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:45.680862 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872b5f5-7f07-46e6-84c2-e3ef72812ed4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:45.737547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c110dbd-0cce-4db1-9a7a-9762cdc4af31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:45.738629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c110dbd-0cce-4db1-9a7a-9762cdc4af31 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:45.739093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c110dbd-0cce-4db1-9a7a-9762cdc4af31 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:45.739561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c110dbd-0cce-4db1-9a7a-9762cdc4af31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:45.741044 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c110dbd-0cce-4db1-9a7a-9762cdc4af31 None admin] RBAC: Adding query filter params (role.id=509fcb6f06144cdd9803fb3910eb80bf, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=08f27c6bc2744b9f92141a9c6906bc3f) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:45.741481 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c110dbd-0cce-4db1-9a7a-9762cdc4af31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:45.744066 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c110dbd-0cce-4db1-9a7a-9762cdc4af31 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:45.762864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 255/542] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:19:45 2022] GET /identity/v3/role_assignments?user.id=08f27c6bc2744b9f92141a9c6906bc3f&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=509fcb6f06144cdd9803fb3910eb80bf => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:45.762864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f302e0-9d33-4a5d-8130-ae78825299de None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:45.762864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f302e0-9d33-4a5d-8130-ae78825299de None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:45.762864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f302e0-9d33-4a5d-8130-ae78825299de None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:45.762864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 256/543] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:45.762864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f302e0-9d33-4a5d-8130-ae78825299de None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:45.847389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:45.870594 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916d425-0c8c-4b77-b5fe-24ec3b9ba25e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:45.944347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95718ecc-2df7-47bd-9e48-edda9f23b81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:45.945655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95718ecc-2df7-47bd-9e48-edda9f23b81d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:45.946119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95718ecc-2df7-47bd-9e48-edda9f23b81d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:45.947696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95718ecc-2df7-47bd-9e48-edda9f23b81d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:45.966452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95718ecc-2df7-47bd-9e48-edda9f23b81d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:45.966780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f302e0-9d33-4a5d-8130-ae78825299de None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-95718ecc-2df7-47bd-9e48-edda9f23b81d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:45.976660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:45.977610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:45.978464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:45.978464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:45.978464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:45.978464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:45.978464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:45.978464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:45.978464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:45.978464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:45.978464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:45.978464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:45.978464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:45.978464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:45.982075 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 288/544] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:45.983620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455aa89-a32b-4be5-afb4-602f77076264 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:45.984107 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455aa89-a32b-4be5-afb4-602f77076264 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:45.984575 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455aa89-a32b-4be5-afb4-602f77076264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:46.013112 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d455aa89-a32b-4be5-afb4-602f77076264 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:46.015130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d455aa89-a32b-4be5-afb4-602f77076264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:46.020058 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb97488-7428-41b8-8fbe-dd8e13a9ea9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:46.020988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97488-7428-41b8-8fbe-dd8e13a9ea9f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:46.021442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97488-7428-41b8-8fbe-dd8e13a9ea9f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:46.021884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97488-7428-41b8-8fbe-dd8e13a9ea9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:46.022940 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb97488-7428-41b8-8fbe-dd8e13a9ea9f None admin] RBAC: Adding query filter params (role.id=509fcb6f06144cdd9803fb3910eb80bf, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=3f9385dec85a4e0cba21c2a840124f5a) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:46.023452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb97488-7428-41b8-8fbe-dd8e13a9ea9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:46.025065 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb97488-7428-41b8-8fbe-dd8e13a9ea9f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:46.031326 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:46.032561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 257/545] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:19:45 2022] GET /identity/v3/role_assignments?user.id=3f9385dec85a4e0cba21c2a840124f5a&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=509fcb6f06144cdd9803fb3910eb80bf => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:46.039497 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb97488-7428-41b8-8fbe-dd8e13a9ea9f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:46.169241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 289/546] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:46.239751 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455aa89-a32b-4be5-afb4-602f77076264 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:46.331619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb97488-7428-41b8-8fbe-dd8e13a9ea9f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:46.362588 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:46.429988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978410aa-0d5d-4a7c-920a-08bd2c05a701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:46.430702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978410aa-0d5d-4a7c-920a-08bd2c05a701 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:46.430979 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978410aa-0d5d-4a7c-920a-08bd2c05a701 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:46.431246 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978410aa-0d5d-4a7c-920a-08bd2c05a701 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:46.432012 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978410aa-0d5d-4a7c-920a-08bd2c05a701 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:46.432316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978410aa-0d5d-4a7c-920a-08bd2c05a701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:46.434514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978410aa-0d5d-4a7c-920a-08bd2c05a701 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:46.464178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 258/547] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:19:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:46.473781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978410aa-0d5d-4a7c-920a-08bd2c05a701 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:46.543280 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455aa89-a32b-4be5-afb4-602f77076264 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:46.619767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9b795-e7a7-4d9a-b3e4-470d694f7090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:46.620459 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9b795-e7a7-4d9a-b3e4-470d694f7090 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:46.620746 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9b795-e7a7-4d9a-b3e4-470d694f7090 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:46.620998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9b795-e7a7-4d9a-b3e4-470d694f7090 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:46.647520 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9b795-e7a7-4d9a-b3e4-470d694f7090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-13f9b795-e7a7-4d9a-b3e4-470d694f7090 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:46.657773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:46.659377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:46.661639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:46.661639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:46.661639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:46.661639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:46.661639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:46.661639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:46.661639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:46.661639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:46.661639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:46.661639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:46.661639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:46.661639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:46.661639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 290/548] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:19:46.666920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9b795-e7a7-4d9a-b3e4-470d694f7090 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:46.677509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:46.703409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978410aa-0d5d-4a7c-920a-08bd2c05a701 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:46.807109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0f645-8818-4223-a4c0-f77307381ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:46.807933 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0f645-8818-4223-a4c0-f77307381ebc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:46.808217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0f645-8818-4223-a4c0-f77307381ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:46.808490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0f645-8818-4223-a4c0-f77307381ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:46.847289 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0f645-8818-4223-a4c0-f77307381ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:46.848780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0f645-8818-4223-a4c0-f77307381ebc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:46.856647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9b795-e7a7-4d9a-b3e4-470d694f7090 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:46.889649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-fbb0f645-8818-4223-a4c0-f77307381ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:46.889649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:46.889649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:46.889649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:46.889649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:46.889649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:46.889649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:46.889649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:46.889649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:46.889649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:46.889649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:46.889649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:46.889649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:46.889649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:46.889649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:46.891350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:46.893629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:46.893629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:46.893629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:46.893629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:46.903926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 259/549] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:19:46.909227 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0f645-8818-4223-a4c0-f77307381ebc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:46.944831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05046064-f561-4d24-89d0-97b74c371a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:46.946349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046064-f561-4d24-89d0-97b74c371a07 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:46.947153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046064-f561-4d24-89d0-97b74c371a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:46.947890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046064-f561-4d24-89d0-97b74c371a07 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:46.949425 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05046064-f561-4d24-89d0-97b74c371a07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:46.950740 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05046064-f561-4d24-89d0-97b74c371a07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:46.953387 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05046064-f561-4d24-89d0-97b74c371a07 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:46.974738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:46.989341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 291/550] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:19:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:46.995636 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05046064-f561-4d24-89d0-97b74c371a07 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:47.129933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:47.209008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05046064-f561-4d24-89d0-97b74c371a07 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:47.241260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0f645-8818-4223-a4c0-f77307381ebc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:47.288278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efe66d-c3ae-4108-9e8c-66a7e0221661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:47.289603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efe66d-c3ae-4108-9e8c-66a7e0221661 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:47.290103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efe66d-c3ae-4108-9e8c-66a7e0221661 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:47.290626 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efe66d-c3ae-4108-9e8c-66a7e0221661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:47.326642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efe66d-c3ae-4108-9e8c-66a7e0221661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:47.329514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efe66d-c3ae-4108-9e8c-66a7e0221661 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:47.340289 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55654eb1-e88a-4094-a8c2-3a1084e275ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:47.342280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55654eb1-e88a-4094-a8c2-3a1084e275ca None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:47.347515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55654eb1-e88a-4094-a8c2-3a1084e275ca None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:47.348448 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55654eb1-e88a-4094-a8c2-3a1084e275ca None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:47.350233 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55654eb1-e88a-4094-a8c2-3a1084e275ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:47.351126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55654eb1-e88a-4094-a8c2-3a1084e275ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:47.358711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55654eb1-e88a-4094-a8c2-3a1084e275ca None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:47.402159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 260/551] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:19:47.405657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-a2efe66d-c3ae-4108-9e8c-66a7e0221661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:47.405657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:47.405657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:47.405657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:47.405657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:47.405657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:47.405657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:47.405657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:47.405657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:47.405657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:47.405657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:47.405657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:47.405657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:47.405657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:47.405657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:47.410768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:47.412441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:47.412441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:47.412441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:47.412441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:47.412844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55654eb1-e88a-4094-a8c2-3a1084e275ca None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:47.419430 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 292/552] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:47.422511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efe66d-c3ae-4108-9e8c-66a7e0221661 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:47.573751 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:47.585137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55654eb1-e88a-4094-a8c2-3a1084e275ca None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:47.628023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3642625-d848-4b27-9e2a-a55fa354904e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:47.629522 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3642625-d848-4b27-9e2a-a55fa354904e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:47.629963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3642625-d848-4b27-9e2a-a55fa354904e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:47.630728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3642625-d848-4b27-9e2a-a55fa354904e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:47.634888 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efe66d-c3ae-4108-9e8c-66a7e0221661 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:47.641462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3642625-d848-4b27-9e2a-a55fa354904e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:47.643222 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3642625-d848-4b27-9e2a-a55fa354904e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-e3642625-d848-4b27-9e2a-a55fa354904e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:19:47.661294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:47.662480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:47.663469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:47.663469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:47.663469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:19:47.663469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:19:47.663469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:19:47.663469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:19:47.663469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:19:47.663469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:19:47.663469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:19:47.663469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:47.671541 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 261/553] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 18 10:19:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:19:47.672663 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490649c8-a156-4e60-9d32-4e5b8a224e34 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:47.672959 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490649c8-a156-4e60-9d32-4e5b8a224e34 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:47.673236 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490649c8-a156-4e60-9d32-4e5b8a224e34 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:47.675992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:47.679219 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 262/554] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:47.682352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490649c8-a156-4e60-9d32-4e5b8a224e34 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:47.711359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a0555-c5c8-454b-883b-2f247d0de82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:47.712431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a0555-c5c8-454b-883b-2f247d0de82a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:47.712903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a0555-c5c8-454b-883b-2f247d0de82a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:47.713303 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a0555-c5c8-454b-883b-2f247d0de82a None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:47.714851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a0555-c5c8-454b-883b-2f247d0de82a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:47.715224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a0555-c5c8-454b-883b-2f247d0de82a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:47.717646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a0555-c5c8-454b-883b-2f247d0de82a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:47.741475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 293/555] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:47.743535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799efd0a-0b29-401a-b7de-55f3900cba8c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:47.744066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799efd0a-0b29-401a-b7de-55f3900cba8c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:47.744427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799efd0a-0b29-401a-b7de-55f3900cba8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:47.767395 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-799efd0a-0b29-401a-b7de-55f3900cba8c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:47.769363 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-799efd0a-0b29-401a-b7de-55f3900cba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:47.862462 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 294/556] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:47.862462 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799efd0a-0b29-401a-b7de-55f3900cba8c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:47.903858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490649c8-a156-4e60-9d32-4e5b8a224e34 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:47.979914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b3c2c-a465-42d5-9e14-76e40f07d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:47.982702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3c2c-a465-42d5-9e14-76e40f07d074 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:47.983441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3c2c-a465-42d5-9e14-76e40f07d074 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:47.984711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3c2c-a465-42d5-9e14-76e40f07d074 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:47.987252 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b3c2c-a465-42d5-9e14-76e40f07d074 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:47.988022 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b3c2c-a465-42d5-9e14-76e40f07d074 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:47.992183 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b3c2c-a465-42d5-9e14-76e40f07d074 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:48.011995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799efd0a-0b29-401a-b7de-55f3900cba8c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:48.014778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:48.021659 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:48.038371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 263/557] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 18 10:19:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:48.038371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b3c2c-a465-42d5-9e14-76e40f07d074 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:48.063273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55239c6-fd8e-47d1-9d25-d52cdc56fdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:48.064382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55239c6-fd8e-47d1-9d25-d52cdc56fdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:48.064874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55239c6-fd8e-47d1-9d25-d52cdc56fdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:48.065364 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55239c6-fd8e-47d1-9d25-d52cdc56fdf9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:48.078473 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55239c6-fd8e-47d1-9d25-d52cdc56fdf9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:48.080864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55239c6-fd8e-47d1-9d25-d52cdc56fdf9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e55239c6-fd8e-47d1-9d25-d52cdc56fdf9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:19:48.116407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:48.117853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:48.118851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:48.118851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:48.118851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:19:48.118851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:19:48.118851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:19:48.118851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:19:48.118851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:19:48.118851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:19:48.118851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:19:48.118851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:48.119388 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 295/558] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:19:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:48.121237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55239c6-fd8e-47d1-9d25-d52cdc56fdf9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:48.188126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b3c2c-a465-42d5-9e14-76e40f07d074 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:48.226889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe41d54-1c52-4c16-9139-7712126c9a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:48.228083 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41d54-1c52-4c16-9139-7712126c9a31 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:48.228563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41d54-1c52-4c16-9139-7712126c9a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:48.229046 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41d54-1c52-4c16-9139-7712126c9a31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:48.241503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe41d54-1c52-4c16-9139-7712126c9a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-3fe41d54-1c52-4c16-9139-7712126c9a31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:48.250137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:48.251134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:48.252052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:48.252052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:48.252052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:48.252052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:48.252052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:48.252052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:48.252052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:48.252052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:48.252052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:48.252052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:48.252052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:48.252052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:48.254024 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55239c6-fd8e-47d1-9d25-d52cdc56fdf9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:48.255094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 264/559] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:48.256114 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe41d54-1c52-4c16-9139-7712126c9a31 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:48.292169 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635fd95-6340-43c5-b525-de2a1b0396a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:48.293061 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635fd95-6340-43c5-b525-de2a1b0396a1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:48.293868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635fd95-6340-43c5-b525-de2a1b0396a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:48.294193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635fd95-6340-43c5-b525-de2a1b0396a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:48.306071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635fd95-6340-43c5-b525-de2a1b0396a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:48.307598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635fd95-6340-43c5-b525-de2a1b0396a1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:48.322937 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:48.330967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e635fd95-6340-43c5-b525-de2a1b0396a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:48.330967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:48.330967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:48.330967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:48.330967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:48.330967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:48.330967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:48.330967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:48.330967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:48.330967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:48.330967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:48.330967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:48.330967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:48.330967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:48.330967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:48.336026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:48.336950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:48.336950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:48.336950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:48.336950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:48.336950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 296/560] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:48.336950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635fd95-6340-43c5-b525-de2a1b0396a1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:48.359207 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:48.374395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe41d54-1c52-4c16-9139-7712126c9a31 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:48.438869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8330254-affd-48dd-b46e-27c1905fc2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:48.440739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8330254-affd-48dd-b46e-27c1905fc2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:48.441235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8330254-affd-48dd-b46e-27c1905fc2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:48.441713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8330254-affd-48dd-b46e-27c1905fc2e1 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:48.443615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8330254-affd-48dd-b46e-27c1905fc2e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:48.444331 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8330254-affd-48dd-b46e-27c1905fc2e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:48.448093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8330254-affd-48dd-b46e-27c1905fc2e1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:48.480292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635fd95-6340-43c5-b525-de2a1b0396a1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:48.494406 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 265/561] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 18 10:19:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:48.495683 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8330254-affd-48dd-b46e-27c1905fc2e1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:48.535943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e2977-988c-4683-b26a-88d0365e1b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:48.536988 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e2977-988c-4683-b26a-88d0365e1b42 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:48.537466 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e2977-988c-4683-b26a-88d0365e1b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:48.537955 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e2977-988c-4683-b26a-88d0365e1b42 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:48.539056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e2977-988c-4683-b26a-88d0365e1b42 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:48.539576 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e2977-988c-4683-b26a-88d0365e1b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:48.541312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e2977-988c-4683-b26a-88d0365e1b42 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:48.551798 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 297/562] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:19:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:48.553023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e2977-988c-4683-b26a-88d0365e1b42 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:48.636361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8330254-affd-48dd-b46e-27c1905fc2e1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:48.647869 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:48.654545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:48.670547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e2977-988c-4683-b26a-88d0365e1b42 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:48.675879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b7b5c-a8c1-496a-9cd1-b6393c445f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:48.676579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b7b5c-a8c1-496a-9cd1-b6393c445f8b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:48.676862 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b7b5c-a8c1-496a-9cd1-b6393c445f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:48.677137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b7b5c-a8c1-496a-9cd1-b6393c445f8b None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:48.677857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b7b5c-a8c1-496a-9cd1-b6393c445f8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:48.678164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b7b5c-a8c1-496a-9cd1-b6393c445f8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:48.680042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b7b5c-a8c1-496a-9cd1-b6393c445f8b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:48.697928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 266/563] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:48.697928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b7b5c-a8c1-496a-9cd1-b6393c445f8b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:48.713217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6887082-7173-4863-b98f-f6a7e9f6cdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:48.713872 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6887082-7173-4863-b98f-f6a7e9f6cdbf None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:48.714261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6887082-7173-4863-b98f-f6a7e9f6cdbf None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:48.714463 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6887082-7173-4863-b98f-f6a7e9f6cdbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:48.791561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6887082-7173-4863-b98f-f6a7e9f6cdbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:48.793017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6887082-7173-4863-b98f-f6a7e9f6cdbf None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:48.807040 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b7b5c-a8c1-496a-9cd1-b6393c445f8b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:48.845342 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655399ea-fcda-43c4-93c3-65b68de69b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:48.846146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655399ea-fcda-43c4-93c3-65b68de69b9c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:48.846482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655399ea-fcda-43c4-93c3-65b68de69b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:48.846764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655399ea-fcda-43c4-93c3-65b68de69b9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:48.858913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655399ea-fcda-43c4-93c3-65b68de69b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:48.860498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655399ea-fcda-43c4-93c3-65b68de69b9c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:48.880852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-655399ea-fcda-43c4-93c3-65b68de69b9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:48.880852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:48.880852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:48.880852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:48.880852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:48.880852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:48.880852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:48.880852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:48.880852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:48.880852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:48.880852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:48.880852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:48.880852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:48.880852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:48.880852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:48.883256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:48.885038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:48.885038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:48.885038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:48.885038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:48.885038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 267/564] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:48.885038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ffe58-b876-4f8b-9710-e8c4c36723db None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:48.885038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ffe58-b876-4f8b-9710-e8c4c36723db None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:48.885038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ffe58-b876-4f8b-9710-e8c4c36723db None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:48.887606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 268/565] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:48.887606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ffe58-b876-4f8b-9710-e8c4c36723db None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:48.889618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:48.913150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 298/566] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:48.914089 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6887082-7173-4863-b98f-f6a7e9f6cdbf None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:48.923600 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:49.010972 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ffe58-b876-4f8b-9710-e8c4c36723db None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:49.033105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6887082-7173-4863-b98f-f6a7e9f6cdbf None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:49.049198 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9afbc-90e2-4481-a65a-9667dcae1a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:49.050001 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9afbc-90e2-4481-a65a-9667dcae1a26 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:49.050311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9afbc-90e2-4481-a65a-9667dcae1a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:49.050644 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9afbc-90e2-4481-a65a-9667dcae1a26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:49.058213 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9afbc-90e2-4481-a65a-9667dcae1a26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:49.060316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9afbc-90e2-4481-a65a-9667dcae1a26 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:49.070536 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc47288-ab5c-4af1-872d-d899288d0696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:49.071193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc47288-ab5c-4af1-872d-d899288d0696 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:49.071467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc47288-ab5c-4af1-872d-d899288d0696 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:49.071736 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc47288-ab5c-4af1-872d-d899288d0696 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:49.072445 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc47288-ab5c-4af1-872d-d899288d0696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:49.072738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc47288-ab5c-4af1-872d-d899288d0696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:49.074086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc47288-ab5c-4af1-872d-d899288d0696 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:49.075870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-00c9afbc-90e2-4481-a65a-9667dcae1a26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:49.075870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:49.075870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:49.075870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:49.075870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:49.075870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:49.075870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:49.075870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:49.075870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:49.075870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:49.075870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:49.075870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:49.075870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:19:49.075870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:19:49.075870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:49.077500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:49.079689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:19:49.079689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:19:49.079689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:19:49.079689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:19:49.079689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:19:49.079689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:19:49.079689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:49.079689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:49.079689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 269/567] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:49.079689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f3fbf-ac41-49f7-afd5-744afeb8435c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:49.079689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f3fbf-ac41-49f7-afd5-744afeb8435c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:49.081142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f3fbf-ac41-49f7-afd5-744afeb8435c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:49.098178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 299/568] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:49.100408 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78a862-a9cc-4670-99b2-d3e656829cd2 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:49.100961 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78a862-a9cc-4670-99b2-d3e656829cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:49.101508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78a862-a9cc-4670-99b2-d3e656829cd2 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:49.103763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 300/569] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:49.104457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78a862-a9cc-4670-99b2-d3e656829cd2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:49.108650 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-269f3fbf-ac41-49f7-afd5-744afeb8435c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:49.110856 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-269f3fbf-ac41-49f7-afd5-744afeb8435c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:49.151511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:49.188542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 270/570] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:49.190207 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f3fbf-ac41-49f7-afd5-744afeb8435c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:49.220310 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78a862-a9cc-4670-99b2-d3e656829cd2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:49.225356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:49.259469 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1089c-609e-46c9-9ce5-a178ff3027aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:49.260260 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1089c-609e-46c9-9ce5-a178ff3027aa None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:49.260542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1089c-609e-46c9-9ce5-a178ff3027aa None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:49.260838 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1089c-609e-46c9-9ce5-a178ff3027aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:49.272796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1089c-609e-46c9-9ce5-a178ff3027aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:49.274476 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1089c-609e-46c9-9ce5-a178ff3027aa None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:49.293109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-9ec1089c-609e-46c9-9ce5-a178ff3027aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:49.293109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:49.293109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:49.293109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:49.293109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:49.293109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:49.293109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:49.293109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:49.293109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:49.293109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:49.293109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:49.293109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:49.293109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:49.293109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:49.293109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:49.294973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:49.296764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:49.296764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:49.296764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:49.296764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:49.296764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 301/571] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:49.296764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1089c-609e-46c9-9ce5-a178ff3027aa None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:49.320663 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f3fbf-ac41-49f7-afd5-744afeb8435c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:49.359470 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18877b-f69d-49dc-a0e2-8fe4c884f606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:49.360408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18877b-f69d-49dc-a0e2-8fe4c884f606 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:49.360793 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18877b-f69d-49dc-a0e2-8fe4c884f606 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:49.361161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18877b-f69d-49dc-a0e2-8fe4c884f606 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:49.362028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18877b-f69d-49dc-a0e2-8fe4c884f606 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:49.362529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18877b-f69d-49dc-a0e2-8fe4c884f606 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:49.364087 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18877b-f69d-49dc-a0e2-8fe4c884f606 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:49.381541 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 271/572] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:19:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:49.383080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4e810-2e17-48e9-b5c5-5333cc41ed5f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:49.383390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4e810-2e17-48e9-b5c5-5333cc41ed5f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:49.383708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4e810-2e17-48e9-b5c5-5333cc41ed5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:49.400449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:49.401238 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-dbf4e810-2e17-48e9-b5c5-5333cc41ed5f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:49.409963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-dbf4e810-2e17-48e9-b5c5-5333cc41ed5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:49.410187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1089c-609e-46c9-9ce5-a178ff3027aa None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:49.450276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934509f-49ff-4590-889f-2298ec08cf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:49.451104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934509f-49ff-4590-889f-2298ec08cf2d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:49.451383 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934509f-49ff-4590-889f-2298ec08cf2d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:49.451666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934509f-49ff-4590-889f-2298ec08cf2d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:49.459154 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934509f-49ff-4590-889f-2298ec08cf2d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:49.460639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934509f-49ff-4590-889f-2298ec08cf2d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:49.479682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 272/573] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:49.480520 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4e810-2e17-48e9-b5c5-5333cc41ed5f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:49.499536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-c934509f-49ff-4590-889f-2298ec08cf2d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:19:49.502456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:49.504274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:49.507285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:49.507285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:49.507285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:19:49.507285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:19:49.507285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:19:49.507285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:19:49.507285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:19:49.507285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:19:49.507285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 10:19:49.507285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:49.507285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 302/574] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:49.507285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934509f-49ff-4590-889f-2298ec08cf2d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:49.617679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4e810-2e17-48e9-b5c5-5333cc41ed5f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:49.654513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934509f-49ff-4590-889f-2298ec08cf2d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:49.665200 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf673a5-1ec7-4c9f-8a60-f089f32b4d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:49.666436 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf673a5-1ec7-4c9f-8a60-f089f32b4d29 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:49.666866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf673a5-1ec7-4c9f-8a60-f089f32b4d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:49.667208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf673a5-1ec7-4c9f-8a60-f089f32b4d29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:49.684645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf673a5-1ec7-4c9f-8a60-f089f32b4d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-5bf673a5-1ec7-4c9f-8a60-f089f32b4d29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:49.698309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:49.699308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:49.701140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:49.701140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:49.701140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:49.701140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:49.701140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:49.701140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:49.701140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:49.701140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:49.701140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:49.701140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:49.701140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:49.701140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:49.701140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 273/575] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:49.702255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf673a5-1ec7-4c9f-8a60-f089f32b4d29 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:49.716280 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de84d-fd41-4e10-b39b-ea91d75c14dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:49.717536 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de84d-fd41-4e10-b39b-ea91d75c14dd None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:49.717892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de84d-fd41-4e10-b39b-ea91d75c14dd None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:49.718376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de84d-fd41-4e10-b39b-ea91d75c14dd None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:49.719639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572de84d-fd41-4e10-b39b-ea91d75c14dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:49.720073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572de84d-fd41-4e10-b39b-ea91d75c14dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:49.722307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572de84d-fd41-4e10-b39b-ea91d75c14dd None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:49.742318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 303/576] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:49.743492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de84d-fd41-4e10-b39b-ea91d75c14dd None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:49.770079 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:49.797243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:49.840277 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf673a5-1ec7-4c9f-8a60-f089f32b4d29 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:49.869839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de84d-fd41-4e10-b39b-ea91d75c14dd None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:49.881099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffa44e-ab04-425a-a331-282196849ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:49.882279 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffa44e-ab04-425a-a331-282196849ee3 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:49.882988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffa44e-ab04-425a-a331-282196849ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:49.883411 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffa44e-ab04-425a-a331-282196849ee3 None admin] PATH_INFO: `/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/f7abf6b71ac3454ca547a750cef9220a/roles/509fcb6f06144cdd9803fb3910eb80bf` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:49.901014 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffa44e-ab04-425a-a331-282196849ee3 None admin] RBAC: Authorizing `identity:create_grant(project_id=40e0b5ee15df481cbc01333131f3def0, user_id=f7abf6b71ac3454ca547a750cef9220a, role_id=509fcb6f06144cdd9803fb3910eb80bf)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:49.902541 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffa44e-ab04-425a-a331-282196849ee3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:49.911209 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d1ecb-1254-4aa8-97ba-e5e2cd21623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:49.912188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d1ecb-1254-4aa8-97ba-e5e2cd21623b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:49.917105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d1ecb-1254-4aa8-97ba-e5e2cd21623b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:49.917105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d1ecb-1254-4aa8-97ba-e5e2cd21623b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:49.924379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d1ecb-1254-4aa8-97ba-e5e2cd21623b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-9c3d1ecb-1254-4aa8-97ba-e5e2cd21623b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:49.932418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:49.934153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:49.935051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:49.935051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:49.935051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:49.935051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:49.935051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:49.935051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:49.935051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:49.935051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:49.935051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:49.935051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:49.935051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:49.935051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:49.935051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 304/577] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:49.935051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d1ecb-1254-4aa8-97ba-e5e2cd21623b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:49.968769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 274/578] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:19:49 2022] PUT /identity/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/f7abf6b71ac3454ca547a750cef9220a/roles/509fcb6f06144cdd9803fb3910eb80bf => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:19:49.969622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffa44e-ab04-425a-a331-282196849ee3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:50.038630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:50.087177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d1ecb-1254-4aa8-97ba-e5e2cd21623b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:50.109356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffa44e-ab04-425a-a331-282196849ee3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:50.138470 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:50.144296 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7116d-5478-4e13-bb8c-403e58c7ebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:50.145170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7116d-5478-4e13-bb8c-403e58c7ebb8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:50.145594 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7116d-5478-4e13-bb8c-403e58c7ebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:50.146070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7116d-5478-4e13-bb8c-403e58c7ebb8 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:50.147123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7116d-5478-4e13-bb8c-403e58c7ebb8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:50.152017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7116d-5478-4e13-bb8c-403e58c7ebb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:50.152017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7116d-5478-4e13-bb8c-403e58c7ebb8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:50.160419 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f040ac-8f2e-423a-858d-65e228afb313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:50.161105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f040ac-8f2e-423a-858d-65e228afb313 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:50.161385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f040ac-8f2e-423a-858d-65e228afb313 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:50.161684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f040ac-8f2e-423a-858d-65e228afb313 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:50.162490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f040ac-8f2e-423a-858d-65e228afb313 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:50.162799 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f040ac-8f2e-423a-858d-65e228afb313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:50.164299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f040ac-8f2e-423a-858d-65e228afb313 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:50.174195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 275/579] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:19:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:50.175375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f040ac-8f2e-423a-858d-65e228afb313 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:50.183057 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 305/580] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 18 10:19:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:50.185525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7116d-5478-4e13-bb8c-403e58c7ebb8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:50.318791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f040ac-8f2e-423a-858d-65e228afb313 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:50.343188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7116d-5478-4e13-bb8c-403e58c7ebb8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:50.364777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0e562-8dac-40d5-a6b3-60c34ac1428d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:50.366092 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0e562-8dac-40d5-a6b3-60c34ac1428d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:50.366605 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0e562-8dac-40d5-a6b3-60c34ac1428d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:50.367078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0e562-8dac-40d5-a6b3-60c34ac1428d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:50.377670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:50.379636 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0e562-8dac-40d5-a6b3-60c34ac1428d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:50.382250 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0e562-8dac-40d5-a6b3-60c34ac1428d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:50.384287 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d2be8-d041-4a3b-bba5-5c88a0b0f350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:50.384969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d2be8-d041-4a3b-bba5-5c88a0b0f350 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:50.385258 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d2be8-d041-4a3b-bba5-5c88a0b0f350 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:50.385707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d2be8-d041-4a3b-bba5-5c88a0b0f350 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:50.386491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d2be8-d041-4a3b-bba5-5c88a0b0f350 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:50.386809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d2be8-d041-4a3b-bba5-5c88a0b0f350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:50.389083 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d2be8-d041-4a3b-bba5-5c88a0b0f350 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:50.400647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-9fb0e562-8dac-40d5-a6b3-60c34ac1428d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:50.400647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:50.400647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:50.400647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:50.400647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:50.400647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:50.400647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:50.400647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:50.400647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:50.400647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:50.400647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:50.400647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:50.400647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:19:50.400647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:19:50.400647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:50.402460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:50.407098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:19:50.407098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:19:50.407098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:19:50.407098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:19:50.407098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:19:50.407098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:19:50.407098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:50.407098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:50.408883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 306/581] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:19:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:50.408883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d2be8-d041-4a3b-bba5-5c88a0b0f350 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:50.410839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 276/582] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:50.410839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0e562-8dac-40d5-a6b3-60c34ac1428d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:50.461345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:50.528165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0e562-8dac-40d5-a6b3-60c34ac1428d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:50.529155 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d2be8-d041-4a3b-bba5-5c88a0b0f350 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:50.568893 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c6022-7134-45a5-8ca4-7135ecd90626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:50.569180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac537ee5-1440-4966-9965-982cd1a12d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:50.569830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c6022-7134-45a5-8ca4-7135ecd90626 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:50.569994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac537ee5-1440-4966-9965-982cd1a12d10 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:50.570224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac537ee5-1440-4966-9965-982cd1a12d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:50.570505 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c6022-7134-45a5-8ca4-7135ecd90626 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:50.570656 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac537ee5-1440-4966-9965-982cd1a12d10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:50.570802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c6022-7134-45a5-8ca4-7135ecd90626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:50.582567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c6022-7134-45a5-8ca4-7135ecd90626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:50.584054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c6022-7134-45a5-8ca4-7135ecd90626 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:50.584250 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac537ee5-1440-4966-9965-982cd1a12d10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:50.585774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac537ee5-1440-4966-9965-982cd1a12d10 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:50.603343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-6f8c6022-7134-45a5-8ca4-7135ecd90626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:50.603343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:50.603343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:50.603343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:50.603343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:50.603343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:50.603343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:50.603343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:50.603343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:50.603343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:50.603343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:50.603343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:50.603343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:50.603343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:50.603343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:50.612771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:50.614991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:50.614991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:50.614991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:50.614991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:50.614991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 277/583] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:50.614991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c6022-7134-45a5-8ca4-7135ecd90626 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:50.616111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-ac537ee5-1440-4966-9965-982cd1a12d10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:50.616111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:50.616111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:50.616111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:50.616111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:50.616111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:50.616111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:50.616111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:50.616111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:50.616111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:50.616111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:50.616111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:50.616111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:50.616111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:50.616111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:50.619924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:50.623320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:50.623320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:50.623320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:50.623320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:50.623320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 307/584] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:50.623320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac537ee5-1440-4966-9965-982cd1a12d10 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:50.682733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:50.723049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:50.734556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c6022-7134-45a5-8ca4-7135ecd90626 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:50.751804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac537ee5-1440-4966-9965-982cd1a12d10 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:50.780056 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4dccd3-1014-490f-b841-553bfdaaa88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:50.780839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dccd3-1014-490f-b841-553bfdaaa88d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:50.781120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dccd3-1014-490f-b841-553bfdaaa88d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:50.781394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dccd3-1014-490f-b841-553bfdaaa88d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:50.791348 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f7a29-a40e-4d33-b153-ab441594c81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:50.792105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f7a29-a40e-4d33-b153-ab441594c81d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:50.792453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f7a29-a40e-4d33-b153-ab441594c81d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:50.792800 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f7a29-a40e-4d33-b153-ab441594c81d None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:50.792954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4dccd3-1014-490f-b841-553bfdaaa88d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:50.794408 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f7a29-a40e-4d33-b153-ab441594c81d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:50.794790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f7a29-a40e-4d33-b153-ab441594c81d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:50.795419 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4dccd3-1014-490f-b841-553bfdaaa88d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:50.796367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f7a29-a40e-4d33-b153-ab441594c81d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:50.817761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 308/585] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:50.817761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f7a29-a40e-4d33-b153-ab441594c81d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:50.818159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-2d4dccd3-1014-490f-b841-553bfdaaa88d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:50.818159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:50.818159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:50.818159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:50.818159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:50.818159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:50.818159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:50.818159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:50.818159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:50.818159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:50.818159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:50.818159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:50.818159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:50.818159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:50.818159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:50.819761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:50.822435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:50.822435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:50.822435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:50.822435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:50.822435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 278/586] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:50.822435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4dccd3-1014-490f-b841-553bfdaaa88d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:50.947180 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4dccd3-1014-490f-b841-553bfdaaa88d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:50.960422 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f7a29-a40e-4d33-b153-ab441594c81d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:50.963180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:50.988097 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f8a2b-d0ad-47e5-b606-eb911d8575a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:50.988774 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f8a2b-d0ad-47e5-b606-eb911d8575a0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:50.989055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f8a2b-d0ad-47e5-b606-eb911d8575a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:50.989330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f8a2b-d0ad-47e5-b606-eb911d8575a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:50.990053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f8a2b-d0ad-47e5-b606-eb911d8575a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:50.990382 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f8a2b-d0ad-47e5-b606-eb911d8575a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:50.991790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f8a2b-d0ad-47e5-b606-eb911d8575a0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:51.003910 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4745f-3d4a-475b-b5bf-23467d341d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:51.004578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4745f-3d4a-475b-b5bf-23467d341d13 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:51.004864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4745f-3d4a-475b-b5bf-23467d341d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:51.005137 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4745f-3d4a-475b-b5bf-23467d341d13 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:51.005858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4745f-3d4a-475b-b5bf-23467d341d13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:51.006164 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4745f-3d4a-475b-b5bf-23467d341d13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:51.014457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4745f-3d4a-475b-b5bf-23467d341d13 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:51.014667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 279/587] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:51.014667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f8a2b-d0ad-47e5-b606-eb911d8575a0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:51.015721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:51.029891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 309/588] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:51.032010 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4745f-3d4a-475b-b5bf-23467d341d13 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:51.131984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f8a2b-d0ad-47e5-b606-eb911d8575a0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:51.163876 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4745f-3d4a-475b-b5bf-23467d341d13 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:51.179639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934003b-54df-4a22-abc9-2887c4e9a303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:51.180584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934003b-54df-4a22-abc9-2887c4e9a303 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:51.181230 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934003b-54df-4a22-abc9-2887c4e9a303 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:51.181685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934003b-54df-4a22-abc9-2887c4e9a303 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:51.182967 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934003b-54df-4a22-abc9-2887c4e9a303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:51.183566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934003b-54df-4a22-abc9-2887c4e9a303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:51.186061 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934003b-54df-4a22-abc9-2887c4e9a303 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:51.208950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 280/589] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:51.208950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934003b-54df-4a22-abc9-2887c4e9a303 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:51.211628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0df949-abfe-445d-8eaa-639e38524018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:51.212550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0df949-abfe-445d-8eaa-639e38524018 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:51.213005 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0df949-abfe-445d-8eaa-639e38524018 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:51.213449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0df949-abfe-445d-8eaa-639e38524018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:51.214960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0df949-abfe-445d-8eaa-639e38524018 None admin] RBAC: Adding query filter params (role.id=509fcb6f06144cdd9803fb3910eb80bf, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=a8ee2beff1a7487d92c1c5940f2784f1) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:51.216285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0df949-abfe-445d-8eaa-639e38524018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:51.218827 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0df949-abfe-445d-8eaa-639e38524018 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:51.227075 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 310/590] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:19:51 2022] GET /identity/v3/role_assignments?user.id=a8ee2beff1a7487d92c1c5940f2784f1&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=509fcb6f06144cdd9803fb3910eb80bf => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:51.228187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0df949-abfe-445d-8eaa-639e38524018 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:51.273576 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:51.315428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:51.372107 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934003b-54df-4a22-abc9-2887c4e9a303 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:51.407237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0df949-abfe-445d-8eaa-639e38524018 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:51.422277 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47de541-5d46-4ad0-870c-a844476f3dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:51.423656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47de541-5d46-4ad0-870c-a844476f3dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:51.424954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47de541-5d46-4ad0-870c-a844476f3dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:51.425460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47de541-5d46-4ad0-870c-a844476f3dd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:51.436259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47de541-5d46-4ad0-870c-a844476f3dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:51.438812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47de541-5d46-4ad0-870c-a844476f3dd2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:51.460715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-f47de541-5d46-4ad0-870c-a844476f3dd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:51.460715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:51.460715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:51.460715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:51.460715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:51.460715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:51.460715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:51.460715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:51.460715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:51.460715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:51.460715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:51.460715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:51.460715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:19:51.460715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:19:51.460715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:51.461692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:51.463427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:19:51.463427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:19:51.463427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:19:51.463427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:19:51.463427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:19:51.463427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:19:51.463427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:51.463427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:51.470128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 281/591] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:51.470128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47de541-5d46-4ad0-870c-a844476f3dd2 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:51.491312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235f333-5e01-4e75-9415-c16cecff96cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:51.492598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235f333-5e01-4e75-9415-c16cecff96cf None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:51.492966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235f333-5e01-4e75-9415-c16cecff96cf None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:51.493285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235f333-5e01-4e75-9415-c16cecff96cf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:51.507373 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235f333-5e01-4e75-9415-c16cecff96cf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:51.509551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235f333-5e01-4e75-9415-c16cecff96cf None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-c235f333-5e01-4e75-9415-c16cecff96cf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:19:51.527642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:51.528679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:51.529785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:51.529785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:51.529785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:19:51.529785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:19:51.529785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:19:51.529785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:19:51.529785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:19:51.529785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:19:51.529785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 10:19:51.529785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:51.532200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 311/592] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:51.533197 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235f333-5e01-4e75-9415-c16cecff96cf None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:51.638209 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:51.652346 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235f333-5e01-4e75-9415-c16cecff96cf None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:51.664312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47de541-5d46-4ad0-870c-a844476f3dd2 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:51.696264 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845650b-eecb-461a-a871-591141903c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:51.697753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845650b-eecb-461a-a871-591141903c20 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:51.698187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845650b-eecb-461a-a871-591141903c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:51.698639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845650b-eecb-461a-a871-591141903c20 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:51.699842 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845650b-eecb-461a-a871-591141903c20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:51.700312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845650b-eecb-461a-a871-591141903c20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:51.701993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845650b-eecb-461a-a871-591141903c20 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:51.711273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:51.717913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 312/593] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:19:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:51.719115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845650b-eecb-461a-a871-591141903c20 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:51.740258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5f3e1-933a-4b8a-9bcc-45e427713f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:51.741660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5f3e1-933a-4b8a-9bcc-45e427713f7c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:51.742363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5f3e1-933a-4b8a-9bcc-45e427713f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:51.742993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5f3e1-933a-4b8a-9bcc-45e427713f7c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:51.757339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5f3e1-933a-4b8a-9bcc-45e427713f7c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:51.760434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5f3e1-933a-4b8a-9bcc-45e427713f7c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-ccf5f3e1-933a-4b8a-9bcc-45e427713f7c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:19:51.787607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:51.788646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:51.789580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:51.789580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:51.789580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:19:51.789580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:19:51.789580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:19:51.789580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:19:51.789580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:19:51.789580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:19:51.789580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:19:51.789580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:51.794441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 282/594] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:51.795815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5f3e1-933a-4b8a-9bcc-45e427713f7c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:51.844400 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845650b-eecb-461a-a871-591141903c20 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:51.883694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354be8a-c89b-4285-b50c-56d69299c64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:51.884751 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354be8a-c89b-4285-b50c-56d69299c64b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:51.885220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354be8a-c89b-4285-b50c-56d69299c64b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:51.885704 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354be8a-c89b-4285-b50c-56d69299c64b None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:51.886761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354be8a-c89b-4285-b50c-56d69299c64b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:51.887790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354be8a-c89b-4285-b50c-56d69299c64b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:51.889882 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354be8a-c89b-4285-b50c-56d69299c64b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:51.911115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 313/595] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Jul 18 10:19:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:51.912379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354be8a-c89b-4285-b50c-56d69299c64b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:51.934129 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:51.961256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5f3e1-933a-4b8a-9bcc-45e427713f7c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:51.998003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de54f45-dfd9-441a-8e92-ff1b8084f1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:51.998918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de54f45-dfd9-441a-8e92-ff1b8084f1aa None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:51.999197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de54f45-dfd9-441a-8e92-ff1b8084f1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:51.999470 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de54f45-dfd9-441a-8e92-ff1b8084f1aa None admin] PATH_INFO: `/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/7f93de99555742ca9bd99d707d1cdbee/roles/509fcb6f06144cdd9803fb3910eb80bf` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:52.015413 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de54f45-dfd9-441a-8e92-ff1b8084f1aa None admin] RBAC: Authorizing `identity:create_grant(project_id=40e0b5ee15df481cbc01333131f3def0, user_id=7f93de99555742ca9bd99d707d1cdbee, role_id=509fcb6f06144cdd9803fb3910eb80bf)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:52.016877 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de54f45-dfd9-441a-8e92-ff1b8084f1aa None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:52.111732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354be8a-c89b-4285-b50c-56d69299c64b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:52.129856 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 283/596] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:19:51 2022] PUT /identity/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/7f93de99555742ca9bd99d707d1cdbee/roles/509fcb6f06144cdd9803fb3910eb80bf => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:19:52.130990 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de54f45-dfd9-441a-8e92-ff1b8084f1aa None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:52.177423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:52.220980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ff9a6-1bb3-4764-826a-acb02d2eb40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:52.222133 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ff9a6-1bb3-4764-826a-acb02d2eb40d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:52.222668 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ff9a6-1bb3-4764-826a-acb02d2eb40d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:52.223170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ff9a6-1bb3-4764-826a-acb02d2eb40d None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:52.224808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ff9a6-1bb3-4764-826a-acb02d2eb40d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:52.225355 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ff9a6-1bb3-4764-826a-acb02d2eb40d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:52.236476 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ff9a6-1bb3-4764-826a-acb02d2eb40d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:52.265619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de54f45-dfd9-441a-8e92-ff1b8084f1aa None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:52.298213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 314/597] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 18 10:19:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:52.306572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ff9a6-1bb3-4764-826a-acb02d2eb40d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:52.316456 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da3bf3-4606-4ea1-a9c7-763593d3b7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:52.317425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da3bf3-4606-4ea1-a9c7-763593d3b7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:52.317710 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da3bf3-4606-4ea1-a9c7-763593d3b7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:52.317988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da3bf3-4606-4ea1-a9c7-763593d3b7f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:52.334899 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da3bf3-4606-4ea1-a9c7-763593d3b7f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:52.336759 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da3bf3-4606-4ea1-a9c7-763593d3b7f4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:52.362135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-b9da3bf3-4606-4ea1-a9c7-763593d3b7f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:52.362135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:52.362135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:52.362135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:52.362135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:52.362135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:52.362135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:52.362135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:52.362135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:52.362135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:52.362135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:52.362135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:52.362135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:52.362135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:52.362135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:52.363765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:52.365389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:52.365389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:52.365389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:52.365389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:52.365389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 284/598] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:52.365389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2299dc-f0b3-448c-8aa8-6364b1be2372 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:52.365389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2299dc-f0b3-448c-8aa8-6364b1be2372 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:52.365389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2299dc-f0b3-448c-8aa8-6364b1be2372 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:52.367326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 285/599] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:52.374129 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6bebd-51fe-451c-8b75-ac80385c348d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:52.374567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6bebd-51fe-451c-8b75-ac80385c348d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:52.374814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6bebd-51fe-451c-8b75-ac80385c348d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:52.397011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:52.399521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-edd6bebd-51fe-451c-8b75-ac80385c348d None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:52.400978 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-edd6bebd-51fe-451c-8b75-ac80385c348d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:52.463270 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ff9a6-1bb3-4764-826a-acb02d2eb40d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:52.530965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf1e36-dda3-4ccf-9cfa-dce653ae44b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:52.532156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf1e36-dda3-4ccf-9cfa-dce653ae44b8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:52.532602 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf1e36-dda3-4ccf-9cfa-dce653ae44b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:52.533019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf1e36-dda3-4ccf-9cfa-dce653ae44b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:52.533871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 286/600] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:52.535581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6bebd-51fe-451c-8b75-ac80385c348d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:52.554622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf1e36-dda3-4ccf-9cfa-dce653ae44b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:52.557853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf1e36-dda3-4ccf-9cfa-dce653ae44b8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:52.572067 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:52.593637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-eeaf1e36-dda3-4ccf-9cfa-dce653ae44b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:52.593637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:52.593637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:52.593637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:52.593637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:52.593637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:52.593637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:52.593637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:52.593637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:52.593637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:52.593637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:52.593637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:52.593637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:52.593637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:52.593637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:52.595382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:52.597088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:52.597088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:52.597088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:52.597088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:52.600585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 315/601] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:19:52.602516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf1e36-dda3-4ccf-9cfa-dce653ae44b8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:52.727283 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6bebd-51fe-451c-8b75-ac80385c348d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:52.793164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ade4af-6323-4426-8d5a-6bc22635cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:52.794062 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf1e36-dda3-4ccf-9cfa-dce653ae44b8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:52.796272 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade4af-6323-4426-8d5a-6bc22635cbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:52.797116 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade4af-6323-4426-8d5a-6bc22635cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:52.797880 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade4af-6323-4426-8d5a-6bc22635cbd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:52.799567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ade4af-6323-4426-8d5a-6bc22635cbd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:52.800443 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ade4af-6323-4426-8d5a-6bc22635cbd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:52.803224 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ade4af-6323-4426-8d5a-6bc22635cbd3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:52.822553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:52.834676 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 287/602] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:52.836638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ade4af-6323-4426-8d5a-6bc22635cbd3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:52.858392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e854988-4072-4144-a7fd-ea08c2aa1a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:52.858392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e854988-4072-4144-a7fd-ea08c2aa1a25 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:52.858392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e854988-4072-4144-a7fd-ea08c2aa1a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:52.858392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e854988-4072-4144-a7fd-ea08c2aa1a25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:52.879961 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e854988-4072-4144-a7fd-ea08c2aa1a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-6e854988-4072-4144-a7fd-ea08c2aa1a25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:52.894556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:52.896096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:52.897442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:52.897442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:52.897442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:52.897442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:52.897442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:52.897442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:52.897442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:52.897442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:52.897442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:52.897442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:52.897442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:52.897442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:52.899841 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 316/603] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:52.900438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e854988-4072-4144-a7fd-ea08c2aa1a25 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:53.038981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:53.055232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ade4af-6323-4426-8d5a-6bc22635cbd3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:53.105593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e854988-4072-4144-a7fd-ea08c2aa1a25 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:53.117325 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ace6e7-0de7-4b16-a1c8-a5449ee9628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:53.118437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ace6e7-0de7-4b16-a1c8-a5449ee9628d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:53.118937 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ace6e7-0de7-4b16-a1c8-a5449ee9628d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:53.119434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ace6e7-0de7-4b16-a1c8-a5449ee9628d None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:53.120946 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ace6e7-0de7-4b16-a1c8-a5449ee9628d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:53.121980 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ace6e7-0de7-4b16-a1c8-a5449ee9628d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:53.124955 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ace6e7-0de7-4b16-a1c8-a5449ee9628d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:53.147997 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 288/604] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:53.149761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ace6e7-0de7-4b16-a1c8-a5449ee9628d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:53.179095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7b86-af8b-45b1-a76e-65a28216c262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:53.180693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7b86-af8b-45b1-a76e-65a28216c262 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:53.180943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7b86-af8b-45b1-a76e-65a28216c262 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:53.181428 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7b86-af8b-45b1-a76e-65a28216c262 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:53.194724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f7b86-af8b-45b1-a76e-65a28216c262 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:53.197387 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f7b86-af8b-45b1-a76e-65a28216c262 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:53.225780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-0f4f7b86-af8b-45b1-a76e-65a28216c262 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:53.225780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:53.225780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:53.225780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:53.225780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:53.225780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:53.225780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:53.225780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:53.225780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:53.225780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:53.225780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:53.225780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:53.225780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:19:53.225780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:19:53.225780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:53.227251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:53.229533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:19:53.229533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:19:53.229533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:19:53.229533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:19:53.229533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:19:53.229533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:19:53.229533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:53.229533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:53.229533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 317/605] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:53.230725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7b86-af8b-45b1-a76e-65a28216c262 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:53.293334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:53.346793 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ace6e7-0de7-4b16-a1c8-a5449ee9628d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:53.414127 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18605ce7-3492-4e2c-bee1-6fe1aba60802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:53.415777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605ce7-3492-4e2c-bee1-6fe1aba60802 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:53.416439 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605ce7-3492-4e2c-bee1-6fe1aba60802 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:53.417499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18605ce7-3492-4e2c-bee1-6fe1aba60802 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:53.419527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18605ce7-3492-4e2c-bee1-6fe1aba60802 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:53.420289 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18605ce7-3492-4e2c-bee1-6fe1aba60802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:53.422121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7b86-af8b-45b1-a76e-65a28216c262 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:53.423224 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18605ce7-3492-4e2c-bee1-6fe1aba60802 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:53.428804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:53.443068 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 289/606] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:19:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:53.444756 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18605ce7-3492-4e2c-bee1-6fe1aba60802 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:53.500946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbe5ec-4163-4a5a-af45-8bcff186019f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:53.503246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbe5ec-4163-4a5a-af45-8bcff186019f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:53.503995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbe5ec-4163-4a5a-af45-8bcff186019f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:53.504608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbe5ec-4163-4a5a-af45-8bcff186019f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:53.519379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbe5ec-4163-4a5a-af45-8bcff186019f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:53.522013 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbe5ec-4163-4a5a-af45-8bcff186019f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:53.553760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-d6fbe5ec-4163-4a5a-af45-8bcff186019f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:53.553760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:53.553760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:53.553760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:53.553760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:53.553760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:53.553760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:53.553760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:53.553760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:53.553760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:53.553760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:53.553760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:53.553760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:19:53.553760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:19:53.553760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:53.555523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:53.557288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:19:53.557288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:19:53.557288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:19:53.557288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:19:53.557288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:19:53.557288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:19:53.557288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:53.557288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:53.562702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 318/607] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:53.564323 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbe5ec-4163-4a5a-af45-8bcff186019f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:53.651299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18605ce7-3492-4e2c-bee1-6fe1aba60802 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:53.717593 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f52e4-cef6-4cae-a80f-c658bdaf9928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:53.718836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f52e4-cef6-4cae-a80f-c658bdaf9928 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:53.719454 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f52e4-cef6-4cae-a80f-c658bdaf9928 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:53.720059 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f52e4-cef6-4cae-a80f-c658bdaf9928 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:53.721744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f52e4-cef6-4cae-a80f-c658bdaf9928 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:53.722492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f52e4-cef6-4cae-a80f-c658bdaf9928 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:53.725385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f52e4-cef6-4cae-a80f-c658bdaf9928 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:53.745412 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:53.749039 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 290/608] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:53.750826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f52e4-cef6-4cae-a80f-c658bdaf9928 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:53.757184 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbe5ec-4163-4a5a-af45-8bcff186019f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:53.825434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba838fd-6403-4fdf-984d-6c6c5832ec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:53.826905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba838fd-6403-4fdf-984d-6c6c5832ec84 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:53.827552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba838fd-6403-4fdf-984d-6c6c5832ec84 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:53.828175 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba838fd-6403-4fdf-984d-6c6c5832ec84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:53.848696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba838fd-6403-4fdf-984d-6c6c5832ec84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:53.851680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba838fd-6403-4fdf-984d-6c6c5832ec84 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:53.869752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:53.888681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-9ba838fd-6403-4fdf-984d-6c6c5832ec84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:53.888681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:53.888681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:53.888681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:53.888681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:53.888681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:53.888681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:53.888681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:53.888681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:53.888681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:53.888681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:53.888681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:53.888681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:53.888681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:53.888681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:53.889676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:53.890611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:53.890611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:53.890611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:53.890611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:53.894431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 319/609] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:53.894431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba838fd-6403-4fdf-984d-6c6c5832ec84 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:53.949704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f52e4-cef6-4cae-a80f-c658bdaf9928 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:54.004362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edd0b1-8166-4625-b1d3-0957e8dcc924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:54.005046 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edd0b1-8166-4625-b1d3-0957e8dcc924 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:54.005343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edd0b1-8166-4625-b1d3-0957e8dcc924 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:54.005597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edd0b1-8166-4625-b1d3-0957e8dcc924 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:54.006810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edd0b1-8166-4625-b1d3-0957e8dcc924 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:54.006810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edd0b1-8166-4625-b1d3-0957e8dcc924 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:54.008486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edd0b1-8166-4625-b1d3-0957e8dcc924 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:54.031548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 291/610] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:54.031548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330c581-43f4-403b-9be6-1b698c3749c0 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:54.031548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330c581-43f4-403b-9be6-1b698c3749c0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:54.031548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330c581-43f4-403b-9be6-1b698c3749c0 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:54.031548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 292/611] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:54.031548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330c581-43f4-403b-9be6-1b698c3749c0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:54.058483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba838fd-6403-4fdf-984d-6c6c5832ec84 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:54.117877 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ceb17a-f4ef-43d1-b017-a8da5f1ef399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:54.119226 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceb17a-f4ef-43d1-b017-a8da5f1ef399 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:54.119679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceb17a-f4ef-43d1-b017-a8da5f1ef399 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:54.120094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceb17a-f4ef-43d1-b017-a8da5f1ef399 None admin] PATH_INFO: `/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/3f9385dec85a4e0cba21c2a840124f5a/roles/509fcb6f06144cdd9803fb3910eb80bf` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:54.145541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ceb17a-f4ef-43d1-b017-a8da5f1ef399 None admin] RBAC: Authorizing `identity:create_grant(project_id=40e0b5ee15df481cbc01333131f3def0, user_id=3f9385dec85a4e0cba21c2a840124f5a, role_id=509fcb6f06144cdd9803fb3910eb80bf)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:54.148070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ceb17a-f4ef-43d1-b017-a8da5f1ef399 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:54.203174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330c581-43f4-403b-9be6-1b698c3749c0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:54.235514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:54.255065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:54.260063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab233c4-548e-419e-b980-2cb53947dec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:54.261093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab233c4-548e-419e-b980-2cb53947dec5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:54.261922 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab233c4-548e-419e-b980-2cb53947dec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:54.262082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab233c4-548e-419e-b980-2cb53947dec5 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:54.263318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab233c4-548e-419e-b980-2cb53947dec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:54.263878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab233c4-548e-419e-b980-2cb53947dec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:54.270733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 320/612] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:19:53 2022] PUT /identity/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/3f9385dec85a4e0cba21c2a840124f5a/roles/509fcb6f06144cdd9803fb3910eb80bf => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:19:54.270733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ceb17a-f4ef-43d1-b017-a8da5f1ef399 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:54.271126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab233c4-548e-419e-b980-2cb53947dec5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:54.290566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 293/613] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:54.292380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fe15d-78b1-481d-9374-b09b38fe3352 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:54.292886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fe15d-78b1-481d-9374-b09b38fe3352 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:54.293770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fe15d-78b1-481d-9374-b09b38fe3352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:54.320648 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-de1fe15d-78b1-481d-9374-b09b38fe3352 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:54.322553 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-de1fe15d-78b1-481d-9374-b09b38fe3352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:54.456283 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 294/614] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:54.458407 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fe15d-78b1-481d-9374-b09b38fe3352 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:54.503647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ceb17a-f4ef-43d1-b017-a8da5f1ef399 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:54.571626 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e1ef3-b1b7-42ce-bbc8-bc6febf44587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:54.572756 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e1ef3-b1b7-42ce-bbc8-bc6febf44587 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:54.573098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e1ef3-b1b7-42ce-bbc8-bc6febf44587 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:54.573592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e1ef3-b1b7-42ce-bbc8-bc6febf44587 None admin] PATH_INFO: `/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/08f27c6bc2744b9f92141a9c6906bc3f/roles/509fcb6f06144cdd9803fb3910eb80bf` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:54.601761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e1ef3-b1b7-42ce-bbc8-bc6febf44587 None admin] RBAC: Authorizing `identity:create_grant(project_id=40e0b5ee15df481cbc01333131f3def0, user_id=08f27c6bc2744b9f92141a9c6906bc3f, role_id=509fcb6f06144cdd9803fb3910eb80bf)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:54.604649 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e1ef3-b1b7-42ce-bbc8-bc6febf44587 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:54.673741 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fe15d-78b1-481d-9374-b09b38fe3352 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:54.683499 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 321/615] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:19:54 2022] PUT /identity/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/08f27c6bc2744b9f92141a9c6906bc3f/roles/509fcb6f06144cdd9803fb3910eb80bf => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:19:54.685946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e1ef3-b1b7-42ce-bbc8-bc6febf44587 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:54.719683 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:54.826901 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa159b6f-858a-4bef-9522-9cedd021c474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:54.835940 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa159b6f-858a-4bef-9522-9cedd021c474 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:54.836869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa159b6f-858a-4bef-9522-9cedd021c474 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:54.837644 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa159b6f-858a-4bef-9522-9cedd021c474 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:54.863597 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:54.864465 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa159b6f-858a-4bef-9522-9cedd021c474 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:54.867274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa159b6f-858a-4bef-9522-9cedd021c474 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-aa159b6f-858a-4bef-9522-9cedd021c474 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:19:54.915928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:54.917833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:54.921214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:54.921214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:54.921214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:19:54.921214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:19:54.921214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:19:54.921214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:19:54.921214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:19:54.921214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:19:54.921214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:19:54.921214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:54.925612 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 295/616] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 18 10:19:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 466 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:54.930787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa159b6f-858a-4bef-9522-9cedd021c474 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:55.029639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e1ef3-b1b7-42ce-bbc8-bc6febf44587 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:55.093862 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60926dce-de72-4d96-92ce-67f6f5059235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:55.094978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60926dce-de72-4d96-92ce-67f6f5059235 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:55.095452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60926dce-de72-4d96-92ce-67f6f5059235 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:55.095911 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60926dce-de72-4d96-92ce-67f6f5059235 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:55.114371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60926dce-de72-4d96-92ce-67f6f5059235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-60926dce-de72-4d96-92ce-67f6f5059235 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:55.129347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:55.131452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:55.133152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:55.133152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:55.133152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:55.133152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:55.133152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:55.133152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:55.133152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:55.133152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:55.133152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:55.133152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:55.133152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:55.133152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:55.133152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 322/617] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:55.143801 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60926dce-de72-4d96-92ce-67f6f5059235 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:55.186430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa159b6f-858a-4bef-9522-9cedd021c474 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:55.267812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7f19c-ce6e-4dbc-ab65-a5469ea18e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:55.268994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7f19c-ce6e-4dbc-ab65-a5469ea18e7f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:55.269503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7f19c-ce6e-4dbc-ab65-a5469ea18e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:55.269992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7f19c-ce6e-4dbc-ab65-a5469ea18e7f None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:55.271700 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7f19c-ce6e-4dbc-ab65-a5469ea18e7f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:55.272346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7f19c-ce6e-4dbc-ab65-a5469ea18e7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:55.275013 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7f19c-ce6e-4dbc-ab65-a5469ea18e7f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:55.328950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 296/618] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 18 10:19:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:55.338825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7f19c-ce6e-4dbc-ab65-a5469ea18e7f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:55.379521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60926dce-de72-4d96-92ce-67f6f5059235 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:55.410863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:55.426563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:55.446889 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b432fdd-2277-44b3-91b1-6e55d2f2f2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:55.448183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b432fdd-2277-44b3-91b1-6e55d2f2f2de None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:55.448757 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b432fdd-2277-44b3-91b1-6e55d2f2f2de None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:55.449347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b432fdd-2277-44b3-91b1-6e55d2f2f2de None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:55.450931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b432fdd-2277-44b3-91b1-6e55d2f2f2de None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:55.451582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b432fdd-2277-44b3-91b1-6e55d2f2f2de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:55.454237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b432fdd-2277-44b3-91b1-6e55d2f2f2de None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:55.471700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 323/619] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:19:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:55.477435 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b432fdd-2277-44b3-91b1-6e55d2f2f2de None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:55.652058 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7f19c-ce6e-4dbc-ab65-a5469ea18e7f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:55.728379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014c41f-8544-4798-885c-0866a35270d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:55.729518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014c41f-8544-4798-885c-0866a35270d2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:55.730026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b432fdd-2277-44b3-91b1-6e55d2f2f2de None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:55.730231 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014c41f-8544-4798-885c-0866a35270d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:55.731212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014c41f-8544-4798-885c-0866a35270d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:55.791556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07234ee6-baa6-4737-9f11-2425af0307dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:55.793766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07234ee6-baa6-4737-9f11-2425af0307dc None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:55.794520 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07234ee6-baa6-4737-9f11-2425af0307dc None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:55.795292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07234ee6-baa6-4737-9f11-2425af0307dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:55.814458 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07234ee6-baa6-4737-9f11-2425af0307dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:55.817432 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07234ee6-baa6-4737-9f11-2425af0307dc None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:55.850086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-07234ee6-baa6-4737-9f11-2425af0307dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:55.850086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:55.850086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:55.850086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:55.850086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:55.850086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:55.850086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:55.850086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:55.850086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:55.850086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:55.850086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:55.850086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:55.850086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:55.850086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:55.850086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:55.851931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:55.853753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:55.853753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:55.853753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:55.853753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:55.857940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 324/620] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:19:55.860809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554da0e2-6eb2-4b84-ab6e-dfd2e22e3ada None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:55.861584 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554da0e2-6eb2-4b84-ab6e-dfd2e22e3ada None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:55.862667 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554da0e2-6eb2-4b84-ab6e-dfd2e22e3ada None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:55.870396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014c41f-8544-4798-885c-0866a35270d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:55.871672 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014c41f-8544-4798-885c-0866a35270d2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:55.871983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 325/621] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:55 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:55.874023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554da0e2-6eb2-4b84-ab6e-dfd2e22e3ada None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:55.921804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:55.928127 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:56.067789 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554da0e2-6eb2-4b84-ab6e-dfd2e22e3ada None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:56.093467 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 297/622] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:56.095970 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e7678-793a-4cd8-b525-478a36e0fc89 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:56.096767 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e7678-793a-4cd8-b525-478a36e0fc89 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:56.097524 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e7678-793a-4cd8-b525-478a36e0fc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:56.128806 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4a8df-aee8-41ef-bfde-abcea33dbdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:56.129539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-bc9e7678-793a-4cd8-b525-478a36e0fc89 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:56.130706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4a8df-aee8-41ef-bfde-abcea33dbdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:56.131457 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-bc9e7678-793a-4cd8-b525-478a36e0fc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:56.131652 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4a8df-aee8-41ef-bfde-abcea33dbdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:56.132380 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4a8df-aee8-41ef-bfde-abcea33dbdb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:56.134187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4a8df-aee8-41ef-bfde-abcea33dbdb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:56.134990 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4a8df-aee8-41ef-bfde-abcea33dbdb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:56.137948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4a8df-aee8-41ef-bfde-abcea33dbdb8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:56.162818 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 326/623] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:56.164485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4a8df-aee8-41ef-bfde-abcea33dbdb8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:56.280120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 298/624] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:56.280120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e7678-793a-4cd8-b525-478a36e0fc89 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:56.374718 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:56.393975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:56.416612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4a8df-aee8-41ef-bfde-abcea33dbdb8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:56.488800 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e7678-793a-4cd8-b525-478a36e0fc89 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:56.495822 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0428eb4-9a80-4a45-88e5-ab5cdeae509c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:56.498711 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0428eb4-9a80-4a45-88e5-ab5cdeae509c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:56.499609 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0428eb4-9a80-4a45-88e5-ab5cdeae509c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:56.500467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0428eb4-9a80-4a45-88e5-ab5cdeae509c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:56.520970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0428eb4-9a80-4a45-88e5-ab5cdeae509c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:56.524059 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0428eb4-9a80-4a45-88e5-ab5cdeae509c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:56.554159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035948e-6c62-40c4-9014-630746279ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:56.555418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035948e-6c62-40c4-9014-630746279ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:56.555926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035948e-6c62-40c4-9014-630746279ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:56.556427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035948e-6c62-40c4-9014-630746279ea4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:56.562407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-d0428eb4-9a80-4a45-88e5-ab5cdeae509c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:56.562407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:56.562407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:56.562407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:56.562407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:56.562407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:56.562407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:56.562407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:56.562407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:56.562407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:56.562407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:56.562407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:56.562407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:56.562407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:56.562407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:56.564028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:56.565707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:56.565707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:56.565707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:56.565707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:56.574583 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035948e-6c62-40c4-9014-630746279ea4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:56.574583 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035948e-6c62-40c4-9014-630746279ea4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:56.575825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 327/625] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:56.577655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0428eb4-9a80-4a45-88e5-ab5cdeae509c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-9035948e-6c62-40c4-9014-630746279ea4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:19:56.606728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:56.608572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:56.611154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:56.611154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:56.611154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:19:56.611154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:19:56.611154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:19:56.611154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:19:56.611154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:19:56.611154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:19:56.611154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:19:56.611154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:56.611154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 299/626] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:19:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:56.615170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035948e-6c62-40c4-9014-630746279ea4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:56.784085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0428eb4-9a80-4a45-88e5-ab5cdeae509c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:56.812768 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035948e-6c62-40c4-9014-630746279ea4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:56.845207 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:56.849642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12069e6e-a766-420b-8faf-ebba5d0ac2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:56.851594 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12069e6e-a766-420b-8faf-ebba5d0ac2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:56.852385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12069e6e-a766-420b-8faf-ebba5d0ac2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:56.853163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12069e6e-a766-420b-8faf-ebba5d0ac2d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:56.857807 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:56.876524 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12069e6e-a766-420b-8faf-ebba5d0ac2d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:56.879426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7139e-3ac5-4abe-be32-b20dcd15c2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:56.882288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7139e-3ac5-4abe-be32-b20dcd15c2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:56.883082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7139e-3ac5-4abe-be32-b20dcd15c2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:56.883576 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7139e-3ac5-4abe-be32-b20dcd15c2d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:56.885142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7139e-3ac5-4abe-be32-b20dcd15c2d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:56.885694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7139e-3ac5-4abe-be32-b20dcd15c2d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:56.888609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7139e-3ac5-4abe-be32-b20dcd15c2d5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-12069e6e-a766-420b-8faf-ebba5d0ac2d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:56.896824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:56.898680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:56.900397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:56.900397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:56.900397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:56.900397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:56.900397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:56.900397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:56.900397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:56.900397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:56.900397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:56.900397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:56.900397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:56.900397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:56.906298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 328/627] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:56.908134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12069e6e-a766-420b-8faf-ebba5d0ac2d1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:56.921437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 300/628] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:56.923053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7139e-3ac5-4abe-be32-b20dcd15c2d5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:57.068484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7139e-3ac5-4abe-be32-b20dcd15c2d5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:57.095017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12069e6e-a766-420b-8faf-ebba5d0ac2d1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:57.116290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2eddd-fd67-4f59-809c-2b7a8b094756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:57.117625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2eddd-fd67-4f59-809c-2b7a8b094756 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:57.118118 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2eddd-fd67-4f59-809c-2b7a8b094756 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:57.118667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2eddd-fd67-4f59-809c-2b7a8b094756 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:57.119837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2eddd-fd67-4f59-809c-2b7a8b094756 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:57.120352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2eddd-fd67-4f59-809c-2b7a8b094756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:57.123518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2eddd-fd67-4f59-809c-2b7a8b094756 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:57.138783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 301/629] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:19:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:57.138783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2eddd-fd67-4f59-809c-2b7a8b094756 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:57.167550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454369e5-4178-4d05-80d4-1f55fe4d2584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:57.169392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454369e5-4178-4d05-80d4-1f55fe4d2584 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:57.170100 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454369e5-4178-4d05-80d4-1f55fe4d2584 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:57.170625 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454369e5-4178-4d05-80d4-1f55fe4d2584 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:57.172275 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454369e5-4178-4d05-80d4-1f55fe4d2584 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:57.172892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454369e5-4178-4d05-80d4-1f55fe4d2584 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:57.175599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454369e5-4178-4d05-80d4-1f55fe4d2584 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:57.181505 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:57.205705 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 329/630] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 18 10:19:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:57.207408 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dddc6b-8fe0-4ecf-a4a2-a71813103081 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:57.207874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dddc6b-8fe0-4ecf-a4a2-a71813103081 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:57.208312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dddc6b-8fe0-4ecf-a4a2-a71813103081 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:57.210108 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 330/631] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:57.211096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dddc6b-8fe0-4ecf-a4a2-a71813103081 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:57.276677 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2eddd-fd67-4f59-809c-2b7a8b094756 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:57.289014 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:57.336668 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45765f7a-c99a-45b1-b183-53b1ff64f7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:57.337566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45765f7a-c99a-45b1-b183-53b1ff64f7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:57.337998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45765f7a-c99a-45b1-b183-53b1ff64f7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:57.338516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45765f7a-c99a-45b1-b183-53b1ff64f7f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:57.348568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45765f7a-c99a-45b1-b183-53b1ff64f7f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:57.350823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45765f7a-c99a-45b1-b183-53b1ff64f7f7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:57.364654 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dddc6b-8fe0-4ecf-a4a2-a71813103081 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:57.370835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-45765f7a-c99a-45b1-b183-53b1ff64f7f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:57.370835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:57.370835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:57.370835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:57.370835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:57.370835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:57.370835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:57.370835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:57.370835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:57.370835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:57.370835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:57.370835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:57.370835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:19:57.370835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:19:57.370835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:57.373187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:57.385300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:19:57.385300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:19:57.385300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:19:57.385300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:19:57.385300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:19:57.385300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:19:57.385300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:57.385300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:57.385300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 302/632] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:57.385300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45765f7a-c99a-45b1-b183-53b1ff64f7f7 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:57.420263 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f31f9-4086-4ba6-bbd4-ed5322122185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:57.421039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f31f9-4086-4ba6-bbd4-ed5322122185 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:57.421320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f31f9-4086-4ba6-bbd4-ed5322122185 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:57.421685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f31f9-4086-4ba6-bbd4-ed5322122185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:57.436897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f31f9-4086-4ba6-bbd4-ed5322122185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:57.438546 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f31f9-4086-4ba6-bbd4-ed5322122185 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:57.459318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-fa8f31f9-4086-4ba6-bbd4-ed5322122185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:57.459318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:57.459318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:57.459318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:57.459318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:57.459318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:57.459318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:57.459318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:57.459318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:57.459318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:57.459318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:57.459318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:57.459318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:57.459318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:57.459318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:57.461069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:57.462958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:57.462958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:57.462958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:57.462958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:57.462958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 331/633] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:57.462958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf390f-1c7c-4664-8126-ecfc433c3289 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:57.462958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf390f-1c7c-4664-8126-ecfc433c3289 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:57.462958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf390f-1c7c-4664-8126-ecfc433c3289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:57.480548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ffaf390f-1c7c-4664-8126-ecfc433c3289 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:57.481935 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ffaf390f-1c7c-4664-8126-ecfc433c3289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:57.524460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:57.530159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45765f7a-c99a-45b1-b183-53b1ff64f7f7 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:57.577147 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 332/634] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:57.577401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957533be-2d14-4606-b990-1d585aff4ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:57.578695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957533be-2d14-4606-b990-1d585aff4ade None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:57.579167 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957533be-2d14-4606-b990-1d585aff4ade None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:57.579638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957533be-2d14-4606-b990-1d585aff4ade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:57.580036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf390f-1c7c-4664-8126-ecfc433c3289 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:57.608451 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957533be-2d14-4606-b990-1d585aff4ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:57.611408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957533be-2d14-4606-b990-1d585aff4ade None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:57.618978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:57.647538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-957533be-2d14-4606-b990-1d585aff4ade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:57.647538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:57.647538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:57.647538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:57.647538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:57.647538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:57.647538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:57.647538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:57.647538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:57.647538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:57.647538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:57.647538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:57.647538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:57.647538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:57.647538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:57.648582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:57.649488 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:57.649488 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:57.649488 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:57.649488 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:57.649720 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 303/635] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:57.651140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957533be-2d14-4606-b990-1d585aff4ade None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:57.731072 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf390f-1c7c-4664-8126-ecfc433c3289 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:57.774543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957533be-2d14-4606-b990-1d585aff4ade None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:57.796193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b42101-cc0b-4993-aaf6-dd340d82ec56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:57.797291 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b42101-cc0b-4993-aaf6-dd340d82ec56 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:57.797774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b42101-cc0b-4993-aaf6-dd340d82ec56 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:57.798250 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b42101-cc0b-4993-aaf6-dd340d82ec56 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:57.800000 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b42101-cc0b-4993-aaf6-dd340d82ec56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:57.800544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b42101-cc0b-4993-aaf6-dd340d82ec56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:57.803637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b42101-cc0b-4993-aaf6-dd340d82ec56 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:57.818465 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef316d3-2a98-4adc-bdc7-84ae54405bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:57.819562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef316d3-2a98-4adc-bdc7-84ae54405bed None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:57.819994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef316d3-2a98-4adc-bdc7-84ae54405bed None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:57.820404 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef316d3-2a98-4adc-bdc7-84ae54405bed None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:57.821167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 333/636] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:57.821528 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef316d3-2a98-4adc-bdc7-84ae54405bed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:57.822057 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef316d3-2a98-4adc-bdc7-84ae54405bed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:57.822503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b42101-cc0b-4993-aaf6-dd340d82ec56 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:57.824273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef316d3-2a98-4adc-bdc7-84ae54405bed None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:57.840854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 304/637] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:57.842052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef316d3-2a98-4adc-bdc7-84ae54405bed None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:57.860194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:57.970070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:57.979075 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b42101-cc0b-4993-aaf6-dd340d82ec56 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:58.001692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef316d3-2a98-4adc-bdc7-84ae54405bed None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:58.024769 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ffaab-4681-4536-bbcb-58d368666c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:58.025694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ffaab-4681-4536-bbcb-58d368666c6d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:58.025992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ffaab-4681-4536-bbcb-58d368666c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:58.026260 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ffaab-4681-4536-bbcb-58d368666c6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:58.039598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ffaab-4681-4536-bbcb-58d368666c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-8d8ffaab-4681-4536-bbcb-58d368666c6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:58.048931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:58.050732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:58.052365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:58.052365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:58.052365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:58.052365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:58.052365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:58.052365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:58.052365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:58.052365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:58.052365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:58.052365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:58.052365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:58.052365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:19:58.052365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 334/638] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:58.052365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ffaab-4681-4536-bbcb-58d368666c6d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:58.066503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60fc8e-8bde-4b9d-b9c8-c0fb9eb49eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:58.067485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60fc8e-8bde-4b9d-b9c8-c0fb9eb49eff None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:58.067908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60fc8e-8bde-4b9d-b9c8-c0fb9eb49eff None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:58.068317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60fc8e-8bde-4b9d-b9c8-c0fb9eb49eff None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:58.069455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60fc8e-8bde-4b9d-b9c8-c0fb9eb49eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:58.069906 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60fc8e-8bde-4b9d-b9c8-c0fb9eb49eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:58.072123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60fc8e-8bde-4b9d-b9c8-c0fb9eb49eff None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:58.092444 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 305/639] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:58.093711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60fc8e-8bde-4b9d-b9c8-c0fb9eb49eff None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:58.187351 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:58.198857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ffaab-4681-4536-bbcb-58d368666c6d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:58.231919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60fc8e-8bde-4b9d-b9c8-c0fb9eb49eff None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:58.250030 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19773746-a995-44ce-be08-d4498131547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:58.251030 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19773746-a995-44ce-be08-d4498131547e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:58.251478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19773746-a995-44ce-be08-d4498131547e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:58.251926 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19773746-a995-44ce-be08-d4498131547e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:58.253356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19773746-a995-44ce-be08-d4498131547e None admin] RBAC: Adding query filter params (role.id=509fcb6f06144cdd9803fb3910eb80bf, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=f7abf6b71ac3454ca547a750cef9220a) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:58.253874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19773746-a995-44ce-be08-d4498131547e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:58.256386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19773746-a995-44ce-be08-d4498131547e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:58.265960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 335/640] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:19:58 2022] GET /identity/v3/role_assignments?user.id=f7abf6b71ac3454ca547a750cef9220a&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=509fcb6f06144cdd9803fb3910eb80bf => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:58.267235 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19773746-a995-44ce-be08-d4498131547e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:58.294479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87714fb-f445-42c3-a42b-917e04bef47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:58.295703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87714fb-f445-42c3-a42b-917e04bef47e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:58.296203 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87714fb-f445-42c3-a42b-917e04bef47e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:58.296658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87714fb-f445-42c3-a42b-917e04bef47e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:58.302362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:58.309335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87714fb-f445-42c3-a42b-917e04bef47e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:58.311757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87714fb-f445-42c3-a42b-917e04bef47e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-a87714fb-f445-42c3-a42b-917e04bef47e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:19:58.332048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:58.333881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:58.335719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:58.335719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:58.335719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:19:58.335719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:19:58.335719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:19:58.335719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:19:58.335719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:19:58.335719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:19:58.335719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 10:19:58.335719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:58.335719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 306/641] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:19:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:58.335719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87714fb-f445-42c3-a42b-917e04bef47e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:58.456915 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19773746-a995-44ce-be08-d4498131547e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:58.491061 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87714fb-f445-42c3-a42b-917e04bef47e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:58.502168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675d4c6-916d-435a-8726-13b82182dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:58.503177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675d4c6-916d-435a-8726-13b82182dc48 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:58.504326 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675d4c6-916d-435a-8726-13b82182dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:58.504326 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675d4c6-916d-435a-8726-13b82182dc48 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:58.504862 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675d4c6-916d-435a-8726-13b82182dc48 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:58.505179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675d4c6-916d-435a-8726-13b82182dc48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:58.508936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675d4c6-916d-435a-8726-13b82182dc48 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:58.521117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 336/642] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:19:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:58.523243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feb95f-5656-4980-92fb-896c94693b0f None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:58.523709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feb95f-5656-4980-92fb-896c94693b0f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:58.524282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feb95f-5656-4980-92fb-896c94693b0f None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:58.526401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 337/643] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:19:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:19:58.527531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85feb95f-5656-4980-92fb-896c94693b0f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:58.534888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:58.543005 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c00deb-5348-4bbd-b29d-39999e9bf46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:58.544511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c00deb-5348-4bbd-b29d-39999e9bf46e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:58.545013 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c00deb-5348-4bbd-b29d-39999e9bf46e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:58.545382 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c00deb-5348-4bbd-b29d-39999e9bf46e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:58.553153 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c00deb-5348-4bbd-b29d-39999e9bf46e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:58.554659 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c00deb-5348-4bbd-b29d-39999e9bf46e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:58.571545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-00c00deb-5348-4bbd-b29d-39999e9bf46e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:58.571545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:58.571545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:58.571545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:58.571545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:58.571545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:58.571545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:58.571545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:58.571545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:58.571545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:58.571545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:58.571545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:58.571545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:19:58.571545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:19:58.571545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:58.572699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:58.575806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:19:58.575806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:19:58.575806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:19:58.575806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:19:58.575806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:19:58.575806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:19:58.575806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:19:58.575806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:58.575806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 307/644] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:19:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:58.575806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c00deb-5348-4bbd-b29d-39999e9bf46e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:58.669858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:58.703193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85feb95f-5656-4980-92fb-896c94693b0f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:58.728163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c00deb-5348-4bbd-b29d-39999e9bf46e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:58.763508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922dcac-2ed5-43c5-91e2-b034cdbc3fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:58.764715 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922dcac-2ed5-43c5-91e2-b034cdbc3fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:58.765178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922dcac-2ed5-43c5-91e2-b034cdbc3fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:58.765643 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922dcac-2ed5-43c5-91e2-b034cdbc3fc4 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:58.767508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922dcac-2ed5-43c5-91e2-b034cdbc3fc4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:58.768034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922dcac-2ed5-43c5-91e2-b034cdbc3fc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:58.770608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922dcac-2ed5-43c5-91e2-b034cdbc3fc4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:58.784368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f610ae-e979-4487-bcee-4f11de980d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:58.785624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f610ae-e979-4487-bcee-4f11de980d90 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:58.786040 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f610ae-e979-4487-bcee-4f11de980d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:58.786529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f610ae-e979-4487-bcee-4f11de980d90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:58.807179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 338/645] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 18 10:19:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:58.807179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de30b5-6b06-470e-838b-53fbc8b92439 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:58.807179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de30b5-6b06-470e-838b-53fbc8b92439 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:58.807179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de30b5-6b06-470e-838b-53fbc8b92439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:58.809877 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f610ae-e979-4487-bcee-4f11de980d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:58.812500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f610ae-e979-4487-bcee-4f11de980d90 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:58.830825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f1de30b5-6b06-470e-838b-53fbc8b92439 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:19:58.832699 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f1de30b5-6b06-470e-838b-53fbc8b92439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:19:58.843328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-f3f610ae-e979-4487-bcee-4f11de980d90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:58.843328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:58.843328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:58.843328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:58.843328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:58.843328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:58.843328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:58.843328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:58.843328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:58.843328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:58.843328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:58.843328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:58.843328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:19:58.843328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:19:58.843328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:58.844408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:58.845307 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:19:58.845307 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:19:58.845307 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:19:58.845307 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:58.846048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 308/646] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:58.847216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f610ae-e979-4487-bcee-4f11de980d90 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:58.907229 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:58.930366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 339/647] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:19:58.930366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de30b5-6b06-470e-838b-53fbc8b92439 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:58.998648 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f610ae-e979-4487-bcee-4f11de980d90 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:59.026562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:59.042543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f41e7-9ae9-42a7-8654-eb4a25f72330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:59.052463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f41e7-9ae9-42a7-8654-eb4a25f72330 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:59.052463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f41e7-9ae9-42a7-8654-eb4a25f72330 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:59.052463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f41e7-9ae9-42a7-8654-eb4a25f72330 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:59.052463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f41e7-9ae9-42a7-8654-eb4a25f72330 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:59.052463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f41e7-9ae9-42a7-8654-eb4a25f72330 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:59.052463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f41e7-9ae9-42a7-8654-eb4a25f72330 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:59.070367 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 309/648] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:19:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:59.071884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f41e7-9ae9-42a7-8654-eb4a25f72330 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:59.086451 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de30b5-6b06-470e-838b-53fbc8b92439 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:59.133901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d32e5-717a-45fe-8f2c-06f2cd1b698f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:59.134693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d32e5-717a-45fe-8f2c-06f2cd1b698f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:59.134966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d32e5-717a-45fe-8f2c-06f2cd1b698f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:59.135242 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d32e5-717a-45fe-8f2c-06f2cd1b698f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:59.223678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f41e7-9ae9-42a7-8654-eb4a25f72330 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:59.226308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:59.251860 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d32e5-717a-45fe-8f2c-06f2cd1b698f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:59.254893 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d32e5-717a-45fe-8f2c-06f2cd1b698f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:59.270775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537f351-b596-47df-a0c1-46694a18d1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:59.271533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537f351-b596-47df-a0c1-46694a18d1ac None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:59.271923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537f351-b596-47df-a0c1-46694a18d1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:59.272264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537f351-b596-47df-a0c1-46694a18d1ac None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:59.273076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537f351-b596-47df-a0c1-46694a18d1ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:19:59.273531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537f351-b596-47df-a0c1-46694a18d1ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:59.275040 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537f351-b596-47df-a0c1-46694a18d1ac None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:59.295612 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 310/649] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:19:59.295612 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537f351-b596-47df-a0c1-46694a18d1ac None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:59.387566 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:59.448050 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 340/650] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:19:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:19:59.450081 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d32e5-717a-45fe-8f2c-06f2cd1b698f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:59.494256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537f351-b596-47df-a0c1-46694a18d1ac None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:59.555093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70611691-a0d9-4b79-8a43-d886641f6e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:59.556248 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70611691-a0d9-4b79-8a43-d886641f6e75 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:59.556689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70611691-a0d9-4b79-8a43-d886641f6e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:59.557133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70611691-a0d9-4b79-8a43-d886641f6e75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:59.577053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70611691-a0d9-4b79-8a43-d886641f6e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-70611691-a0d9-4b79-8a43-d886641f6e75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:19:59.591832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:59.592874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:59.593758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:59.593758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:59.593758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:59.593758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:59.593758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:19:59.593758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:19:59.593758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:19:59.593758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:19:59.593758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:19:59.593758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:19:59.593758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:19:59.593758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:59.593758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 311/651] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:59.595136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70611691-a0d9-4b79-8a43-d886641f6e75 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:59.620393 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d32e5-717a-45fe-8f2c-06f2cd1b698f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:59.641122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:59.684716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35177944-4174-4554-a38b-d15b24d8730f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:59.686836 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35177944-4174-4554-a38b-d15b24d8730f None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:59.687583 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35177944-4174-4554-a38b-d15b24d8730f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:59.688351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35177944-4174-4554-a38b-d15b24d8730f None admin] PATH_INFO: `/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/a8ee2beff1a7487d92c1c5940f2784f1/roles/509fcb6f06144cdd9803fb3910eb80bf` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:59.717438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35177944-4174-4554-a38b-d15b24d8730f None admin] RBAC: Authorizing `identity:create_grant(project_id=40e0b5ee15df481cbc01333131f3def0, user_id=a8ee2beff1a7487d92c1c5940f2784f1, role_id=509fcb6f06144cdd9803fb3910eb80bf)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:59.719108 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35177944-4174-4554-a38b-d15b24d8730f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:59.795623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70611691-a0d9-4b79-8a43-d886641f6e75 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:19:59.805970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 341/652] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:19:59 2022] PUT /identity/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/a8ee2beff1a7487d92c1c5940f2784f1/roles/509fcb6f06144cdd9803fb3910eb80bf => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:19:59.807332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35177944-4174-4554-a38b-d15b24d8730f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:19:59.858283 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48277a67-3431-457f-9575-19ade8a242dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:19:59.860122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48277a67-3431-457f-9575-19ade8a242dc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:19:59.860874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48277a67-3431-457f-9575-19ade8a242dc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:19:59.861632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48277a67-3431-457f-9575-19ade8a242dc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:19:59.879429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48277a67-3431-457f-9575-19ade8a242dc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:19:59.883156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:19:59.883697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48277a67-3431-457f-9575-19ade8a242dc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-48277a67-3431-457f-9575-19ade8a242dc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:19:59.917296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:19:59.919206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:19:59.929729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:19:59.929729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:19:59.929729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:19:59.929729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:19:59.929729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:19:59.929729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:19:59.929729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:19:59.929729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:19:59.929729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 10:19:59.929729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:19:59.933406 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 312/653] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:19:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:19:59.935436 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48277a67-3431-457f-9575-19ade8a242dc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:00.039893 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35177944-4174-4554-a38b-d15b24d8730f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:00.087362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27945984-5981-4e7e-a418-09f40698e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:00.088261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27945984-5981-4e7e-a418-09f40698e412 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:00.088538 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27945984-5981-4e7e-a418-09f40698e412 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:00.088837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27945984-5981-4e7e-a418-09f40698e412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:00.108149 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27945984-5981-4e7e-a418-09f40698e412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:00.111179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:00.112529 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27945984-5981-4e7e-a418-09f40698e412 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:00.130639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48277a67-3431-457f-9575-19ade8a242dc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:00.150931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-27945984-5981-4e7e-a418-09f40698e412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:00.150931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:00.150931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:00.150931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:00.150931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:00.150931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:00.150931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:00.150931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:00.150931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:00.150931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:00.150931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:00.150931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:00.150931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:00.150931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:00.150931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:00.153450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:00.155511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:00.155511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:00.155511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:00.155511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:00.155511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 342/654] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:00.162354 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27945984-5981-4e7e-a418-09f40698e412 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:00.180972 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc858e-7d80-47d2-bbed-02aa5af765e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:00.181651 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc858e-7d80-47d2-bbed-02aa5af765e7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:00.181929 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc858e-7d80-47d2-bbed-02aa5af765e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:00.182202 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc858e-7d80-47d2-bbed-02aa5af765e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:00.182993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc858e-7d80-47d2-bbed-02aa5af765e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:00.183291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc858e-7d80-47d2-bbed-02aa5af765e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:00.185380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc858e-7d80-47d2-bbed-02aa5af765e7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:00.195148 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 313/655] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:19:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:00.196072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc858e-7d80-47d2-bbed-02aa5af765e7 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:00.307248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:00.318813 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc858e-7d80-47d2-bbed-02aa5af765e7 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:00.357225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393570c-2e83-4818-9e15-d8d821b40d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:00.357783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393570c-2e83-4818-9e15-d8d821b40d0b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:00.358048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393570c-2e83-4818-9e15-d8d821b40d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:00.358346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393570c-2e83-4818-9e15-d8d821b40d0b None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:00.359063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393570c-2e83-4818-9e15-d8d821b40d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:00.359343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393570c-2e83-4818-9e15-d8d821b40d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:00.361015 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393570c-2e83-4818-9e15-d8d821b40d0b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:00.372718 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27945984-5981-4e7e-a418-09f40698e412 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:00.380535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 314/656] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:00.381520 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393570c-2e83-4818-9e15-d8d821b40d0b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:00.385961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:00.442601 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0b58a-2a3f-4288-91b2-4eed711b13b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:00.444213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0b58a-2a3f-4288-91b2-4eed711b13b0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:00.444906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0b58a-2a3f-4288-91b2-4eed711b13b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:00.445691 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0b58a-2a3f-4288-91b2-4eed711b13b0 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:00.447792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0b58a-2a3f-4288-91b2-4eed711b13b0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:00.448582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0b58a-2a3f-4288-91b2-4eed711b13b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:00.452154 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0b58a-2a3f-4288-91b2-4eed711b13b0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:00.498643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393570c-2e83-4818-9e15-d8d821b40d0b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:00.499117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 343/657] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Jul 18 10:20:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:00.501124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0b58a-2a3f-4288-91b2-4eed711b13b0 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:00.536145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6f8ed-dd99-4df1-8972-26558c0bf29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:00.537054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6f8ed-dd99-4df1-8972-26558c0bf29f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:00.537337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6f8ed-dd99-4df1-8972-26558c0bf29f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:00.537608 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6f8ed-dd99-4df1-8972-26558c0bf29f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:00.551099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6f8ed-dd99-4df1-8972-26558c0bf29f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:00.552574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6f8ed-dd99-4df1-8972-26558c0bf29f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:00.573369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-15d6f8ed-dd99-4df1-8972-26558c0bf29f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:00.573369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:00.573369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:00.573369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:00.573369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:00.573369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:00.573369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:00.573369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:00.573369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:00.573369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:00.573369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:00.573369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:00.573369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:00.573369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:00.573369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:00.576516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:00.578369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:00.578369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:00.578369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:00.578369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:00.578369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 315/658] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:00.578369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6f8ed-dd99-4df1-8972-26558c0bf29f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:00.650970 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:00.712809 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6f8ed-dd99-4df1-8972-26558c0bf29f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:00.717748 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0b58a-2a3f-4288-91b2-4eed711b13b0 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:00.754630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:00.761703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c204191-3cef-4bd2-9907-c7f0dfa37bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:00.762460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c204191-3cef-4bd2-9907-c7f0dfa37bbd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:00.762747 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c204191-3cef-4bd2-9907-c7f0dfa37bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:00.763224 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c204191-3cef-4bd2-9907-c7f0dfa37bbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:00.766395 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fc733-4803-4b8b-98a2-137d1c08a3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:00.770758 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fc733-4803-4b8b-98a2-137d1c08a3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:00.770758 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fc733-4803-4b8b-98a2-137d1c08a3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:00.770758 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fc733-4803-4b8b-98a2-137d1c08a3e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:00.784785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fc733-4803-4b8b-98a2-137d1c08a3e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:00.787469 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fc733-4803-4b8b-98a2-137d1c08a3e4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:00.815684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-1a9fc733-4803-4b8b-98a2-137d1c08a3e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:00.815684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:00.815684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:00.815684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:00.815684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:00.815684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:00.815684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:00.815684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:00.815684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:00.815684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:00.815684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:00.815684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:00.815684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:00.815684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:00.815684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:00.816871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:00.817831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:00.817831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:00.817831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:00.817831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:00.817831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:00.817831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:00.817831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:00.817831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:00.817831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 344/659] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:00.819165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fc733-4803-4b8b-98a2-137d1c08a3e4 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:00.846098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c204191-3cef-4bd2-9907-c7f0dfa37bbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:00.847636 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c204191-3cef-4bd2-9907-c7f0dfa37bbd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:00.915170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:00.978293 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 316/660] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:20:00.980526 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c36a3b-28c1-4252-9885-729e72b17d9e None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:00.981238 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c36a3b-28c1-4252-9885-729e72b17d9e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:00.981837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c36a3b-28c1-4252-9885-729e72b17d9e None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:00.988686 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 317/661] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:00.988686 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c36a3b-28c1-4252-9885-729e72b17d9e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:01.003767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fc733-4803-4b8b-98a2-137d1c08a3e4 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:01.057784 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c290f-64c5-4a8a-b581-861d884b3388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:01.059374 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c290f-64c5-4a8a-b581-861d884b3388 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:01.059522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c290f-64c5-4a8a-b581-861d884b3388 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:01.059686 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c290f-64c5-4a8a-b581-861d884b3388 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:01.060692 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c290f-64c5-4a8a-b581-861d884b3388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:01.061020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c290f-64c5-4a8a-b581-861d884b3388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:01.062472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c290f-64c5-4a8a-b581-861d884b3388 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:01.081379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 345/662] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:01.081379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c290f-64c5-4a8a-b581-861d884b3388 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:01.140241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:01.144288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c36a3b-28c1-4252-9885-729e72b17d9e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:01.211112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe053b-7264-471a-83e6-2176e8dc97e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:01.211732 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe053b-7264-471a-83e6-2176e8dc97e6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:01.211997 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe053b-7264-471a-83e6-2176e8dc97e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:01.212263 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe053b-7264-471a-83e6-2176e8dc97e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:01.212785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c290f-64c5-4a8a-b581-861d884b3388 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:01.213070 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe053b-7264-471a-83e6-2176e8dc97e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:01.213358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe053b-7264-471a-83e6-2176e8dc97e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:01.216124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe053b-7264-471a-83e6-2176e8dc97e6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:01.240237 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 318/663] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:01.240237 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3633a-6825-46ae-967c-a1de493f2ab8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:01.240237 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3633a-6825-46ae-967c-a1de493f2ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:01.240237 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3633a-6825-46ae-967c-a1de493f2ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:01.261168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7df6f-f9d8-4fda-bc19-617669968945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:01.263546 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7df6f-f9d8-4fda-bc19-617669968945 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:01.263958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7df6f-f9d8-4fda-bc19-617669968945 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:01.264398 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7df6f-f9d8-4fda-bc19-617669968945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:01.266351 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-28e3633a-6825-46ae-967c-a1de493f2ab8 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:01.268227 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-28e3633a-6825-46ae-967c-a1de493f2ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:01.282158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7df6f-f9d8-4fda-bc19-617669968945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:01.284732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7df6f-f9d8-4fda-bc19-617669968945 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:01.287949 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:01.309857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-9ce7df6f-f9d8-4fda-bc19-617669968945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:01.309857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:01.309857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:01.309857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:01.309857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:01.309857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:01.309857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:01.309857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:01.309857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:01.309857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:01.309857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:01.309857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:01.309857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:01.309857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:01.309857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:01.311119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:01.316779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:01.316779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:01.316779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:01.316779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:01.316779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 346/664] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:01.316779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7df6f-f9d8-4fda-bc19-617669968945 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:01.379279 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 319/665] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:20:01.380700 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3633a-6825-46ae-967c-a1de493f2ab8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:01.453125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:01.456822 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7df6f-f9d8-4fda-bc19-617669968945 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:01.498555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d97190-ab45-4bb0-9bd9-9b65a02053be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:01.499868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d97190-ab45-4bb0-9bd9-9b65a02053be None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:01.500555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d97190-ab45-4bb0-9bd9-9b65a02053be None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:01.500972 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d97190-ab45-4bb0-9bd9-9b65a02053be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:01.516726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d97190-ab45-4bb0-9bd9-9b65a02053be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:01.519446 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d97190-ab45-4bb0-9bd9-9b65a02053be None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:01.534475 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3633a-6825-46ae-967c-a1de493f2ab8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-c2d97190-ab45-4bb0-9bd9-9b65a02053be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:01.545237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:01.546253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:01.547265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:01.547265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:01.547265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:01.547265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:01.547265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:01.547265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:01.547265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:01.547265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:01.547265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:20:01.547265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:01.547265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 347/666] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:20:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:01.549026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d97190-ab45-4bb0-9bd9-9b65a02053be None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:01.596395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc608e-2382-468a-88a0-93ba8f9ea9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:01.597363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc608e-2382-468a-88a0-93ba8f9ea9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:01.597792 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc608e-2382-468a-88a0-93ba8f9ea9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:01.598205 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc608e-2382-468a-88a0-93ba8f9ea9a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:01.599606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc608e-2382-468a-88a0-93ba8f9ea9a1 None admin] RBAC: Adding query filter params (role.id=509fcb6f06144cdd9803fb3910eb80bf, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=7f93de99555742ca9bd99d707d1cdbee) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:01.600086 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc608e-2382-468a-88a0-93ba8f9ea9a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:01.602388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc608e-2382-468a-88a0-93ba8f9ea9a1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:01.618368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 320/667] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:20:01 2022] GET /identity/v3/role_assignments?user.id=7f93de99555742ca9bd99d707d1cdbee&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=509fcb6f06144cdd9803fb3910eb80bf => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:01.618368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc608e-2382-468a-88a0-93ba8f9ea9a1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:01.641101 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:01.721497 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d97190-ab45-4bb0-9bd9-9b65a02053be None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:01.765495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fd5bf-52ed-4e4a-9984-c42f9082c47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:01.766220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fd5bf-52ed-4e4a-9984-c42f9082c47e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:01.766635 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fd5bf-52ed-4e4a-9984-c42f9082c47e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:01.767015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fd5bf-52ed-4e4a-9984-c42f9082c47e None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:01.768045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fd5bf-52ed-4e4a-9984-c42f9082c47e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:01.768573 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fd5bf-52ed-4e4a-9984-c42f9082c47e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:01.770095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fd5bf-52ed-4e4a-9984-c42f9082c47e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:01.790136 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 348/668] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:01.791253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fd5bf-52ed-4e4a-9984-c42f9082c47e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:01.795556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc608e-2382-468a-88a0-93ba8f9ea9a1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:01.817495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:01.837324 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533252a-e22b-4411-8fda-9f396d666068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:01.838510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533252a-e22b-4411-8fda-9f396d666068 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:01.839077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533252a-e22b-4411-8fda-9f396d666068 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:01.839573 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533252a-e22b-4411-8fda-9f396d666068 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:01.863948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533252a-e22b-4411-8fda-9f396d666068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-6533252a-e22b-4411-8fda-9f396d666068 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:01.871623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:01.872662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:01.873515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:01.873515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:01.873515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:01.873515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:01.873515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:01.873515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:01.873515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:01.873515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:01.873515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:01.873515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:01.873515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:01.873515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:01.873515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 321/669] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:20:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:01.874255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533252a-e22b-4411-8fda-9f396d666068 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:01.938719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fd5bf-52ed-4e4a-9984-c42f9082c47e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:02.001750 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:02.008679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9508507-05f9-4a41-bd38-45602aac5960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:02.009840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9508507-05f9-4a41-bd38-45602aac5960 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:02.010381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9508507-05f9-4a41-bd38-45602aac5960 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:02.011938 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9508507-05f9-4a41-bd38-45602aac5960 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:02.014201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9508507-05f9-4a41-bd38-45602aac5960 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:02.014874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9508507-05f9-4a41-bd38-45602aac5960 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:02.018380 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9508507-05f9-4a41-bd38-45602aac5960 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:02.051576 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 349/670] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 18 10:20:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:02.052189 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533252a-e22b-4411-8fda-9f396d666068 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:02.053103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9508507-05f9-4a41-bd38-45602aac5960 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:02.108021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80137d28-5ec5-478f-b893-bf00e1ab1c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:02.109397 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80137d28-5ec5-478f-b893-bf00e1ab1c68 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:02.109886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80137d28-5ec5-478f-b893-bf00e1ab1c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:02.110399 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80137d28-5ec5-478f-b893-bf00e1ab1c68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:02.123684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80137d28-5ec5-478f-b893-bf00e1ab1c68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:02.126510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80137d28-5ec5-478f-b893-bf00e1ab1c68 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:02.155179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-80137d28-5ec5-478f-b893-bf00e1ab1c68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:02.155179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:02.155179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:02.155179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:02.155179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:02.155179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:02.155179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:02.155179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:02.155179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:02.155179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:02.155179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:02.155179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:02.155179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:02.155179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:02.155179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:02.156619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:02.158415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:02.158415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:02.158415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:02.158415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:02.158415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:02.158415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:02.158415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:02.158415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:02.158415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 322/671] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:02.163120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80137d28-5ec5-478f-b893-bf00e1ab1c68 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:02.163808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:02.192079 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9508507-05f9-4a41-bd38-45602aac5960 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:02.258751 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b4efe-8724-4da2-baec-1dc69a3b8d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:02.259563 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b4efe-8724-4da2-baec-1dc69a3b8d6b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:02.259997 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b4efe-8724-4da2-baec-1dc69a3b8d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:02.260413 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b4efe-8724-4da2-baec-1dc69a3b8d6b None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:02.261570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b4efe-8724-4da2-baec-1dc69a3b8d6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:02.262195 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b4efe-8724-4da2-baec-1dc69a3b8d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:02.264884 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b4efe-8724-4da2-baec-1dc69a3b8d6b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:02.285951 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 350/672] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:20:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:02.287437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b4efe-8724-4da2-baec-1dc69a3b8d6b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:02.322945 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80137d28-5ec5-478f-b893-bf00e1ab1c68 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:02.362634 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:02.376064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b0985-60fc-4059-8e36-b2affe2ecda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:02.380007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b0985-60fc-4059-8e36-b2affe2ecda2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:02.380007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b0985-60fc-4059-8e36-b2affe2ecda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:02.380007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b0985-60fc-4059-8e36-b2affe2ecda2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:02.459234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b4efe-8724-4da2-baec-1dc69a3b8d6b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:02.483223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b0985-60fc-4059-8e36-b2affe2ecda2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:02.484730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b0985-60fc-4059-8e36-b2affe2ecda2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:02.520490 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd46290-d5c6-4a61-b905-588fc66a4996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:02.521156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd46290-d5c6-4a61-b905-588fc66a4996 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:02.521438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd46290-d5c6-4a61-b905-588fc66a4996 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:02.521719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd46290-d5c6-4a61-b905-588fc66a4996 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:02.522679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd46290-d5c6-4a61-b905-588fc66a4996 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:02.522988 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd46290-d5c6-4a61-b905-588fc66a4996 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:02.524520 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd46290-d5c6-4a61-b905-588fc66a4996 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:02.537004 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:02.545216 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 351/673] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:02.545216 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd46290-d5c6-4a61-b905-588fc66a4996 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:02.638613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 323/674] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:20:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:20:02.639561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b0985-60fc-4059-8e36-b2affe2ecda2 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:02.674998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:02.720428 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd46290-d5c6-4a61-b905-588fc66a4996 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:02.757930 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b0985-60fc-4059-8e36-b2affe2ecda2 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:02.773606 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3594298-340e-42a7-9df8-41d86ec0baa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:02.774815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3594298-340e-42a7-9df8-41d86ec0baa6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:02.775238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3594298-340e-42a7-9df8-41d86ec0baa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:02.775651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3594298-340e-42a7-9df8-41d86ec0baa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:02.790446 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3594298-340e-42a7-9df8-41d86ec0baa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:02.792414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3594298-340e-42a7-9df8-41d86ec0baa6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:02.800593 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee841fdd-6d5f-4f47-ad80-ba5fcfcbc5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:02.801575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee841fdd-6d5f-4f47-ad80-ba5fcfcbc5bb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:02.802053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee841fdd-6d5f-4f47-ad80-ba5fcfcbc5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:02.802543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee841fdd-6d5f-4f47-ad80-ba5fcfcbc5bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:02.803600 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee841fdd-6d5f-4f47-ad80-ba5fcfcbc5bb None admin] RBAC: Adding query filter params (role.id=509fcb6f06144cdd9803fb3910eb80bf, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=3f9385dec85a4e0cba21c2a840124f5a) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:02.803997 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee841fdd-6d5f-4f47-ad80-ba5fcfcbc5bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:02.805539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee841fdd-6d5f-4f47-ad80-ba5fcfcbc5bb None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:02.818730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 324/675] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:20:02 2022] GET /identity/v3/role_assignments?user.id=3f9385dec85a4e0cba21c2a840124f5a&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=509fcb6f06144cdd9803fb3910eb80bf => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:02.818730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf2a9b-ff99-481b-9232-8fcc01104187 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:02.818730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf2a9b-ff99-481b-9232-8fcc01104187 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:02.818730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf2a9b-ff99-481b-9232-8fcc01104187 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:02.819396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-b3594298-340e-42a7-9df8-41d86ec0baa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:02.819396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:02.819396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:02.819396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:02.819396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:02.819396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:02.819396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:02.819396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:02.819396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:02.819396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:02.819396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:02.819396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:02.819396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:02.819396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:02.819396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:02.823830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:02.828521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:02.828521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:02.828521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:02.828521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:02.828835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 325/676] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:02.828835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf2a9b-ff99-481b-9232-8fcc01104187 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:02.828977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 352/677] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:02.829349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3594298-340e-42a7-9df8-41d86ec0baa6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:02.913387 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:02.992252 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:03.002820 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf2a9b-ff99-481b-9232-8fcc01104187 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:03.039701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3594298-340e-42a7-9df8-41d86ec0baa6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:03.074181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4569ef-23b7-46f5-a5f2-e068281e5c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:03.074971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4569ef-23b7-46f5-a5f2-e068281e5c61 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:03.075258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4569ef-23b7-46f5-a5f2-e068281e5c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:03.075545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4569ef-23b7-46f5-a5f2-e068281e5c61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:03.090868 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4569ef-23b7-46f5-a5f2-e068281e5c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:03.092402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4569ef-23b7-46f5-a5f2-e068281e5c61 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:03.100841 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b40c25-2f61-477a-8c9b-96195ff5255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:03.102548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b40c25-2f61-477a-8c9b-96195ff5255d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:03.102968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b40c25-2f61-477a-8c9b-96195ff5255d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:03.103391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b40c25-2f61-477a-8c9b-96195ff5255d None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:03.104324 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b40c25-2f61-477a-8c9b-96195ff5255d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:03.104790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b40c25-2f61-477a-8c9b-96195ff5255d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:03.107728 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b40c25-2f61-477a-8c9b-96195ff5255d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:03.116919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-6d4569ef-23b7-46f5-a5f2-e068281e5c61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:03.116919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:03.116919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:03.116919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:03.116919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:03.116919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:03.116919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:03.116919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:03.116919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:03.116919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:03.116919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:03.116919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:03.116919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:03.116919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:03.116919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:03.118829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:03.120889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:03.120889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:03.120889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:03.120889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:03.120889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 326/678] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:03.120889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d088ba-c775-476f-859e-ef9966e51297 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:03.121734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d088ba-c775-476f-859e-ef9966e51297 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:03.121734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d088ba-c775-476f-859e-ef9966e51297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:03.130181 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 353/679] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:03.131253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b40c25-2f61-477a-8c9b-96195ff5255d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:03.155078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-73d088ba-c775-476f-859e-ef9966e51297 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:03.157345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-73d088ba-c775-476f-859e-ef9966e51297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:03.242893 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b40c25-2f61-477a-8c9b-96195ff5255d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:03.259100 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:03.280449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb92986-78f6-4be7-8f4f-b6dfca5864f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:03.281111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb92986-78f6-4be7-8f4f-b6dfca5864f9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:03.281389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb92986-78f6-4be7-8f4f-b6dfca5864f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:03.281666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb92986-78f6-4be7-8f4f-b6dfca5864f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:03.282400 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb92986-78f6-4be7-8f4f-b6dfca5864f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:03.282776 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb92986-78f6-4be7-8f4f-b6dfca5864f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:03.284228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb92986-78f6-4be7-8f4f-b6dfca5864f9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:03.287786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 327/680] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:20:03.289553 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d088ba-c775-476f-859e-ef9966e51297 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:03.302647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 354/681] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:03.304011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb92986-78f6-4be7-8f4f-b6dfca5864f9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:03.412985 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb92986-78f6-4be7-8f4f-b6dfca5864f9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:03.438560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:03.456173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadf261-e4ab-4a69-877e-942cb2b9f9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:03.457020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadf261-e4ab-4a69-877e-942cb2b9f9bf None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:03.457308 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadf261-e4ab-4a69-877e-942cb2b9f9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:03.457582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadf261-e4ab-4a69-877e-942cb2b9f9bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:03.466675 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadf261-e4ab-4a69-877e-942cb2b9f9bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:03.468695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadf261-e4ab-4a69-877e-942cb2b9f9bf None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:03.484838 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d088ba-c775-476f-859e-ef9966e51297 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:03.486094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-0eadf261-e4ab-4a69-877e-942cb2b9f9bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:03.486094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:03.486094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:03.486094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:03.486094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:03.486094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:03.486094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:03.486094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:03.486094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:03.486094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:03.486094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:03.486094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:03.486094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:03.486094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:03.486094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:03.487679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:03.489386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:03.489386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:03.489386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:03.489386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:03.489386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:03.489386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:03.489386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:03.489386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:03.492228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 355/682] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:03.493177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadf261-e4ab-4a69-877e-942cb2b9f9bf None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:03.542782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:03.556077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa779f5d-31cf-4de7-a19a-678fb1a363b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:03.557982 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa779f5d-31cf-4de7-a19a-678fb1a363b2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:03.558881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa779f5d-31cf-4de7-a19a-678fb1a363b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:03.559446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa779f5d-31cf-4de7-a19a-678fb1a363b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:03.573741 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa779f5d-31cf-4de7-a19a-678fb1a363b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:03.576755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa779f5d-31cf-4de7-a19a-678fb1a363b2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-fa779f5d-31cf-4de7-a19a-678fb1a363b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:03.607517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:03.608994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:03.610684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:03.610684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:03.610684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:03.610684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:03.610684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:03.610684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:03.610684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:03.610684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:03.610684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:20:03.610684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:03.610684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 328/683] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 18 10:20:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:03.612582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa779f5d-31cf-4de7-a19a-678fb1a363b2 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:03.629177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadf261-e4ab-4a69-877e-942cb2b9f9bf None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:03.673262 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbfebf-09f3-4424-b23b-2f0c1012099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:03.674702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbfebf-09f3-4424-b23b-2f0c1012099e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:03.675188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbfebf-09f3-4424-b23b-2f0c1012099e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:03.675613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbfebf-09f3-4424-b23b-2f0c1012099e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:03.688665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbfebf-09f3-4424-b23b-2f0c1012099e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-badbfebf-09f3-4424-b23b-2f0c1012099e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:03.698629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:03.700065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:03.700959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:03.700959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:03.700959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:03.700959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:03.700959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:03.700959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:03.700959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:03.700959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:03.700959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:03.700959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:03.700959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:20:03.700959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:03.703817 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 356/684] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:20:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:03.704815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbfebf-09f3-4424-b23b-2f0c1012099e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:03.812767 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa779f5d-31cf-4de7-a19a-678fb1a363b2 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:03.863912 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:03.874810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbfebf-09f3-4424-b23b-2f0c1012099e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:03.875002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51ca5d-e5fe-493d-9bc9-0bf16ca43206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:03.876169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51ca5d-e5fe-493d-9bc9-0bf16ca43206 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:03.876840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51ca5d-e5fe-493d-9bc9-0bf16ca43206 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:03.877266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51ca5d-e5fe-493d-9bc9-0bf16ca43206 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:03.879926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51ca5d-e5fe-493d-9bc9-0bf16ca43206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:03.879926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51ca5d-e5fe-493d-9bc9-0bf16ca43206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:03.882912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51ca5d-e5fe-493d-9bc9-0bf16ca43206 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:03.888578 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:03.910221 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 329/685] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:03.912039 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51ca5d-e5fe-493d-9bc9-0bf16ca43206 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:03.918162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca7fe2-7f7e-420f-ad41-dde70df5c986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:03.919068 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca7fe2-7f7e-420f-ad41-dde70df5c986 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:03.919492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca7fe2-7f7e-420f-ad41-dde70df5c986 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:03.920830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca7fe2-7f7e-420f-ad41-dde70df5c986 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:03.921872 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca7fe2-7f7e-420f-ad41-dde70df5c986 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:03.922351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca7fe2-7f7e-420f-ad41-dde70df5c986 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:03.924014 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca7fe2-7f7e-420f-ad41-dde70df5c986 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:03.945598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 357/686] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 18 10:20:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:03.947002 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca7fe2-7f7e-420f-ad41-dde70df5c986 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:04.086245 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51ca5d-e5fe-493d-9bc9-0bf16ca43206 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:04.101691 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca7fe2-7f7e-420f-ad41-dde70df5c986 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:04.148074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaff788-abcc-44f0-b842-55901e950251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:04.149187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaff788-abcc-44f0-b842-55901e950251 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:04.149678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaff788-abcc-44f0-b842-55901e950251 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:04.150148 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaff788-abcc-44f0-b842-55901e950251 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:04.151537 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaff788-abcc-44f0-b842-55901e950251 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:04.151681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24415a5b-0c47-4006-b7d8-951bfb55ba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:04.152076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaff788-abcc-44f0-b842-55901e950251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:04.152305 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24415a5b-0c47-4006-b7d8-951bfb55ba93 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:04.153260 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24415a5b-0c47-4006-b7d8-951bfb55ba93 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:04.153566 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24415a5b-0c47-4006-b7d8-951bfb55ba93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:04.154544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24415a5b-0c47-4006-b7d8-951bfb55ba93 None admin] RBAC: Adding query filter params (role.id=509fcb6f06144cdd9803fb3910eb80bf, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=08f27c6bc2744b9f92141a9c6906bc3f) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:04.155077 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24415a5b-0c47-4006-b7d8-951bfb55ba93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:04.155830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaff788-abcc-44f0-b842-55901e950251 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:04.157055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24415a5b-0c47-4006-b7d8-951bfb55ba93 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:04.173822 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 358/687] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:20:03 2022] GET /identity/v3/role_assignments?user.id=08f27c6bc2744b9f92141a9c6906bc3f&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=509fcb6f06144cdd9803fb3910eb80bf => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:04.173822 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24415a5b-0c47-4006-b7d8-951bfb55ba93 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:04.187242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 330/688] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:20:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:04.189766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6d0b7-fd85-4388-a024-060c809bf6f4 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:04.190649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6d0b7-fd85-4388-a024-060c809bf6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:04.191104 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6d0b7-fd85-4388-a024-060c809bf6f4 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:04.194032 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 331/689] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:04.195653 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6d0b7-fd85-4388-a024-060c809bf6f4 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:04.212029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:04.315454 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:04.393307 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6d0b7-fd85-4388-a024-060c809bf6f4 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:04.420198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24415a5b-0c47-4006-b7d8-951bfb55ba93 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:04.445091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aeb18c-5d16-4c22-a942-588633d0fc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:04.445803 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeb18c-5d16-4c22-a942-588633d0fc39 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:04.446084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeb18c-5d16-4c22-a942-588633d0fc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:04.446388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeb18c-5d16-4c22-a942-588633d0fc39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:04.461204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aeb18c-5d16-4c22-a942-588633d0fc39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:04.462867 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aeb18c-5d16-4c22-a942-588633d0fc39 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:04.477992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc41980-87a6-41a6-b0ed-cfa3c212628f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:04.478714 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41980-87a6-41a6-b0ed-cfa3c212628f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:04.479001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41980-87a6-41a6-b0ed-cfa3c212628f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:04.479279 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41980-87a6-41a6-b0ed-cfa3c212628f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:04.484794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-c3aeb18c-5d16-4c22-a942-588633d0fc39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:04.484794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:04.484794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:04.484794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:04.484794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:04.484794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:04.484794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:04.484794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:04.484794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:04.484794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:04.484794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:04.484794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:04.484794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:04.484794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:04.484794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:04.485781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:04.486873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:04.486873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:04.486873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:04.486873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:04.486873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 332/690] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:04.487579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ba218-f471-4130-bde3-cc3d529e0a9a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:04.487877 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ba218-f471-4130-bde3-cc3d529e0a9a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:04.488153 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ba218-f471-4130-bde3-cc3d529e0a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:04.522094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a75ba218-f471-4130-bde3-cc3d529e0a9a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:04.524839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a75ba218-f471-4130-bde3-cc3d529e0a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:04.600769 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc41980-87a6-41a6-b0ed-cfa3c212628f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:04.603432 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc41980-87a6-41a6-b0ed-cfa3c212628f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:04.616047 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 333/691] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:20:04.616927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ba218-f471-4130-bde3-cc3d529e0a9a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:04.627732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:04.730001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 359/692] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:20:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:20:04.735502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc41980-87a6-41a6-b0ed-cfa3c212628f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:04.738017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:04.839032 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ba218-f471-4130-bde3-cc3d529e0a9a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:04.851937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc41980-87a6-41a6-b0ed-cfa3c212628f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:04.877760 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958b81f-7696-44a4-b7ec-4d843e90b3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:04.878473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958b81f-7696-44a4-b7ec-4d843e90b3bc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:04.878760 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958b81f-7696-44a4-b7ec-4d843e90b3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:04.879121 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958b81f-7696-44a4-b7ec-4d843e90b3bc None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:04.879764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958b81f-7696-44a4-b7ec-4d843e90b3bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:04.880069 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958b81f-7696-44a4-b7ec-4d843e90b3bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:04.881523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958b81f-7696-44a4-b7ec-4d843e90b3bc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:04.890996 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:04.895014 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dbf2c-556f-4222-a4d7-e12187aa5359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:04.895854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 334/693] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:04.896491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dbf2c-556f-4222-a4d7-e12187aa5359 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:04.896730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958b81f-7696-44a4-b7ec-4d843e90b3bc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:04.897204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dbf2c-556f-4222-a4d7-e12187aa5359 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:04.897578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dbf2c-556f-4222-a4d7-e12187aa5359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:04.910636 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875dbf2c-556f-4222-a4d7-e12187aa5359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:04.916394 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875dbf2c-556f-4222-a4d7-e12187aa5359 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:04.935358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-875dbf2c-556f-4222-a4d7-e12187aa5359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:04.935358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:04.935358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:04.935358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:04.935358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:04.935358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:04.935358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:04.935358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:04.935358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:04.935358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:04.935358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:04.935358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:04.935358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:04.935358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:04.935358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:04.936525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:04.937506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:04.937506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:04.937506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:04.937506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:04.942744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 360/694] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:04.944236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dbf2c-556f-4222-a4d7-e12187aa5359 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:05.019124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:05.024241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958b81f-7696-44a4-b7ec-4d843e90b3bc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:05.065304 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dbf2c-556f-4222-a4d7-e12187aa5359 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:05.091706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fb085-1253-431d-b1c7-11b5947bae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:05.093853 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fb085-1253-431d-b1c7-11b5947bae31 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:05.094808 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fb085-1253-431d-b1c7-11b5947bae31 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:05.095424 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fb085-1253-431d-b1c7-11b5947bae31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:05.105457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6df1f6-ee06-47d8-9fa8-e7055e81056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:05.106632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6df1f6-ee06-47d8-9fa8-e7055e81056c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:05.107115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6df1f6-ee06-47d8-9fa8-e7055e81056c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:05.107536 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6df1f6-ee06-47d8-9fa8-e7055e81056c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:05.116690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6df1f6-ee06-47d8-9fa8-e7055e81056c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:05.118496 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6df1f6-ee06-47d8-9fa8-e7055e81056c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:05.119464 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fb085-1253-431d-b1c7-11b5947bae31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:05.123768 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fb085-1253-431d-b1c7-11b5947bae31 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-db6df1f6-ee06-47d8-9fa8-e7055e81056c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:05.135729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:05.136782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:05.138342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:05.138342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:05.138342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:05.138342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:05.138342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:05.138342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:05.138342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:05.138342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:05.138342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:20:05.138342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:05.140590 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 361/695] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:20:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:05.141659 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6df1f6-ee06-47d8-9fa8-e7055e81056c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:05.158390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-c09fb085-1253-431d-b1c7-11b5947bae31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:05.158390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:05.158390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:05.158390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:05.158390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:05.158390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:05.158390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:05.158390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:05.158390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:05.158390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:05.158390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:05.158390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:05.158390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:05.158390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:05.158390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:05.160084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:05.161796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:05.161796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:05.161796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:05.161796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:05.161796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 335/696] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:05.161796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fb085-1253-431d-b1c7-11b5947bae31 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:05.191720 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:05.277239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fb085-1253-431d-b1c7-11b5947bae31 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:05.279530 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6df1f6-ee06-47d8-9fa8-e7055e81056c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:05.318472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca504dab-8a3f-4e09-8717-42673de2b270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:05.319656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca504dab-8a3f-4e09-8717-42673de2b270 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:05.320213 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca504dab-8a3f-4e09-8717-42673de2b270 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:05.320731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca504dab-8a3f-4e09-8717-42673de2b270 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:05.321818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca504dab-8a3f-4e09-8717-42673de2b270 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:05.322361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca504dab-8a3f-4e09-8717-42673de2b270 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:05.322599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a13aca-528b-420b-93a1-9e60d78fbce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:05.323681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a13aca-528b-420b-93a1-9e60d78fbce3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:05.324164 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a13aca-528b-420b-93a1-9e60d78fbce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:05.325187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a13aca-528b-420b-93a1-9e60d78fbce3 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:05.325761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca504dab-8a3f-4e09-8717-42673de2b270 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:05.326534 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a13aca-528b-420b-93a1-9e60d78fbce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:05.327080 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a13aca-528b-420b-93a1-9e60d78fbce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:05.330255 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a13aca-528b-420b-93a1-9e60d78fbce3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:05.350803 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 336/697] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 18 10:20:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:05.352092 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca504dab-8a3f-4e09-8717-42673de2b270 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:05.354357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 362/698] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:05.357449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a13aca-528b-420b-93a1-9e60d78fbce3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:05.369276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:05.475197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca504dab-8a3f-4e09-8717-42673de2b270 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:05.475833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:05.493403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a13aca-528b-420b-93a1-9e60d78fbce3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:05.517852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b99e48-a759-4bd2-9980-ea81249ed39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:05.519693 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b99e48-a759-4bd2-9980-ea81249ed39a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:05.520196 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b99e48-a759-4bd2-9980-ea81249ed39a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:05.520694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b99e48-a759-4bd2-9980-ea81249ed39a None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:05.521674 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b99e48-a759-4bd2-9980-ea81249ed39a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:05.522203 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b99e48-a759-4bd2-9980-ea81249ed39a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:05.524149 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b99e48-a759-4bd2-9980-ea81249ed39a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:05.537862 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 337/699] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:05.539134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b99e48-a759-4bd2-9980-ea81249ed39a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:05.556749 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e3149-a453-4013-ae45-ccd097f0658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:05.557942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3149-a453-4013-ae45-ccd097f0658d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:05.558443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3149-a453-4013-ae45-ccd097f0658d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:05.558967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3149-a453-4013-ae45-ccd097f0658d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:05.621831 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:05.655655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e3149-a453-4013-ae45-ccd097f0658d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:05.657337 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e3149-a453-4013-ae45-ccd097f0658d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:05.659002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b99e48-a759-4bd2-9980-ea81249ed39a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:05.702078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc9573-7ed1-470c-93e1-4b838880f8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:05.703205 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9573-7ed1-470c-93e1-4b838880f8c1 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:05.703804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9573-7ed1-470c-93e1-4b838880f8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:05.704546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9573-7ed1-470c-93e1-4b838880f8c1 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:05.705499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc9573-7ed1-470c-93e1-4b838880f8c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:05.707228 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc9573-7ed1-470c-93e1-4b838880f8c1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:05.758181 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:05.777251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 363/700] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:20:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 10:20:05.777251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e3149-a453-4013-ae45-ccd097f0658d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:05.793787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 338/701] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:20:05 2022] POST /identity/v3/users => generated 254 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:20:05.795392 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc9573-7ed1-470c-93e1-4b838880f8c1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:05.941339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc9573-7ed1-470c-93e1-4b838880f8c1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:05.972033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e3149-a453-4013-ae45-ccd097f0658d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:05.982295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:05.999232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41caf631-9a03-40f6-87e4-552d0e5356e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:06.000056 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41caf631-9a03-40f6-87e4-552d0e5356e5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:06.000370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41caf631-9a03-40f6-87e4-552d0e5356e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:06.000679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41caf631-9a03-40f6-87e4-552d0e5356e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:06.020226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41caf631-9a03-40f6-87e4-552d0e5356e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:06.022657 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41caf631-9a03-40f6-87e4-552d0e5356e5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:06.032447 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a99d2f-c900-408a-9295-546bb22fc786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:06.032447 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a99d2f-c900-408a-9295-546bb22fc786 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:06.032447 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a99d2f-c900-408a-9295-546bb22fc786 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:06.032447 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a99d2f-c900-408a-9295-546bb22fc786 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:06.045293 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a99d2f-c900-408a-9295-546bb22fc786 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:06.047736 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a99d2f-c900-408a-9295-546bb22fc786 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:06.050372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-41caf631-9a03-40f6-87e4-552d0e5356e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:06.050372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:06.050372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:06.050372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:06.050372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:06.050372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:06.050372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:06.050372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:06.050372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:06.050372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:06.050372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:06.050372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:06.050372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:06.050372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:06.050372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:06.052276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:06.054060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:06.054060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:06.054060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:06.054060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:06.054060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 339/702] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:06.054060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146a0a4-c931-4f4f-bf11-95148ec14895 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:06.055786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146a0a4-c931-4f4f-bf11-95148ec14895 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:06.055786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146a0a4-c931-4f4f-bf11-95148ec14895 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:06.056254 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 340/703] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:06.062107 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146a0a4-c931-4f4f-bf11-95148ec14895 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:06.078874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-17a99d2f-c900-408a-9295-546bb22fc786 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:06.078874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:06.078874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:06.078874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:06.078874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:06.078874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:06.078874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:06.078874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:06.078874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:06.078874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:06.078874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:06.078874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:06.078874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:06.078874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:06.078874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:06.083329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:06.085071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:06.085071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:06.085071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:06.085071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:06.085071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:06.085071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:06.085071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:06.085071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:06.085071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 364/704] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:06.085071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a2468-5d44-463e-b5bc-0d65758a390e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:06.085071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a2468-5d44-463e-b5bc-0d65758a390e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:06.088195 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a2468-5d44-463e-b5bc-0d65758a390e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:06.115249 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2c7a2468-5d44-463e-b5bc-0d65758a390e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:06.117810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2c7a2468-5d44-463e-b5bc-0d65758a390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:06.206685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:06.239985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146a0a4-c931-4f4f-bf11-95148ec14895 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:06.262776 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 365/705] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:20:06.264472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a2468-5d44-463e-b5bc-0d65758a390e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:06.283353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad330a29-8e2b-46d8-9bf2-ebb417020665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:06.284095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad330a29-8e2b-46d8-9bf2-ebb417020665 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:06.284291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad330a29-8e2b-46d8-9bf2-ebb417020665 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:06.284594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad330a29-8e2b-46d8-9bf2-ebb417020665 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:06.285359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad330a29-8e2b-46d8-9bf2-ebb417020665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:06.285700 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad330a29-8e2b-46d8-9bf2-ebb417020665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:06.287479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad330a29-8e2b-46d8-9bf2-ebb417020665 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:06.301789 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 341/706] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:06.306839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad330a29-8e2b-46d8-9bf2-ebb417020665 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:06.355250 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:06.437299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad330a29-8e2b-46d8-9bf2-ebb417020665 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:06.441545 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a2468-5d44-463e-b5bc-0d65758a390e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:06.475480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138ce9a-68fa-45e2-a227-65b33b909b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:06.476348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138ce9a-68fa-45e2-a227-65b33b909b7e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:06.476847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138ce9a-68fa-45e2-a227-65b33b909b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:06.476965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138ce9a-68fa-45e2-a227-65b33b909b7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:06.485511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138ce9a-68fa-45e2-a227-65b33b909b7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:06.486877 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df80484-cb82-4c42-b359-c908f481f3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:06.487339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138ce9a-68fa-45e2-a227-65b33b909b7e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:06.488153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df80484-cb82-4c42-b359-c908f481f3ad None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:06.488584 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df80484-cb82-4c42-b359-c908f481f3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:06.489195 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df80484-cb82-4c42-b359-c908f481f3ad None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:06.490485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df80484-cb82-4c42-b359-c908f481f3ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:06.490942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df80484-cb82-4c42-b359-c908f481f3ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:06.492632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df80484-cb82-4c42-b359-c908f481f3ad None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:06.503282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-8138ce9a-68fa-45e2-a227-65b33b909b7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:06.503282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:06.503282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:06.503282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:06.503282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:06.503282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:06.503282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:06.503282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:06.503282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:06.503282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:06.503282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:06.503282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:06.503282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:06.503282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:06.503282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:06.504523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:06.505690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:06.505690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:06.505690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:06.505690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:06.505690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:06.505690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:06.505690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:06.505690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:06.505690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 342/707] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:06.506206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138ce9a-68fa-45e2-a227-65b33b909b7e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:06.511669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 366/708] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:06.513809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df80484-cb82-4c42-b359-c908f481f3ad None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:06.559406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:06.669970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df80484-cb82-4c42-b359-c908f481f3ad None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:06.679653 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:06.687212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138ce9a-68fa-45e2-a227-65b33b909b7e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:06.716659 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936e821-cd7b-497a-ba5d-6533f13d6cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:06.717943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936e821-cd7b-497a-ba5d-6533f13d6cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:06.718555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936e821-cd7b-497a-ba5d-6533f13d6cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:06.719016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936e821-cd7b-497a-ba5d-6533f13d6cd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:06.720009 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936e821-cd7b-497a-ba5d-6533f13d6cd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:06.720725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936e821-cd7b-497a-ba5d-6533f13d6cd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:06.722809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936e821-cd7b-497a-ba5d-6533f13d6cd1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:06.739908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 367/709] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:06.741300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936e821-cd7b-497a-ba5d-6533f13d6cd1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:06.749758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707c7c6-6330-4b00-bdc4-ce1388f4ee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:06.750599 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707c7c6-6330-4b00-bdc4-ce1388f4ee06 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:06.750952 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707c7c6-6330-4b00-bdc4-ce1388f4ee06 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:06.751227 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707c7c6-6330-4b00-bdc4-ce1388f4ee06 None admin] PATH_INFO: `/v3/services/network` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:06.751984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707c7c6-6330-4b00-bdc4-ce1388f4ee06 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:06.753395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707c7c6-6330-4b00-bdc4-ce1388f4ee06 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-4707c7c6-6330-4b00-bdc4-ce1388f4ee06 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:06.768726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:06.769879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:06.770778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:06.770778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:06.770778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:06.770778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:06.770778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:06.770778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:06.770778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:06.770778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:06.770778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:06.770778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:06.770778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:06.770778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:06.770778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:20:06.770778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:06.770778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 343/710] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:06 2022] GET /identity/v3/services/network => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:06.771701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707c7c6-6330-4b00-bdc4-ce1388f4ee06 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:06.898203 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:06.909787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936e821-cd7b-497a-ba5d-6533f13d6cd1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:06.937453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707c7c6-6330-4b00-bdc4-ce1388f4ee06 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:06.966392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dd3c8-84b0-45cc-8512-3a10915e6cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:06.966392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dd3c8-84b0-45cc-8512-3a10915e6cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:06.966392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dd3c8-84b0-45cc-8512-3a10915e6cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:06.966392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dd3c8-84b0-45cc-8512-3a10915e6cf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:06.966979 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dd3c8-84b0-45cc-8512-3a10915e6cf3 None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=f7abf6b71ac3454ca547a750cef9220a) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:06.966979 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dd3c8-84b0-45cc-8512-3a10915e6cf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:06.969940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dd3c8-84b0-45cc-8512-3a10915e6cf3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:06.981265 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a024d-1254-4056-b49a-d9b348a5cfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:06.981971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a024d-1254-4056-b49a-d9b348a5cfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:06.982257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a024d-1254-4056-b49a-d9b348a5cfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:06.982554 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a024d-1254-4056-b49a-d9b348a5cfc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:06.983393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a024d-1254-4056-b49a-d9b348a5cfc0 None admin] RBAC: Adding query filter params (role.id=509fcb6f06144cdd9803fb3910eb80bf, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=a8ee2beff1a7487d92c1c5940f2784f1) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:06.983785 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a024d-1254-4056-b49a-d9b348a5cfc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:06.985297 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a024d-1254-4056-b49a-d9b348a5cfc0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:06.986810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 368/711] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:20:06 2022] GET /identity/v3/role_assignments?user.id=f7abf6b71ac3454ca547a750cef9220a&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:06.988722 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dd3c8-84b0-45cc-8512-3a10915e6cf3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:06.992502 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 344/712] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:20:06 2022] GET /identity/v3/role_assignments?user.id=a8ee2beff1a7487d92c1c5940f2784f1&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=509fcb6f06144cdd9803fb3910eb80bf => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:07.144501 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d7b59-3624-45ca-a470-1106d1d26f18 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:07.145194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d7b59-3624-45ca-a470-1106d1d26f18 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:07.145671 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d7b59-3624-45ca-a470-1106d1d26f18 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:07.149739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 345/713] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:07.156942 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667d109-6c47-43dc-83b3-bc6d0a4d9ec6 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:07.157850 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667d109-6c47-43dc-83b3-bc6d0a4d9ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:07.158609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667d109-6c47-43dc-83b3-bc6d0a4d9ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:07.185129 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-7667d109-6c47-43dc-83b3-bc6d0a4d9ec6 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:07.187514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7667d109-6c47-43dc-83b3-bc6d0a4d9ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:07.225182 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:07.267206 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dd3c8-84b0-45cc-8512-3a10915e6cf3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:07.315643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 346/714] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:20:07.330106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea9ae8-b9c5-4c56-bf6b-d02a40d2b217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:07.330869 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea9ae8-b9c5-4c56-bf6b-d02a40d2b217 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:07.331146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea9ae8-b9c5-4c56-bf6b-d02a40d2b217 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:07.331421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea9ae8-b9c5-4c56-bf6b-d02a40d2b217 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:07.332123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea9ae8-b9c5-4c56-bf6b-d02a40d2b217 None admin] RBAC: Adding query filter params (name=network) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:07.332431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea9ae8-b9c5-4c56-bf6b-d02a40d2b217 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:07.333899 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea9ae8-b9c5-4c56-bf6b-d02a40d2b217 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:07.338863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 369/715] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 18 10:20:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:07.345177 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667d109-6c47-43dc-83b3-bc6d0a4d9ec6 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:07.359650 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea9ae8-b9c5-4c56-bf6b-d02a40d2b217 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:07.412383 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:07.526667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667d109-6c47-43dc-83b3-bc6d0a4d9ec6 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:07.538848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea9ae8-b9c5-4c56-bf6b-d02a40d2b217 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:07.585259 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a3ebe-ab95-47c6-8cd4-9fd0ca10979f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:07.586073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a3ebe-ab95-47c6-8cd4-9fd0ca10979f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:07.586410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a3ebe-ab95-47c6-8cd4-9fd0ca10979f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:07.587030 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a3ebe-ab95-47c6-8cd4-9fd0ca10979f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:07.587739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a3ebe-ab95-47c6-8cd4-9fd0ca10979f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:07.589481 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a3ebe-ab95-47c6-8cd4-9fd0ca10979f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:07.595804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649def19-4064-4580-893c-4c9dd4ddf807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:07.597442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649def19-4064-4580-893c-4c9dd4ddf807 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:07.598209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649def19-4064-4580-893c-4c9dd4ddf807 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:07.599001 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649def19-4064-4580-893c-4c9dd4ddf807 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:07.601800 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649def19-4064-4580-893c-4c9dd4ddf807 None admin] RBAC: Adding query filter params (type=network) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:07.602663 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649def19-4064-4580-893c-4c9dd4ddf807 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:07.605358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649def19-4064-4580-893c-4c9dd4ddf807 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-047a3ebe-ab95-47c6-8cd4-9fd0ca10979f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:07.608592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:07.610237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:07.611994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 370/716] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Jul 18 10:20:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:07.616436 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a3ebe-ab95-47c6-8cd4-9fd0ca10979f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:07.624031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 347/717] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 18 10:20:07 2022] GET /identity/v3/services?type=network => generated 124 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:07.763105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:07.793721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a3ebe-ab95-47c6-8cd4-9fd0ca10979f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:07.873216 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f36e3-944f-4c9c-886e-c208f6f69323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:07.873901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f36e3-944f-4c9c-886e-c208f6f69323 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:07.874179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f36e3-944f-4c9c-886e-c208f6f69323 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:07.874483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f36e3-944f-4c9c-886e-c208f6f69323 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:07.875214 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f36e3-944f-4c9c-886e-c208f6f69323 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:07.875524 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f36e3-944f-4c9c-886e-c208f6f69323 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:07.876977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f36e3-944f-4c9c-886e-c208f6f69323 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:07.887592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 371/718] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 18 10:20:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:07.893553 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649def19-4064-4580-893c-4c9dd4ddf807 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:07.959795 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:08.110561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649def19-4064-4580-893c-4c9dd4ddf807 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:08.177007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b27ab-ff49-4ca2-8ee6-a11ca91c8b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:08.178092 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b27ab-ff49-4ca2-8ee6-a11ca91c8b3f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:08.178605 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b27ab-ff49-4ca2-8ee6-a11ca91c8b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:08.179093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b27ab-ff49-4ca2-8ee6-a11ca91c8b3f None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:08.180436 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b27ab-ff49-4ca2-8ee6-a11ca91c8b3f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:08.180981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b27ab-ff49-4ca2-8ee6-a11ca91c8b3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:08.184210 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b27ab-ff49-4ca2-8ee6-a11ca91c8b3f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:08.197299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 348/719] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 18 10:20:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:08.726288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9ece6-d769-459c-b841-3465a7febb03 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:08.727109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9ece6-d769-459c-b841-3465a7febb03 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:08.727109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9ece6-d769-459c-b841-3465a7febb03 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:08.728602 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 372/720] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:08.735025 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4683a4-1a00-4c19-825e-a7c71419576c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:08.735964 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4683a4-1a00-4c19-825e-a7c71419576c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:08.736450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4683a4-1a00-4c19-825e-a7c71419576c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:08.757867 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3a4683a4-1a00-4c19-825e-a7c71419576c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:08.759532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3a4683a4-1a00-4c19-825e-a7c71419576c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:08.838429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 349/721] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:20:08.860317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9ece6-d769-459c-b841-3465a7febb03 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:09.106793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9ece6-d769-459c-b841-3465a7febb03 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:09.171788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62bcd2-0300-42fb-a07d-f1ddf8cd4f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:09.173766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62bcd2-0300-42fb-a07d-f1ddf8cd4f23 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:09.174593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62bcd2-0300-42fb-a07d-f1ddf8cd4f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:09.175392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62bcd2-0300-42fb-a07d-f1ddf8cd4f23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:09.195057 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62bcd2-0300-42fb-a07d-f1ddf8cd4f23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-0a62bcd2-0300-42fb-a07d-f1ddf8cd4f23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:09.204335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:09.205340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:09.206188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:09.206188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:09.206188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:09.206188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:09.206188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:09.206188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:09.206188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:09.206188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:09.206188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:09.206188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:09.206188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:20:09.206188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:09.208824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 373/722] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:20:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:09.225245 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4683a4-1a00-4c19-825e-a7c71419576c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:09.269201 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:09.476007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4683a4-1a00-4c19-825e-a7c71419576c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:09.563449 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665c2b9-5dd9-4ec1-973e-cc4a88b1ef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:09.564588 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665c2b9-5dd9-4ec1-973e-cc4a88b1ef62 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:09.565038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665c2b9-5dd9-4ec1-973e-cc4a88b1ef62 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:09.565492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665c2b9-5dd9-4ec1-973e-cc4a88b1ef62 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:09.566854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665c2b9-5dd9-4ec1-973e-cc4a88b1ef62 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:09.567414 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665c2b9-5dd9-4ec1-973e-cc4a88b1ef62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:09.569896 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665c2b9-5dd9-4ec1-973e-cc4a88b1ef62 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:09.588221 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 350/723] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:20:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:09.596931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62bcd2-0300-42fb-a07d-f1ddf8cd4f23 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:09.645151 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:09.901397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62bcd2-0300-42fb-a07d-f1ddf8cd4f23 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:09.975331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327aa27-6ac8-415b-8f42-d79cbefaa29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:09.976541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327aa27-6ac8-415b-8f42-d79cbefaa29c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:09.976960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327aa27-6ac8-415b-8f42-d79cbefaa29c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:09.977375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327aa27-6ac8-415b-8f42-d79cbefaa29c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:09.999887 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327aa27-6ac8-415b-8f42-d79cbefaa29c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:10.002175 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327aa27-6ac8-415b-8f42-d79cbefaa29c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:10.040824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-b327aa27-6ac8-415b-8f42-d79cbefaa29c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:10.040824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:10.040824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:10.040824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:10.040824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:10.040824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:10.040824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:10.040824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:10.040824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:10.040824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:10.040824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:10.040824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:10.040824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:10.040824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:10.040824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:10.041906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:10.042846 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:10.042846 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:10.042846 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:10.042846 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:10.044334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 374/724] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:10.052452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665c2b9-5dd9-4ec1-973e-cc4a88b1ef62 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:10.242363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:10.290437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665c2b9-5dd9-4ec1-973e-cc4a88b1ef62 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:10.352024 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b76a28-4d05-467f-af8d-c06c3e660ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:10.353147 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b76a28-4d05-467f-af8d-c06c3e660ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:10.353637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b76a28-4d05-467f-af8d-c06c3e660ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:10.354145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b76a28-4d05-467f-af8d-c06c3e660ce5 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:10.355622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b76a28-4d05-467f-af8d-c06c3e660ce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:10.356671 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b76a28-4d05-467f-af8d-c06c3e660ce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:10.359300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b76a28-4d05-467f-af8d-c06c3e660ce5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:10.381927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 351/725] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:10.390692 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327aa27-6ac8-415b-8f42-d79cbefaa29c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:10.576725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:10.647644 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327aa27-6ac8-415b-8f42-d79cbefaa29c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:10.708590 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65907a99-1629-4c3c-9796-dfc7d899097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:10.709992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65907a99-1629-4c3c-9796-dfc7d899097b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:10.710527 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65907a99-1629-4c3c-9796-dfc7d899097b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:10.711019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65907a99-1629-4c3c-9796-dfc7d899097b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:10.733080 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65907a99-1629-4c3c-9796-dfc7d899097b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:10.735944 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65907a99-1629-4c3c-9796-dfc7d899097b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-65907a99-1629-4c3c-9796-dfc7d899097b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:10.777098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:10.778547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:10.779702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:10.779702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:10.779702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:10.779702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:10.779702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:10.779702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:10.779702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:10.779702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:10.779702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:20:10.779702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:10.780807 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 375/726] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 18 10:20:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:10.788849 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b76a28-4d05-467f-af8d-c06c3e660ce5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:10.805742 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7306c4-b4dd-4b5a-af59-03c2836f3f97 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:10.806052 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7306c4-b4dd-4b5a-af59-03c2836f3f97 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:10.806268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7306c4-b4dd-4b5a-af59-03c2836f3f97 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:10.807966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 376/727] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:10.814035 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2269c2-d18b-4f0e-a683-a296d8a10ddb None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:10.814344 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2269c2-d18b-4f0e-a683-a296d8a10ddb None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:10.814627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2269c2-d18b-4f0e-a683-a296d8a10ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:10.841837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8a2269c2-d18b-4f0e-a683-a296d8a10ddb None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:10.843686 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8a2269c2-d18b-4f0e-a683-a296d8a10ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:10.924841 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 377/728] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:20:10.927616 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fffc44-9268-4591-9c46-5d487faf155a None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:10.928128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fffc44-9268-4591-9c46-5d487faf155a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:10.928743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fffc44-9268-4591-9c46-5d487faf155a None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:10.935181 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 378/729] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:10.938223 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8779-baba-428d-986b-4ca27cfba64a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:10.938808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8779-baba-428d-986b-4ca27cfba64a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:10.939310 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8779-baba-428d-986b-4ca27cfba64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:10.941418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b76a28-4d05-467f-af8d-c06c3e660ce5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:10.958852 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5cef8779-baba-428d-986b-4ca27cfba64a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:10.960376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5cef8779-baba-428d-986b-4ca27cfba64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:10.991638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf9779-83c6-485f-aa0c-37893a9ffaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:10.992314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf9779-83c6-485f-aa0c-37893a9ffaf3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:10.992599 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf9779-83c6-485f-aa0c-37893a9ffaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:10.992876 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf9779-83c6-485f-aa0c-37893a9ffaf3 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:10.993720 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf9779-83c6-485f-aa0c-37893a9ffaf3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:10.994065 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf9779-83c6-485f-aa0c-37893a9ffaf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:10.995560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf9779-83c6-485f-aa0c-37893a9ffaf3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:10.998995 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:11.015785 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 352/730] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 18 10:20:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:11.016682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf9779-83c6-485f-aa0c-37893a9ffaf3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:11.022928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:11.050452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 379/731] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:20:11.051784 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef8779-baba-428d-986b-4ca27cfba64a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:11.171550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf9779-83c6-485f-aa0c-37893a9ffaf3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:11.180823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef8779-baba-428d-986b-4ca27cfba64a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:11.222139 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229ba7c-0cd2-47c0-b523-9abfed192739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:11.223821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229ba7c-0cd2-47c0-b523-9abfed192739 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:11.224710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229ba7c-0cd2-47c0-b523-9abfed192739 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:11.225616 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229ba7c-0cd2-47c0-b523-9abfed192739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:11.228154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5d048-8222-4994-9ff0-064208057ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:11.229033 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5d048-8222-4994-9ff0-064208057ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:11.229408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5d048-8222-4994-9ff0-064208057ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:11.229761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5d048-8222-4994-9ff0-064208057ba0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:11.242077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5d048-8222-4994-9ff0-064208057ba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-7fc5d048-8222-4994-9ff0-064208057ba0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:11.250762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:11.252943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:11.254898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:11.254898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:11.254898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:11.254898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:11.254898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:11.254898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:11.254898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:11.254898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:11.254898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:11.254898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:11.254898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:11.254898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:11.258153 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 353/732] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:20:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:11.259543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5d048-8222-4994-9ff0-064208057ba0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:11.316618 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:11.338471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:11.364187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5d048-8222-4994-9ff0-064208057ba0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:11.368031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229ba7c-0cd2-47c0-b523-9abfed192739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:11.369519 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229ba7c-0cd2-47c0-b523-9abfed192739 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:11.415267 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3095c-d63a-4342-a93b-f150b03a3905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:11.416092 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3095c-d63a-4342-a93b-f150b03a3905 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:11.416278 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3095c-d63a-4342-a93b-f150b03a3905 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:11.416620 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3095c-d63a-4342-a93b-f150b03a3905 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:11.429493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3095c-d63a-4342-a93b-f150b03a3905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-22b3095c-d63a-4342-a93b-f150b03a3905 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:11.442034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:11.443623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:11.444975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:11.444975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:11.444975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:11.444975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:11.444975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:11.444975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:11.444975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:11.444975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:11.444975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:11.444975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:11.444975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:11.444975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:11.444975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 354/733] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:20:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:11.447468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b0333-e980-4b60-bfc6-03b5030701ce None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:11.447468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b0333-e980-4b60-bfc6-03b5030701ce None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:11.447468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b0333-e980-4b60-bfc6-03b5030701ce None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:11.450365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 355/734] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:11.450998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b0333-e980-4b60-bfc6-03b5030701ce None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:11.534787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 380/735] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:20:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:20:11.536169 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229ba7c-0cd2-47c0-b523-9abfed192739 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:11.602844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b0333-e980-4b60-bfc6-03b5030701ce None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:11.617656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:11.639515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e7668-58aa-4e58-9c2c-170ec8e894ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:11.640245 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e7668-58aa-4e58-9c2c-170ec8e894ca None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:11.640792 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e7668-58aa-4e58-9c2c-170ec8e894ca None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:11.641291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e7668-58aa-4e58-9c2c-170ec8e894ca None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:11.642470 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e7668-58aa-4e58-9c2c-170ec8e894ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:11.642778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e7668-58aa-4e58-9c2c-170ec8e894ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:11.644156 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e7668-58aa-4e58-9c2c-170ec8e894ca None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:11.658236 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 356/736] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:20:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:11.659738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167edb9b-4ab0-4bb7-985d-4e1c5bf54b44 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:11.660048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167edb9b-4ab0-4bb7-985d-4e1c5bf54b44 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:11.660318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167edb9b-4ab0-4bb7-985d-4e1c5bf54b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:11.668599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:11.678652 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-167edb9b-4ab0-4bb7-985d-4e1c5bf54b44 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:11.679905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-167edb9b-4ab0-4bb7-985d-4e1c5bf54b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:11.693018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229ba7c-0cd2-47c0-b523-9abfed192739 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:11.743799 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90317972-eb0e-48a1-a535-a8f0eab9edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:11.744474 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90317972-eb0e-48a1-a535-a8f0eab9edaa None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:11.744757 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90317972-eb0e-48a1-a535-a8f0eab9edaa None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:11.745033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90317972-eb0e-48a1-a535-a8f0eab9edaa None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:11.745778 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90317972-eb0e-48a1-a535-a8f0eab9edaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:11.746758 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90317972-eb0e-48a1-a535-a8f0eab9edaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:11.748153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90317972-eb0e-48a1-a535-a8f0eab9edaa None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:11.759237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 381/737] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:20:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:11.760462 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90317972-eb0e-48a1-a535-a8f0eab9edaa None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:11.769346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 357/738] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:20:11.770618 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167edb9b-4ab0-4bb7-985d-4e1c5bf54b44 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:11.898638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167edb9b-4ab0-4bb7-985d-4e1c5bf54b44 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:11.907850 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:11.919354 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90317972-eb0e-48a1-a535-a8f0eab9edaa None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:11.937020 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26672d92-64f1-43c0-93a4-41c05da8bf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:11.937742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26672d92-64f1-43c0-93a4-41c05da8bf4e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:11.938026 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26672d92-64f1-43c0-93a4-41c05da8bf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:11.938304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26672d92-64f1-43c0-93a4-41c05da8bf4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:11.951398 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26672d92-64f1-43c0-93a4-41c05da8bf4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:11.952890 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26672d92-64f1-43c0-93a4-41c05da8bf4e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:11.973837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-26672d92-64f1-43c0-93a4-41c05da8bf4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:11.973837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:11.973837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:11.973837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:11.973837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:11.973837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:11.973837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:11.973837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:11.973837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:11.973837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:11.973837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:11.973837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:11.973837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:11.973837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:11.973837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:11.975355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:11.977336 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:11.977336 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:11.977336 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:11.977336 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:11.977336 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 358/739] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:11.977336 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26672d92-64f1-43c0-93a4-41c05da8bf4e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:11.984892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559da052-059b-45f3-a1b4-e447bce408cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:11.986134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559da052-059b-45f3-a1b4-e447bce408cb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:11.986636 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559da052-059b-45f3-a1b4-e447bce408cb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:11.987080 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559da052-059b-45f3-a1b4-e447bce408cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:12.003380 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559da052-059b-45f3-a1b4-e447bce408cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:12.005145 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559da052-059b-45f3-a1b4-e447bce408cb None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:12.014314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:12.028036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-559da052-059b-45f3-a1b4-e447bce408cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:12.028036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:12.028036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:12.028036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:12.028036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:12.028036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:12.028036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:12.028036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:12.028036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:12.028036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:12.028036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:12.028036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:12.028036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:12.028036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:12.028036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:12.034124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:12.035710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:12.035710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:12.035710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:12.035710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:12.035710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 382/740] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:12.035710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559da052-059b-45f3-a1b4-e447bce408cb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:12.106472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26672d92-64f1-43c0-93a4-41c05da8bf4e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:12.148625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e51a9-ab9b-45f3-82e9-3c710ea2e995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:12.149427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e51a9-ab9b-45f3-82e9-3c710ea2e995 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:12.149722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e51a9-ab9b-45f3-82e9-3c710ea2e995 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:12.150002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e51a9-ab9b-45f3-82e9-3c710ea2e995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:12.155856 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559da052-059b-45f3-a1b4-e447bce408cb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:12.163665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e51a9-ab9b-45f3-82e9-3c710ea2e995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:12.165988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e51a9-ab9b-45f3-82e9-3c710ea2e995 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:12.190312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c30b2c-3c27-426a-9ced-52c2689fc131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:12.190926 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c30b2c-3c27-426a-9ced-52c2689fc131 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:12.191205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c30b2c-3c27-426a-9ced-52c2689fc131 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:12.191477 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c30b2c-3c27-426a-9ced-52c2689fc131 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:12.192197 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c30b2c-3c27-426a-9ced-52c2689fc131 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:12.193562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c30b2c-3c27-426a-9ced-52c2689fc131 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:12.194055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-d16e51a9-ab9b-45f3-82e9-3c710ea2e995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:12.194055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:12.194055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:12.194055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:12.194055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:12.194055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:12.194055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:12.194055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:12.194055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:12.194055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:12.194055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:12.194055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:12.194055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:12.194055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:12.194055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:12.195486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:12.196426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:12.196426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:12.196426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:12.196426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:12.196426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 359/741] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:12.197719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0267f-ad21-48c6-b056-77c9785b2219 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:12.198170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0267f-ad21-48c6-b056-77c9785b2219 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:12.198616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0267f-ad21-48c6-b056-77c9785b2219 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:12.201368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 360/742] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:12.202264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0267f-ad21-48c6-b056-77c9785b2219 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:12.220257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:12.305455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 383/743] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 18 10:20:12 2022] POST /identity/v3/services => generated 240 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:20:12.306678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c30b2c-3c27-426a-9ced-52c2689fc131 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:12.388107 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0267f-ad21-48c6-b056-77c9785b2219 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:12.418439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:12.437227 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960209c-f28d-4593-ba01-d1a99aff8c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:12.437914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960209c-f28d-4593-ba01-d1a99aff8c33 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:12.438195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960209c-f28d-4593-ba01-d1a99aff8c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:12.438505 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960209c-f28d-4593-ba01-d1a99aff8c33 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:12.439243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960209c-f28d-4593-ba01-d1a99aff8c33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:12.439609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960209c-f28d-4593-ba01-d1a99aff8c33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:12.441217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960209c-f28d-4593-ba01-d1a99aff8c33 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:12.460071 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 361/744] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:12.460071 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960209c-f28d-4593-ba01-d1a99aff8c33 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:12.493516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c30b2c-3c27-426a-9ced-52c2689fc131 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:12.536558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:12.549481 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bd6e2-7a8f-4314-8a4f-76dd60453be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:12.550153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bd6e2-7a8f-4314-8a4f-76dd60453be6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:12.550456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bd6e2-7a8f-4314-8a4f-76dd60453be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:12.550766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bd6e2-7a8f-4314-8a4f-76dd60453be6 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:12.551449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bd6e2-7a8f-4314-8a4f-76dd60453be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:12.551754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bd6e2-7a8f-4314-8a4f-76dd60453be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:12.553128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bd6e2-7a8f-4314-8a4f-76dd60453be6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:12.569743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 384/745] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:12.571419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e80a7-2069-4495-aace-d11e662b574b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:12.571721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e80a7-2069-4495-aace-d11e662b574b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:12.571965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e80a7-2069-4495-aace-d11e662b574b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:12.588509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960209c-f28d-4593-ba01-d1a99aff8c33 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:12.590874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b78e80a7-2069-4495-aace-d11e662b574b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:12.592694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b78e80a7-2069-4495-aace-d11e662b574b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:12.631884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792543d-3a02-490c-980d-fb5f18f45009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:12.632805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792543d-3a02-490c-980d-fb5f18f45009 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:12.633087 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792543d-3a02-490c-980d-fb5f18f45009 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:12.633359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792543d-3a02-490c-980d-fb5f18f45009 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:12.634066 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792543d-3a02-490c-980d-fb5f18f45009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:12.634386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792543d-3a02-490c-980d-fb5f18f45009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:12.635766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792543d-3a02-490c-980d-fb5f18f45009 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:12.650260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 362/746] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:12.651112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792543d-3a02-490c-980d-fb5f18f45009 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:12.667375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 385/747] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:12 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:20:12.668570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e80a7-2069-4495-aace-d11e662b574b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:12.753002 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:12.787546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792543d-3a02-490c-980d-fb5f18f45009 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:12.818269 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:12.827245 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bfab4-f465-4da3-8340-3a3a82c8a9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:12.828034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bfab4-f465-4da3-8340-3a3a82c8a9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:12.828312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bfab4-f465-4da3-8340-3a3a82c8a9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:12.828585 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bfab4-f465-4da3-8340-3a3a82c8a9c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:12.831700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e80a7-2069-4495-aace-d11e662b574b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:12.837260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bfab4-f465-4da3-8340-3a3a82c8a9c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:12.838735 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bfab4-f465-4da3-8340-3a3a82c8a9c5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-4a2bfab4-f465-4da3-8340-3a3a82c8a9c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:12.857711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:12.858965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:12.860123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:12.860123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:12.860123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:12.860123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:12.860123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:12.860123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:12.860123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:12.860123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:12.860123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:20:12.860123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:12.868003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 363/748] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 18 10:20:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:12.869316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bfab4-f465-4da3-8340-3a3a82c8a9c5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:12.883195 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069d3e8-47d4-4546-afd5-32d1dab245b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:12.883971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069d3e8-47d4-4546-afd5-32d1dab245b9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:12.884254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069d3e8-47d4-4546-afd5-32d1dab245b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:12.884526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069d3e8-47d4-4546-afd5-32d1dab245b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:12.892569 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069d3e8-47d4-4546-afd5-32d1dab245b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:12.894027 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069d3e8-47d4-4546-afd5-32d1dab245b9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:12.909335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-c069d3e8-47d4-4546-afd5-32d1dab245b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:12.909335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:12.909335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:12.909335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:12.909335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:12.909335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:12.909335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:12.909335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:12.909335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:12.909335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:12.909335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:12.909335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:12.909335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:12.909335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:12.909335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:12.910290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:12.911562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:12.911562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:12.911562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:12.911562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:12.911562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:12.911562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:12.911562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:12.911562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:12.915333 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 386/749] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:12.916186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069d3e8-47d4-4546-afd5-32d1dab245b9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:12.981658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bfab4-f465-4da3-8340-3a3a82c8a9c5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:13.036775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2d60b-8070-4bf8-b613-0465d5e3edf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:13.037881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2d60b-8070-4bf8-b613-0465d5e3edf1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:13.038394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2d60b-8070-4bf8-b613-0465d5e3edf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:13.038878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2d60b-8070-4bf8-b613-0465d5e3edf1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:13.051428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2d60b-8070-4bf8-b613-0465d5e3edf1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:13.053991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2d60b-8070-4bf8-b613-0465d5e3edf1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:13.065766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069d3e8-47d4-4546-afd5-32d1dab245b9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-fac2d60b-8070-4bf8-b613-0465d5e3edf1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:13.079991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:13.081892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:13.083757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:13.083757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:13.083757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:13.083757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:13.083757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:13.083757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:13.083757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:13.083757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:13.083757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:20:13.083757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:13.084812 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:13.089254 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 364/750] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:20:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:13.091228 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2d60b-8070-4bf8-b613-0465d5e3edf1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:13.129064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c838c95-84c9-4b58-b5fc-3dc663ad4dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:13.129788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c838c95-84c9-4b58-b5fc-3dc663ad4dd6 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:13.130545 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c838c95-84c9-4b58-b5fc-3dc663ad4dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:13.130545 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c838c95-84c9-4b58-b5fc-3dc663ad4dd6 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:13.131119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c838c95-84c9-4b58-b5fc-3dc663ad4dd6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:13.132879 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c838c95-84c9-4b58-b5fc-3dc663ad4dd6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:13.156461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:13.181497 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 387/751] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 18 10:20:12 2022] POST /identity/v3/services => generated 251 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:20:13.183461 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c838c95-84c9-4b58-b5fc-3dc663ad4dd6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:13.238248 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2d60b-8070-4bf8-b613-0465d5e3edf1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:13.299084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de13d96-c33c-4709-86ef-6fc04133fe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:13.299748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de13d96-c33c-4709-86ef-6fc04133fe42 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:13.300127 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de13d96-c33c-4709-86ef-6fc04133fe42 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:13.300478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de13d96-c33c-4709-86ef-6fc04133fe42 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:13.301361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de13d96-c33c-4709-86ef-6fc04133fe42 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:13.301675 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de13d96-c33c-4709-86ef-6fc04133fe42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:13.303403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de13d96-c33c-4709-86ef-6fc04133fe42 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:13.332382 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 365/752] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 18 10:20:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:13.332382 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de13d96-c33c-4709-86ef-6fc04133fe42 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:13.363282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c838c95-84c9-4b58-b5fc-3dc663ad4dd6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:13.406603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5bfd5-5078-40e7-b60a-59fd64374af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:13.407297 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5bfd5-5078-40e7-b60a-59fd64374af9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:13.407578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5bfd5-5078-40e7-b60a-59fd64374af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:13.407851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5bfd5-5078-40e7-b60a-59fd64374af9 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:13.408799 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5bfd5-5078-40e7-b60a-59fd64374af9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:13.409903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5bfd5-5078-40e7-b60a-59fd64374af9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:13.411389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5bfd5-5078-40e7-b60a-59fd64374af9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:13.427380 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 388/753] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:13.428235 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5bfd5-5078-40e7-b60a-59fd64374af9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:13.466909 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:13.469291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:13.474587 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de13d96-c33c-4709-86ef-6fc04133fe42 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:13.522386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a12099-2eda-4750-8a49-bc68d2138674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:13.523093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a12099-2eda-4750-8a49-bc68d2138674 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:13.523371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a12099-2eda-4750-8a49-bc68d2138674 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:13.523644 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a12099-2eda-4750-8a49-bc68d2138674 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:13.524558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a12099-2eda-4750-8a49-bc68d2138674 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:13.524860 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a12099-2eda-4750-8a49-bc68d2138674 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:13.526312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a12099-2eda-4750-8a49-bc68d2138674 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:13.551613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 366/754] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 18 10:20:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:13.551915 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5bfd5-5078-40e7-b60a-59fd64374af9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:13.552903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a12099-2eda-4750-8a49-bc68d2138674 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:13.588611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7e70b-edb9-4a68-89eb-d164569a60c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:13.589468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7e70b-edb9-4a68-89eb-d164569a60c1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:13.590284 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7e70b-edb9-4a68-89eb-d164569a60c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:13.590639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7e70b-edb9-4a68-89eb-d164569a60c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:13.602800 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7e70b-edb9-4a68-89eb-d164569a60c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:13.604366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7e70b-edb9-4a68-89eb-d164569a60c1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:13.624294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-38e7e70b-edb9-4a68-89eb-d164569a60c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:13.624294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:13.624294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:13.624294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:13.624294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:13.624294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:13.624294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:13.624294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:13.624294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:13.624294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:13.624294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:13.624294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:13.624294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:13.624294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:13.624294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:13.625273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:13.626254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:13.626254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:13.626254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:13.626254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:13.630382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 389/755] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:13.631185 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7e70b-edb9-4a68-89eb-d164569a60c1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:13.715420 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a12099-2eda-4750-8a49-bc68d2138674 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:13.734725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:13.748318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7e70b-edb9-4a68-89eb-d164569a60c1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:13.754448 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63ef04-2eee-435b-b10c-b90c8bd77c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:13.755124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63ef04-2eee-435b-b10c-b90c8bd77c71 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:13.755404 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63ef04-2eee-435b-b10c-b90c8bd77c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:13.755678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63ef04-2eee-435b-b10c-b90c8bd77c71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:13.756694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63ef04-2eee-435b-b10c-b90c8bd77c71 None admin] RBAC: Adding query filter params (role.id=509fcb6f06144cdd9803fb3910eb80bf, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=8c34067d12a34f8ab2061460e86ef135) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:13.757157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63ef04-2eee-435b-b10c-b90c8bd77c71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:13.759051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63ef04-2eee-435b-b10c-b90c8bd77c71 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:13.770519 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 367/756] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:20:13 2022] GET /identity/v3/role_assignments?user.id=8c34067d12a34f8ab2061460e86ef135&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=509fcb6f06144cdd9803fb3910eb80bf => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:13.771774 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63ef04-2eee-435b-b10c-b90c8bd77c71 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:13.791596 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fa010-7509-45d8-ab41-1b63f56c63b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:13.792271 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fa010-7509-45d8-ab41-1b63f56c63b6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:13.792621 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fa010-7509-45d8-ab41-1b63f56c63b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:13.793421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fa010-7509-45d8-ab41-1b63f56c63b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:13.866819 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:13.880578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fa010-7509-45d8-ab41-1b63f56c63b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:13.885025 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fa010-7509-45d8-ab41-1b63f56c63b6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:13.994790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:14.017710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 390/757] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:20:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:20:14.023494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fa010-7509-45d8-ab41-1b63f56c63b6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:14.093153 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63ef04-2eee-435b-b10c-b90c8bd77c71 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:14.149843 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fa010-7509-45d8-ab41-1b63f56c63b6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:14.174120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e709134-6e9c-40a2-9461-cdef2a191057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:14.175335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e709134-6e9c-40a2-9461-cdef2a191057 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:14.175861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e709134-6e9c-40a2-9461-cdef2a191057 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:14.176346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e709134-6e9c-40a2-9461-cdef2a191057 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:14.177331 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e709134-6e9c-40a2-9461-cdef2a191057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:14.177875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e709134-6e9c-40a2-9461-cdef2a191057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:14.184758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e709134-6e9c-40a2-9461-cdef2a191057 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:14.209618 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 368/758] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:14.210172 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658477e-d900-4780-a902-6ee67c5936ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:14.211030 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658477e-d900-4780-a902-6ee67c5936ff None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:14.211320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658477e-d900-4780-a902-6ee67c5936ff None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:14.211636 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658477e-d900-4780-a902-6ee67c5936ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:14.216947 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e709134-6e9c-40a2-9461-cdef2a191057 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:14.230846 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658477e-d900-4780-a902-6ee67c5936ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:14.232473 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658477e-d900-4780-a902-6ee67c5936ff None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:14.269257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-6658477e-d900-4780-a902-6ee67c5936ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:14.269257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:14.269257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:14.269257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:14.269257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:14.269257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:14.269257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:14.269257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:14.269257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:14.269257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:14.269257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:14.269257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:14.269257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:14.269257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:14.269257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:14.270256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:14.271189 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:14.271189 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:14.271189 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:14.271189 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:14.273697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 391/759] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:14.280662 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658477e-d900-4780-a902-6ee67c5936ff None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:14.315702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:14.401378 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658477e-d900-4780-a902-6ee67c5936ff None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:14.438503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:14.462662 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20affb-b984-465d-b22d-c3eff53065c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:14.463361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20affb-b984-465d-b22d-c3eff53065c8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:14.463638 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20affb-b984-465d-b22d-c3eff53065c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:14.463907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20affb-b984-465d-b22d-c3eff53065c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:14.464627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20affb-b984-465d-b22d-c3eff53065c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:14.465925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20affb-b984-465d-b22d-c3eff53065c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:14.467356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20affb-b984-465d-b22d-c3eff53065c8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:14.472661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e709134-6e9c-40a2-9461-cdef2a191057 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:14.500530 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 392/760] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:14.508371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20affb-b984-465d-b22d-c3eff53065c8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:14.545501 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249a1b5-7e1f-4d73-9ef1-0532aba3a2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:14.546306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249a1b5-7e1f-4d73-9ef1-0532aba3a2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:14.546608 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249a1b5-7e1f-4d73-9ef1-0532aba3a2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:14.546880 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249a1b5-7e1f-4d73-9ef1-0532aba3a2c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:14.558607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249a1b5-7e1f-4d73-9ef1-0532aba3a2c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:14.560552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249a1b5-7e1f-4d73-9ef1-0532aba3a2c8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:14.587888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-2249a1b5-7e1f-4d73-9ef1-0532aba3a2c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:14.587888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:14.587888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:14.587888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:14.587888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:14.587888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:14.587888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:14.587888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:14.587888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:14.587888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:14.587888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:14.587888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:14.587888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:14.587888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:14.587888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:14.588842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:14.589857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:14.589857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:14.589857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:14.589857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:14.589857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:14.589857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:14.589857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:14.589857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:14.589857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 369/761] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:14.596749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249a1b5-7e1f-4d73-9ef1-0532aba3a2c8 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:14.713468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249a1b5-7e1f-4d73-9ef1-0532aba3a2c8 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:14.752784 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119dd4b-3a3f-4170-b743-3a8c61a1a71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:14.753845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119dd4b-3a3f-4170-b743-3a8c61a1a71b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:14.754393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119dd4b-3a3f-4170-b743-3a8c61a1a71b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:14.754873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119dd4b-3a3f-4170-b743-3a8c61a1a71b None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:14.755871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119dd4b-3a3f-4170-b743-3a8c61a1a71b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:14.756386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119dd4b-3a3f-4170-b743-3a8c61a1a71b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:14.758349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119dd4b-3a3f-4170-b743-3a8c61a1a71b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:14.762759 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:14.773507 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 370/762] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:14.782715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119dd4b-3a3f-4170-b743-3a8c61a1a71b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:14.783066 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:14.788727 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20affb-b984-465d-b22d-c3eff53065c8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:14.828971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062740b-f98d-4894-bb41-f3e28fb320cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:14.829784 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062740b-f98d-4894-bb41-f3e28fb320cf None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:14.830065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062740b-f98d-4894-bb41-f3e28fb320cf None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:14.830350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062740b-f98d-4894-bb41-f3e28fb320cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:14.837974 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062740b-f98d-4894-bb41-f3e28fb320cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:14.839494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062740b-f98d-4894-bb41-f3e28fb320cf None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:14.855036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-1062740b-f98d-4894-bb41-f3e28fb320cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:14.855036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:14.855036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:14.855036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:14.855036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:14.855036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:14.855036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:14.855036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:14.855036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:14.855036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:14.855036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:14.855036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:14.855036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:14.855036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:14.855036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:14.856868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:14.857782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:14.857782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:14.857782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:14.857782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:14.857782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:14.857782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:14.857782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:14.857782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:14.861917 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 393/763] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:14.863341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360daea8-63e5-4770-af60-bad4c0a69dd6 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:14.863680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360daea8-63e5-4770-af60-bad4c0a69dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:14.863900 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360daea8-63e5-4770-af60-bad4c0a69dd6 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:14.869445 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 394/764] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:14.870595 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360daea8-63e5-4770-af60-bad4c0a69dd6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:14.906113 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119dd4b-3a3f-4170-b743-3a8c61a1a71b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:14.944572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9339c38-ad3f-402c-bae5-9d4619accc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:14.945805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9339c38-ad3f-402c-bae5-9d4619accc3b None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:14.946354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9339c38-ad3f-402c-bae5-9d4619accc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:14.946815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9339c38-ad3f-402c-bae5-9d4619accc3b None admin] PATH_INFO: `/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/f7abf6b71ac3454ca547a750cef9220a/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:14.949252 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9339c38-ad3f-402c-bae5-9d4619accc3b None admin] RBAC: Authorizing `identity:create_grant(project_id=40e0b5ee15df481cbc01333131f3def0, user_id=f7abf6b71ac3454ca547a750cef9220a, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:14.951488 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9339c38-ad3f-402c-bae5-9d4619accc3b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:14.981160 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360daea8-63e5-4770-af60-bad4c0a69dd6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:15.019295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848c470-c3d0-44c3-8e99-a25a391d08c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:15.019955 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848c470-c3d0-44c3-8e99-a25a391d08c1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:15.020241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848c470-c3d0-44c3-8e99-a25a391d08c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:15.020550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848c470-c3d0-44c3-8e99-a25a391d08c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:15.021342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848c470-c3d0-44c3-8e99-a25a391d08c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:15.021653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848c470-c3d0-44c3-8e99-a25a391d08c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:15.023162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848c470-c3d0-44c3-8e99-a25a391d08c1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:15.040663 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 395/765] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:15.042053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82128de-7b1c-472b-b14c-27d48dabb7cd None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:15.042365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82128de-7b1c-472b-b14c-27d48dabb7cd None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:15.042653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82128de-7b1c-472b-b14c-27d48dabb7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:15.050369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 371/766] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:20:14 2022] PUT /identity/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/f7abf6b71ac3454ca547a750cef9220a/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:20:15.053338 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9339c38-ad3f-402c-bae5-9d4619accc3b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:15.086195 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b82128de-7b1c-472b-b14c-27d48dabb7cd None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:15.089706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b82128de-7b1c-472b-b14c-27d48dabb7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:15.107011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:15.195709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:15.242568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 396/767] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:15.272717 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9339c38-ad3f-402c-bae5-9d4619accc3b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:15.281681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82128de-7b1c-472b-b14c-27d48dabb7cd None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:15.334448 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02b5c2-7f47-4c8a-8970-be4b8926def2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:15.335621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02b5c2-7f47-4c8a-8970-be4b8926def2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:15.336102 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02b5c2-7f47-4c8a-8970-be4b8926def2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:15.336571 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02b5c2-7f47-4c8a-8970-be4b8926def2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:15.337616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02b5c2-7f47-4c8a-8970-be4b8926def2 None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=a8ee2beff1a7487d92c1c5940f2784f1) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:15.338234 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02b5c2-7f47-4c8a-8970-be4b8926def2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:15.340648 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02b5c2-7f47-4c8a-8970-be4b8926def2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:15.348445 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 372/768] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:20:15 2022] GET /identity/v3/role_assignments?user.id=a8ee2beff1a7487d92c1c5940f2784f1&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:15.416790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82128de-7b1c-472b-b14c-27d48dabb7cd None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:15.461389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76fa30-2e65-4152-9e15-cc952a8bc893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:15.462199 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76fa30-2e65-4152-9e15-cc952a8bc893 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:15.462507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76fa30-2e65-4152-9e15-cc952a8bc893 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:15.462781 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76fa30-2e65-4152-9e15-cc952a8bc893 None admin] PATH_INFO: `/v3/services/network` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:15.463442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76fa30-2e65-4152-9e15-cc952a8bc893 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:15.464898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76fa30-2e65-4152-9e15-cc952a8bc893 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-da76fa30-2e65-4152-9e15-cc952a8bc893 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:15.478370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:15.479449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:15.480288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:15.480288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:15.480288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:15.480288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:15.480288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:15.480288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:15.480288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:15.480288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:15.480288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:15.480288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:15.480288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:15.480288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:15.480288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:20:15.480288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:15.480288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 397/769] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:15 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:15.488125 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02b5c2-7f47-4c8a-8970-be4b8926def2 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:15.635521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e149463-0a18-4bda-b420-9e809d263706 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:15.636301 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e149463-0a18-4bda-b420-9e809d263706 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:15.636734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e149463-0a18-4bda-b420-9e809d263706 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:15.642224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 398/770] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:15.647949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a1376-3ba2-4ec7-8417-53b04057ae58 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:15.648227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a1376-3ba2-4ec7-8417-53b04057ae58 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:15.648649 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a1376-3ba2-4ec7-8417-53b04057ae58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:15.664171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:15.665675 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02b5c2-7f47-4c8a-8970-be4b8926def2 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:15.672157 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-db1a1376-3ba2-4ec7-8417-53b04057ae58 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:15.673883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-db1a1376-3ba2-4ec7-8417-53b04057ae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:15.701454 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:15.715561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356eda46-245d-4a75-9d6b-ade9c2c6ac6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:15.717362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356eda46-245d-4a75-9d6b-ade9c2c6ac6a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:15.717838 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356eda46-245d-4a75-9d6b-ade9c2c6ac6a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:15.718376 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356eda46-245d-4a75-9d6b-ade9c2c6ac6a None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:15.719320 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356eda46-245d-4a75-9d6b-ade9c2c6ac6a None admin] RBAC: Adding query filter params (name=network) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:15.720350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356eda46-245d-4a75-9d6b-ade9c2c6ac6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:15.721948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356eda46-245d-4a75-9d6b-ade9c2c6ac6a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:15.728839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 373/771] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 18 10:20:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:15.736902 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356eda46-245d-4a75-9d6b-ade9c2c6ac6a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:15.833521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 399/772] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:20:15.882209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356eda46-245d-4a75-9d6b-ade9c2c6ac6a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:15.890401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a1376-3ba2-4ec7-8417-53b04057ae58 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:15.938446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6913ad-331c-4479-aa60-bc417dc24bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:15.939139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6913ad-331c-4479-aa60-bc417dc24bdd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:15.939424 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6913ad-331c-4479-aa60-bc417dc24bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:15.939702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6913ad-331c-4479-aa60-bc417dc24bdd None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:15.940418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6913ad-331c-4479-aa60-bc417dc24bdd None admin] RBAC: Adding query filter params (type=network) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:15.940724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6913ad-331c-4479-aa60-bc417dc24bdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:15.942123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6913ad-331c-4479-aa60-bc417dc24bdd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:15.948284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 374/773] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 18 10:20:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:15.955938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6913ad-331c-4479-aa60-bc417dc24bdd None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:16.058739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:16.113059 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6913ad-331c-4479-aa60-bc417dc24bdd None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:16.151024 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a1376-3ba2-4ec7-8417-53b04057ae58 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:16.176675 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c6c57-5fd0-4c07-a40c-a169b356990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:16.177348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c6c57-5fd0-4c07-a40c-a169b356990a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:16.177628 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c6c57-5fd0-4c07-a40c-a169b356990a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:16.177900 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c6c57-5fd0-4c07-a40c-a169b356990a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:16.178724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c6c57-5fd0-4c07-a40c-a169b356990a None admin] RBAC: Adding query filter params (interface=public, service_id=9b999bf7d73f4e299b5dc9e44ab5c119, region_id=RegionOne) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:16.179035 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c6c57-5fd0-4c07-a40c-a169b356990a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:16.180445 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c6c57-5fd0-4c07-a40c-a169b356990a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:16.197602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 375/774] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 18 10:20:15 2022] GET /identity/v3/endpoints?service_id=9b999bf7d73f4e299b5dc9e44ab5c119&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:16.203946 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c6c57-5fd0-4c07-a40c-a169b356990a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:16.222062 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f826f7-7ee9-433e-adbd-2f0f18cc2de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:16.222913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f826f7-7ee9-433e-adbd-2f0f18cc2de3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:16.223241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f826f7-7ee9-433e-adbd-2f0f18cc2de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:16.223518 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f826f7-7ee9-433e-adbd-2f0f18cc2de3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:16.224202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f826f7-7ee9-433e-adbd-2f0f18cc2de3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:16.225586 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f826f7-7ee9-433e-adbd-2f0f18cc2de3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:16.232300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-99f826f7-7ee9-433e-adbd-2f0f18cc2de3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:16.250454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:16.251936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:16.252774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:16.252774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:16.252774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:16.252774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:16.252774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:16.252774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:16.252774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:16.252774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:16.252774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:16.252774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:16.252774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:16.252774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:16.252774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:16.252774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:20:16.252774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:16.254822 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 400/775] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Jul 18 10:20:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:16.259179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f826f7-7ee9-433e-adbd-2f0f18cc2de3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:16.357389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c6c57-5fd0-4c07-a40c-a169b356990a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:16.379686 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:16.399293 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36072d48-1cf7-4030-9cfc-a61e2f3f3854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:16.400071 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36072d48-1cf7-4030-9cfc-a61e2f3f3854 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:16.400454 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36072d48-1cf7-4030-9cfc-a61e2f3f3854 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:16.400825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36072d48-1cf7-4030-9cfc-a61e2f3f3854 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:16.401715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36072d48-1cf7-4030-9cfc-a61e2f3f3854 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:16.403609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36072d48-1cf7-4030-9cfc-a61e2f3f3854 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:16.406450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f826f7-7ee9-433e-adbd-2f0f18cc2de3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:16.410141 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 376/776] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 18 10:20:16 2022] GET /identity/v3/services => generated 772 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:16.411703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a5e04-58d7-4ee7-9f1e-18b676e9326c None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:16.412235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a5e04-58d7-4ee7-9f1e-18b676e9326c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:16.412702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a5e04-58d7-4ee7-9f1e-18b676e9326c None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:16.419103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 377/777] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:16.420926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b40e0-2f0b-4d77-945d-1c6a3e27e134 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:16.421216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b40e0-2f0b-4d77-945d-1c6a3e27e134 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:16.421495 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b40e0-2f0b-4d77-945d-1c6a3e27e134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:16.455521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c28b40e0-2f0b-4d77-945d-1c6a3e27e134 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:16.456837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c28b40e0-2f0b-4d77-945d-1c6a3e27e134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:16.488693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea46790-8838-4438-b097-7633e72316ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:16.489382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea46790-8838-4438-b097-7633e72316ed None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:16.489665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea46790-8838-4438-b097-7633e72316ed None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:16.489939 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea46790-8838-4438-b097-7633e72316ed None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:16.490685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea46790-8838-4438-b097-7633e72316ed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:16.490991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea46790-8838-4438-b097-7633e72316ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:16.493849 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea46790-8838-4438-b097-7633e72316ed None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:16.510123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 401/778] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 18 10:20:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:16.519562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea46790-8838-4438-b097-7633e72316ed None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:16.596096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:16.617409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 378/779] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:16.641715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b40e0-2f0b-4d77-945d-1c6a3e27e134 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:16.646290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea46790-8838-4438-b097-7633e72316ed None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:16.694802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ff066-e756-4f2e-8306-c84789140b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:16.695844 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ff066-e756-4f2e-8306-c84789140b2a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:16.696358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ff066-e756-4f2e-8306-c84789140b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:16.696834 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ff066-e756-4f2e-8306-c84789140b2a None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:16.697767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ff066-e756-4f2e-8306-c84789140b2a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:16.698303 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ff066-e756-4f2e-8306-c84789140b2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:16.700327 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ff066-e756-4f2e-8306-c84789140b2a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:16.707586 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 402/780] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 18 10:20:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:16.712919 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ff066-e756-4f2e-8306-c84789140b2a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:16.788979 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b40e0-2f0b-4d77-945d-1c6a3e27e134 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:16.809103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:16.835229 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc9c52-9a0b-4ce6-ac7e-bd0c77ec4373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:16.836432 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc9c52-9a0b-4ce6-ac7e-bd0c77ec4373 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:16.836911 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc9c52-9a0b-4ce6-ac7e-bd0c77ec4373 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:16.837381 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc9c52-9a0b-4ce6-ac7e-bd0c77ec4373 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:16.852411 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc9c52-9a0b-4ce6-ac7e-bd0c77ec4373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-bbfc9c52-9a0b-4ce6-ac7e-bd0c77ec4373 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:16.862783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:16.863805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:16.864638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:16.864638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:16.864638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:16.864638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:16.864638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:16.864638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:16.864638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:16.864638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:16.864638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:16.864638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:16.864638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:20:16.864638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:16.867694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 379/781] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:20:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:16.873727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc9c52-9a0b-4ce6-ac7e-bd0c77ec4373 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:16.924031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ff066-e756-4f2e-8306-c84789140b2a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:16.967149 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c69e46-4670-4094-8c21-3239e3a35368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:16.968371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c69e46-4670-4094-8c21-3239e3a35368 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:16.968882 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c69e46-4670-4094-8c21-3239e3a35368 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:16.969353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c69e46-4670-4094-8c21-3239e3a35368 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:16.970392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c69e46-4670-4094-8c21-3239e3a35368 None admin] RBAC: Adding query filter params (interface=public, service_id=ab66ae4a68364253b8e2610ebb34eb80, region_id=RegionOne) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:16.970910 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c69e46-4670-4094-8c21-3239e3a35368 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:16.972557 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c69e46-4670-4094-8c21-3239e3a35368 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:16.978743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:16.983215 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 403/782] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 18 10:20:16 2022] GET /identity/v3/endpoints?service_id=ab66ae4a68364253b8e2610ebb34eb80&interface=public®ion_id=RegionOne => generated 194 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:16.988890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c69e46-4670-4094-8c21-3239e3a35368 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:17.133781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc9c52-9a0b-4ce6-ac7e-bd0c77ec4373 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:17.169537 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c69e46-4670-4094-8c21-3239e3a35368 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:17.209593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00796f1-35d0-472d-9db7-861fa143e764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:17.210642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00796f1-35d0-472d-9db7-861fa143e764 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:17.211125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00796f1-35d0-472d-9db7-861fa143e764 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:17.211746 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00796f1-35d0-472d-9db7-861fa143e764 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:17.212677 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00796f1-35d0-472d-9db7-861fa143e764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:17.214278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00796f1-35d0-472d-9db7-861fa143e764 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:17.221308 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 404/783] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 18 10:20:16 2022] GET /identity/v3/services => generated 772 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:17.242597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaf791-df67-4e40-a5dc-50f21b9244d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:17.243659 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaf791-df67-4e40-a5dc-50f21b9244d1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:17.244178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaf791-df67-4e40-a5dc-50f21b9244d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:17.244666 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaf791-df67-4e40-a5dc-50f21b9244d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:17.245631 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feaf791-df67-4e40-a5dc-50f21b9244d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:17.246749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feaf791-df67-4e40-a5dc-50f21b9244d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:17.248474 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feaf791-df67-4e40-a5dc-50f21b9244d1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:17.265140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 380/784] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:20:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:17.270582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00796f1-35d0-472d-9db7-861fa143e764 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:17.362748 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:17.430855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00796f1-35d0-472d-9db7-861fa143e764 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:17.472620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0342b-50c1-48a0-a63c-8eb28e4f16a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:17.473429 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0342b-50c1-48a0-a63c-8eb28e4f16a9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:17.473710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0342b-50c1-48a0-a63c-8eb28e4f16a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:17.473980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0342b-50c1-48a0-a63c-8eb28e4f16a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:17.486381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0342b-50c1-48a0-a63c-8eb28e4f16a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:17.487852 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0342b-50c1-48a0-a63c-8eb28e4f16a9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:17.507161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-b4c0342b-50c1-48a0-a63c-8eb28e4f16a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:17.507161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:17.507161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:17.507161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:17.507161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:17.507161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:17.507161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:17.507161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:17.507161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:17.507161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:17.507161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:17.507161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:17.507161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:17.507161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:17.507161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:17.508369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:17.509307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:17.509307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:17.509307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:17.509307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:17.509307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 405/785] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:17.519468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaf791-df67-4e40-a5dc-50f21b9244d1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:17.563998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:17.645673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaf791-df67-4e40-a5dc-50f21b9244d1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:17.669061 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820da53-9043-48fa-9ff3-4ad2019f9e60 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:17.669383 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820da53-9043-48fa-9ff3-4ad2019f9e60 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:17.669610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820da53-9043-48fa-9ff3-4ad2019f9e60 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:17.671384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 406/786] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:17.683030 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b407c-5414-4e64-8e20-070736a814ba None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:17.683812 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b407c-5414-4e64-8e20-070736a814ba None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:17.684302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b407c-5414-4e64-8e20-070736a814ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:17.690301 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3f8ed-4fea-4230-bcac-8ee07343677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:17.690926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3f8ed-4fea-4230-bcac-8ee07343677f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:17.691214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3f8ed-4fea-4230-bcac-8ee07343677f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:17.691494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3f8ed-4fea-4230-bcac-8ee07343677f None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:17.692957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3f8ed-4fea-4230-bcac-8ee07343677f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:17.692957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3f8ed-4fea-4230-bcac-8ee07343677f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:17.693892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3f8ed-4fea-4230-bcac-8ee07343677f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:17.709508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b30b407c-5414-4e64-8e20-070736a814ba None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:17.711158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b30b407c-5414-4e64-8e20-070736a814ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:17.718073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 381/787] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:17.727042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3f8ed-4fea-4230-bcac-8ee07343677f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:17.901796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 407/788] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:20:17.910213 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:17.931926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3f8ed-4fea-4230-bcac-8ee07343677f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:17.942085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b407c-5414-4e64-8e20-070736a814ba None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:18.001054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:18.071091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b4035-9586-432d-9478-821e5ca84f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:18.071933 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b4035-9586-432d-9478-821e5ca84f84 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:18.072218 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b4035-9586-432d-9478-821e5ca84f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:18.072631 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b4035-9586-432d-9478-821e5ca84f84 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:18.083328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b4035-9586-432d-9478-821e5ca84f84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:18.085561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b4035-9586-432d-9478-821e5ca84f84 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:18.096142 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b407c-5414-4e64-8e20-070736a814ba None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-b02b4035-9586-432d-9478-821e5ca84f84 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:18.113115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:18.116724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:18.120531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:18.120531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:18.120531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:18.120531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:18.120531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:18.120531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:18.120531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:18.120531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:18.120531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:20:18.120531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:18.120531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 382/789] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 18 10:20:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:18.120531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b1630-fb79-4a00-b900-d1ef11939942 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:18.120531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b1630-fb79-4a00-b900-d1ef11939942 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:18.121609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b1630-fb79-4a00-b900-d1ef11939942 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:18.121609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 383/790] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:18.124067 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318bd68-6f1f-4f3b-860b-338d8f5d8d58 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:18.124641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318bd68-6f1f-4f3b-860b-338d8f5d8d58 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:18.125059 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318bd68-6f1f-4f3b-860b-338d8f5d8d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:18.149740 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896133e-ae25-47d1-8082-1d3ee52943b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:18.150904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896133e-ae25-47d1-8082-1d3ee52943b2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:18.151183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896133e-ae25-47d1-8082-1d3ee52943b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:18.151504 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896133e-ae25-47d1-8082-1d3ee52943b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:18.155581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e318bd68-6f1f-4f3b-860b-338d8f5d8d58 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:18.157037 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e318bd68-6f1f-4f3b-860b-338d8f5d8d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:18.166505 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896133e-ae25-47d1-8082-1d3ee52943b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e896133e-ae25-47d1-8082-1d3ee52943b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:18.179191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:18.180227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:18.181096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:18.181096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:18.181096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:18.181096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:18.181096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:18.181096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:18.181096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:18.181096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:18.181096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:18.181096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:18.181096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:18.181096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:18.182236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 408/791] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:20:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:18.184115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896133e-ae25-47d1-8082-1d3ee52943b2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:18.251858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 384/792] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:18.252748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318bd68-6f1f-4f3b-860b-338d8f5d8d58 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:18.323458 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:18.329550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896133e-ae25-47d1-8082-1d3ee52943b2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:18.373627 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:18.385970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622352cd-78e6-435c-a296-3fdf6b032a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:18.387056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622352cd-78e6-435c-a296-3fdf6b032a78 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:18.387529 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622352cd-78e6-435c-a296-3fdf6b032a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:18.387997 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622352cd-78e6-435c-a296-3fdf6b032a78 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:18.389214 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622352cd-78e6-435c-a296-3fdf6b032a78 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:18.389670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622352cd-78e6-435c-a296-3fdf6b032a78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:18.391943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622352cd-78e6-435c-a296-3fdf6b032a78 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:18.401249 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318bd68-6f1f-4f3b-860b-338d8f5d8d58 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:18.417668 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 409/793] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 18 10:20:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:18.419890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622352cd-78e6-435c-a296-3fdf6b032a78 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:18.448481 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ed280-e9d3-440e-b3cd-6a9bc80d1908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:18.449401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ed280-e9d3-440e-b3cd-6a9bc80d1908 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:18.449785 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ed280-e9d3-440e-b3cd-6a9bc80d1908 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:18.450179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ed280-e9d3-440e-b3cd-6a9bc80d1908 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:18.451052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ed280-e9d3-440e-b3cd-6a9bc80d1908 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:18.451461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ed280-e9d3-440e-b3cd-6a9bc80d1908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:18.452954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ed280-e9d3-440e-b3cd-6a9bc80d1908 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:18.468396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 385/794] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:20:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:18.470362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ed280-e9d3-440e-b3cd-6a9bc80d1908 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:18.569163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622352cd-78e6-435c-a296-3fdf6b032a78 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:18.602404 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ed280-e9d3-440e-b3cd-6a9bc80d1908 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:18.614923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753d444-f548-4679-937b-8d720be15db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:18.616000 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753d444-f548-4679-937b-8d720be15db5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:18.616396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753d444-f548-4679-937b-8d720be15db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:18.616775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753d444-f548-4679-937b-8d720be15db5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:18.635930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753d444-f548-4679-937b-8d720be15db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:18.644540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc602a-68ec-4915-99fb-e9bd80df6877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:18.645361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc602a-68ec-4915-99fb-e9bd80df6877 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:18.645639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc602a-68ec-4915-99fb-e9bd80df6877 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-1753d444-f548-4679-937b-8d720be15db5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:18.645791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:18.647484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:18.649315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:18.649315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:18.649315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:18.649315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:18.649315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:18.649315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:18.649315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:18.649315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:18.649315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:18.649315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:18.649315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:18.649315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:18.650850 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc602a-68ec-4915-99fb-e9bd80df6877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:18.657008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 410/795] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:20:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:18.657008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753d444-f548-4679-937b-8d720be15db5 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:18.662347 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc602a-68ec-4915-99fb-e9bd80df6877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:18.662347 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc602a-68ec-4915-99fb-e9bd80df6877 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:18.669358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:18.679110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:18.685379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-3cdc602a-68ec-4915-99fb-e9bd80df6877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:18.685379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:18.685379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:18.685379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:18.685379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:18.685379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:18.685379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:18.685379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:18.685379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:18.685379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:18.685379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:18.685379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:18.685379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:18.685379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:18.685379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:18.686527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:18.687764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:18.687764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:18.687764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:18.687764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:18.690410 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 386/796] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:18.694096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc602a-68ec-4915-99fb-e9bd80df6877 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:18.807724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753d444-f548-4679-937b-8d720be15db5 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:18.836910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc602a-68ec-4915-99fb-e9bd80df6877 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:18.849098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60cac1-576e-4efb-baf4-765b868bbd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:18.849987 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60cac1-576e-4efb-baf4-765b868bbd41 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:18.850351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60cac1-576e-4efb-baf4-765b868bbd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:18.850750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60cac1-576e-4efb-baf4-765b868bbd41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:18.863174 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60cac1-576e-4efb-baf4-765b868bbd41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:18.864741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60cac1-576e-4efb-baf4-765b868bbd41 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:18.882910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a146eeb-7aa2-4948-b3b6-bb5291cccc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:18.883885 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146eeb-7aa2-4948-b3b6-bb5291cccc1e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:18.884350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146eeb-7aa2-4948-b3b6-bb5291cccc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:18.884833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-dc60cac1-576e-4efb-baf4-765b868bbd41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:18.884833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:18.884833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:18.884833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:18.884833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:18.884833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:18.884833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:18.884833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:18.884833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:18.884833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:18.884833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:18.884833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:18.884833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:18.884833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:18.884833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:18.885683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:18.887273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:18.887273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:18.887273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:18.887273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:18.888124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146eeb-7aa2-4948-b3b6-bb5291cccc1e None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:18.889239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a146eeb-7aa2-4948-b3b6-bb5291cccc1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:18.889728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a146eeb-7aa2-4948-b3b6-bb5291cccc1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:18.891426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a146eeb-7aa2-4948-b3b6-bb5291cccc1e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:18.891648 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 411/797] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:18.892627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60cac1-576e-4efb-baf4-765b868bbd41 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:18.910544 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 387/798] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:20:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:18.910544 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a146eeb-7aa2-4948-b3b6-bb5291cccc1e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:18.975851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:18.978944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:19.022697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a146eeb-7aa2-4948-b3b6-bb5291cccc1e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:19.034996 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60cac1-576e-4efb-baf4-765b868bbd41 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:19.063704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcc717-c739-492a-b68b-63f01059f524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:19.064368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcc717-c739-492a-b68b-63f01059f524 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:19.064656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcc717-c739-492a-b68b-63f01059f524 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:19.064933 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcc717-c739-492a-b68b-63f01059f524 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:19.065655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcc717-c739-492a-b68b-63f01059f524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:19.065962 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcc717-c739-492a-b68b-63f01059f524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:19.067401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcc717-c739-492a-b68b-63f01059f524 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:19.080939 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 388/799] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:19.082556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18b2b9-d6a9-4fe5-a978-98bc192643fd None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:19.082669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873032d-c88a-48ad-a934-afaf701159a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:19.083171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18b2b9-d6a9-4fe5-a978-98bc192643fd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:19.083432 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873032d-c88a-48ad-a934-afaf701159a1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:19.083794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873032d-c88a-48ad-a934-afaf701159a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:19.083997 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18b2b9-d6a9-4fe5-a978-98bc192643fd None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:19.084141 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873032d-c88a-48ad-a934-afaf701159a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:19.084971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873032d-c88a-48ad-a934-afaf701159a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:19.085467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873032d-c88a-48ad-a934-afaf701159a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:19.085993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 389/800] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:19.086903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18b2b9-d6a9-4fe5-a978-98bc192643fd None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:19.087116 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873032d-c88a-48ad-a934-afaf701159a1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:19.101863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 412/801] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:19.103112 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873032d-c88a-48ad-a934-afaf701159a1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:19.210295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18b2b9-d6a9-4fe5-a978-98bc192643fd None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:19.218713 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873032d-c88a-48ad-a934-afaf701159a1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:19.233725 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:19.249003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:19.250629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9024ec5-c384-49dc-a9e2-fa9498af78ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:19.253237 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9024ec5-c384-49dc-a9e2-fa9498af78ed None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:19.253237 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9024ec5-c384-49dc-a9e2-fa9498af78ed None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:19.253237 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9024ec5-c384-49dc-a9e2-fa9498af78ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:19.263558 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f14e0-b9cf-4485-acc9-1533a382c087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:19.264863 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9024ec5-c384-49dc-a9e2-fa9498af78ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:19.264986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f14e0-b9cf-4485-acc9-1533a382c087 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:19.265441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f14e0-b9cf-4485-acc9-1533a382c087 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:19.265941 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f14e0-b9cf-4485-acc9-1533a382c087 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:19.266361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9024ec5-c384-49dc-a9e2-fa9498af78ed None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:19.279845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f14e0-b9cf-4485-acc9-1533a382c087 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:19.282547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f14e0-b9cf-4485-acc9-1533a382c087 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:19.285244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-e9024ec5-c384-49dc-a9e2-fa9498af78ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:19.285244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:19.285244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:19.285244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:19.285244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:19.285244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:19.285244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:19.285244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:19.285244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:19.285244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:19.285244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:19.285244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:19.285244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:19.285244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:19.285244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:19.286136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:19.287110 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:19.287110 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:19.287110 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:19.287110 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:19.287110 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 390/802] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:19.287843 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3abe0-91f4-4791-af8c-487d9f671ad1 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:19.288074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3abe0-91f4-4791-af8c-487d9f671ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:19.288238 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3abe0-91f4-4791-af8c-487d9f671ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-924f14e0-b9cf-4485-acc9-1533a382c087 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:19.305033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:19.306056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:19.307103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:19.307103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:19.307103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:19.307103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:19.307103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:19.307103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:19.307103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:19.307103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:19.307103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:20:19.307103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:19.308269 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 413/803] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 18 10:20:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:19.309041 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f14e0-b9cf-4485-acc9-1533a382c087 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:19.313726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-5aa3abe0-91f4-4791-af8c-487d9f671ad1 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:19.314959 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5aa3abe0-91f4-4791-af8c-487d9f671ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:19.387857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 391/804] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:19.389020 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3abe0-91f4-4791-af8c-487d9f671ad1 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:19.453632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f14e0-b9cf-4485-acc9-1533a382c087 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:19.493963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3abe0-91f4-4791-af8c-487d9f671ad1 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:19.496571 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:19.496994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77490c-2eab-4015-84cc-3da6551d13f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:19.497866 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77490c-2eab-4015-84cc-3da6551d13f0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:19.498811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77490c-2eab-4015-84cc-3da6551d13f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:19.498811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77490c-2eab-4015-84cc-3da6551d13f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:19.505921 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77490c-2eab-4015-84cc-3da6551d13f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:19.507515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77490c-2eab-4015-84cc-3da6551d13f0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:19.523509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-ce77490c-2eab-4015-84cc-3da6551d13f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:19.523509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:19.523509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:19.523509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:19.523509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:19.523509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:19.523509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:19.523509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:19.523509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:19.523509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:19.523509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:19.523509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:19.523509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:19.523509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:19.523509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:19.524623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:19.525721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:19.525721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:19.525721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:19.525721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:19.525721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:19.525721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:19.525721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:19.525721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:19.529750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 414/805] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:19.530753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77490c-2eab-4015-84cc-3da6551d13f0 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:19.536784 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb933a17-66a0-4b73-9c5a-35fb90aa5a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:19.537578 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb933a17-66a0-4b73-9c5a-35fb90aa5a46 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:19.537957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb933a17-66a0-4b73-9c5a-35fb90aa5a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:19.538359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb933a17-66a0-4b73-9c5a-35fb90aa5a46 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:19.539181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb933a17-66a0-4b73-9c5a-35fb90aa5a46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:19.539584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb933a17-66a0-4b73-9c5a-35fb90aa5a46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:19.541042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb933a17-66a0-4b73-9c5a-35fb90aa5a46 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:19.553458 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 392/806] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:19.554272 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb933a17-66a0-4b73-9c5a-35fb90aa5a46 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:19.596277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:19.659250 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77490c-2eab-4015-84cc-3da6551d13f0 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:19.677730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb933a17-66a0-4b73-9c5a-35fb90aa5a46 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:19.698082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0d87c-1f6e-4173-90c4-a0f6eb8ce223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:19.698903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0d87c-1f6e-4173-90c4-a0f6eb8ce223 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:19.699325 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0d87c-1f6e-4173-90c4-a0f6eb8ce223 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:19.699575 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0d87c-1f6e-4173-90c4-a0f6eb8ce223 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:19.700417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0d87c-1f6e-4173-90c4-a0f6eb8ce223 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:19.700744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0d87c-1f6e-4173-90c4-a0f6eb8ce223 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:19.702390 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0d87c-1f6e-4173-90c4-a0f6eb8ce223 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:19.713599 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1e964-cbb8-4d81-8538-8ad2129d8c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:19.714429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1e964-cbb8-4d81-8538-8ad2129d8c4f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:19.715129 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1e964-cbb8-4d81-8538-8ad2129d8c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:19.715509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1e964-cbb8-4d81-8538-8ad2129d8c4f None admin] PATH_INFO: `/v3/services/network` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:19.716225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1e964-cbb8-4d81-8538-8ad2129d8c4f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:19.717606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1e964-cbb8-4d81-8538-8ad2129d8c4f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:19.726108 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 415/807] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 18 10:20:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:19.726108 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0d87c-1f6e-4173-90c4-a0f6eb8ce223 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-60f1e964-cbb8-4d81-8538-8ad2129d8c4f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:19.729958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:19.731748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:19.732790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:19.732790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:19.732790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:19.732790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:19.732790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:19.732790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:19.732790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:19.732790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:19.732790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:19.732790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:19.732790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:19.732790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:19.732790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:20:19.732790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:19.736931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 393/808] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:19 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:19.737827 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1e964-cbb8-4d81-8538-8ad2129d8c4f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:19.767179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:19.840627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0d87c-1f6e-4173-90c4-a0f6eb8ce223 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:19.845783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1e964-cbb8-4d81-8538-8ad2129d8c4f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:19.849295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:19.882950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a2254-f11d-4961-a8d3-56882507eada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:19.883608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a2254-f11d-4961-a8d3-56882507eada None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:19.883888 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a2254-f11d-4961-a8d3-56882507eada None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:19.884161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a2254-f11d-4961-a8d3-56882507eada None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:19.884938 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a2254-f11d-4961-a8d3-56882507eada None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:19.885246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a2254-f11d-4961-a8d3-56882507eada None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:19.886641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869c2a2-65be-4969-8ab9-b83b9cd354ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:19.886779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a2254-f11d-4961-a8d3-56882507eada None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:19.887440 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c2a2-65be-4969-8ab9-b83b9cd354ba None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:19.887727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c2a2-65be-4969-8ab9-b83b9cd354ba None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:19.888001 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c2a2-65be-4969-8ab9-b83b9cd354ba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:19.895377 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869c2a2-65be-4969-8ab9-b83b9cd354ba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:19.896833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869c2a2-65be-4969-8ab9-b83b9cd354ba None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:19.898413 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 416/809] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:19.899218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a2254-f11d-4961-a8d3-56882507eada None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-c869c2a2-65be-4969-8ab9-b83b9cd354ba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:19.916034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:19.917038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:19.918589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:19.918589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:19.918589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:19.918589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:19.918589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:19.918589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:19.918589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:19.918589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:19.918589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:20:19.918589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:19.918589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 394/810] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:20:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:19.918589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869c2a2-65be-4969-8ab9-b83b9cd354ba None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:20.014702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:20.016794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a2254-f11d-4961-a8d3-56882507eada None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:20.029901 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869c2a2-65be-4969-8ab9-b83b9cd354ba None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:20.055299 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69519f7b-db82-4bf7-b225-57a796791888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:20.056086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519f7b-db82-4bf7-b225-57a796791888 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:20.056423 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519f7b-db82-4bf7-b225-57a796791888 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:20.056794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519f7b-db82-4bf7-b225-57a796791888 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:20.065370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8bd6a-7829-4ac8-a1a6-2995837fd8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:20.066044 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8bd6a-7829-4ac8-a1a6-2995837fd8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:20.066363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8bd6a-7829-4ac8-a1a6-2995837fd8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:20.066634 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8bd6a-7829-4ac8-a1a6-2995837fd8e7 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:20.067344 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8bd6a-7829-4ac8-a1a6-2995837fd8e7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:20.067695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8bd6a-7829-4ac8-a1a6-2995837fd8e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:20.069089 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8bd6a-7829-4ac8-a1a6-2995837fd8e7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:20.073951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 395/811] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 18 10:20:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:20.075726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc07b4-f8ca-4ddc-b74c-dee3701621b8 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:20.076016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc07b4-f8ca-4ddc-b74c-dee3701621b8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:20.076297 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc07b4-f8ca-4ddc-b74c-dee3701621b8 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:20.077582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 396/812] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:20.078590 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc07b4-f8ca-4ddc-b74c-dee3701621b8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:20.101998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:20.139172 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69519f7b-db82-4bf7-b225-57a796791888 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:20.140677 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69519f7b-db82-4bf7-b225-57a796791888 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:20.185913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc07b4-f8ca-4ddc-b74c-dee3701621b8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:20.221734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518fe74-805d-454e-a83b-a0ddfc9b71f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:20.222644 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518fe74-805d-454e-a83b-a0ddfc9b71f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:20.222923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518fe74-805d-454e-a83b-a0ddfc9b71f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:20.223194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518fe74-805d-454e-a83b-a0ddfc9b71f7 None admin] PATH_INFO: `/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/8c34067d12a34f8ab2061460e86ef135/roles/509fcb6f06144cdd9803fb3910eb80bf` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:20.239248 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518fe74-805d-454e-a83b-a0ddfc9b71f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=40e0b5ee15df481cbc01333131f3def0, user_id=8c34067d12a34f8ab2061460e86ef135, role_id=509fcb6f06144cdd9803fb3910eb80bf)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:20.240702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518fe74-805d-454e-a83b-a0ddfc9b71f7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:20.246548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 417/813] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:20:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:20:20.247706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69519f7b-db82-4bf7-b225-57a796791888 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:20.312112 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:20.317246 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:20.321658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 397/814] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:20:20 2022] PUT /identity/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/8c34067d12a34f8ab2061460e86ef135/roles/509fcb6f06144cdd9803fb3910eb80bf => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:20:20.322571 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518fe74-805d-454e-a83b-a0ddfc9b71f7 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:20.353598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69519f7b-db82-4bf7-b225-57a796791888 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:20.400369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a662523-2b43-413f-aabf-c86b52520400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:20.401351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a662523-2b43-413f-aabf-c86b52520400 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:20.401631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a662523-2b43-413f-aabf-c86b52520400 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:20.401902 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a662523-2b43-413f-aabf-c86b52520400 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:20.403388 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a662523-2b43-413f-aabf-c86b52520400 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:20.403697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a662523-2b43-413f-aabf-c86b52520400 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:20.405626 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a662523-2b43-413f-aabf-c86b52520400 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:20.429810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 418/815] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 18 10:20:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:20.431224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45542b08-0489-4b61-83c1-ddf5bfd27ade None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:20.431509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45542b08-0489-4b61-83c1-ddf5bfd27ade None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:20.431783 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45542b08-0489-4b61-83c1-ddf5bfd27ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:20.447859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518fe74-805d-454e-a83b-a0ddfc9b71f7 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:20.450800 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-45542b08-0489-4b61-83c1-ddf5bfd27ade None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:20.453045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-45542b08-0489-4b61-83c1-ddf5bfd27ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:20.499965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bee1f-8478-4019-860c-7ea7518f3bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:20.500665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bee1f-8478-4019-860c-7ea7518f3bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:20.500931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bee1f-8478-4019-860c-7ea7518f3bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:20.501204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bee1f-8478-4019-860c-7ea7518f3bf6 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:20.501914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bee1f-8478-4019-860c-7ea7518f3bf6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:20.502211 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bee1f-8478-4019-860c-7ea7518f3bf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:20.503631 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bee1f-8478-4019-860c-7ea7518f3bf6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:20.509563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 398/816] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 18 10:20:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:20.510431 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bee1f-8478-4019-860c-7ea7518f3bf6 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:20.546992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 419/817] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:20.547859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45542b08-0489-4b61-83c1-ddf5bfd27ade None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:20.592924 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:20.629410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:20.636861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bee1f-8478-4019-860c-7ea7518f3bf6 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:20.673881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e57307-5b6c-4d31-bcd4-838ffb19c615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:20.674838 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e57307-5b6c-4d31-bcd4-838ffb19c615 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:20.675126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e57307-5b6c-4d31-bcd4-838ffb19c615 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:20.675410 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e57307-5b6c-4d31-bcd4-838ffb19c615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:20.687262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e57307-5b6c-4d31-bcd4-838ffb19c615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:20.688814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e57307-5b6c-4d31-bcd4-838ffb19c615 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:20.705261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45542b08-0489-4b61-83c1-ddf5bfd27ade None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:20.711171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-f1e57307-5b6c-4d31-bcd4-838ffb19c615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:20.711171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:20.711171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:20.711171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:20.711171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:20.711171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:20.711171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:20.711171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:20.711171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:20.711171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:20.711171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:20.711171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:20.711171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:20.711171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:20.711171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:20.712054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:20.712964 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:20.712964 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:20.712964 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:20.712964 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:20.717739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 399/818] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:20.717739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e57307-5b6c-4d31-bcd4-838ffb19c615 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:20.747731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3329c-7b24-4456-845c-6b203ef5c77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:20.748523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3329c-7b24-4456-845c-6b203ef5c77f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:20.748805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3329c-7b24-4456-845c-6b203ef5c77f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:20.749301 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3329c-7b24-4456-845c-6b203ef5c77f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:20.760838 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3329c-7b24-4456-845c-6b203ef5c77f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:20.762653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3329c-7b24-4456-845c-6b203ef5c77f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:20.784202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-d0f3329c-7b24-4456-845c-6b203ef5c77f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:20.784202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:20.784202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:20.784202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:20.784202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:20.784202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:20.784202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:20.784202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:20.784202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:20.784202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:20.784202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:20.784202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:20.784202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:20.784202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:20.784202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:20.785205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:20.786121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:20.786121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:20.786121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:20.786121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:20.786121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 420/819] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:20.787498 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3329c-7b24-4456-845c-6b203ef5c77f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:20.841335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e57307-5b6c-4d31-bcd4-838ffb19c615 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:20.907980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3329c-7b24-4456-845c-6b203ef5c77f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:20.917394 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:20.954740 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fcba0-2642-4a6d-962c-80b5a5eaa9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:20.955641 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fcba0-2642-4a6d-962c-80b5a5eaa9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:20.956356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fcba0-2642-4a6d-962c-80b5a5eaa9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:20.956356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fcba0-2642-4a6d-962c-80b5a5eaa9d8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:20.956790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fcba0-2642-4a6d-962c-80b5a5eaa9d8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:20.958192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fcba0-2642-4a6d-962c-80b5a5eaa9d8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e22fcba0-2642-4a6d-962c-80b5a5eaa9d8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:20.973227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:20.974920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:20.976359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 421/820] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Jul 18 10:20:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:20.978496 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fcba0-2642-4a6d-962c-80b5a5eaa9d8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:20.982902 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:21.002643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ce521-3423-4140-8f66-e01b26566ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:21.003749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ce521-3423-4140-8f66-e01b26566ecf None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:21.004031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ce521-3423-4140-8f66-e01b26566ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:21.004306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ce521-3423-4140-8f66-e01b26566ecf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:21.005051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ce521-3423-4140-8f66-e01b26566ecf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:21.007009 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ce521-3423-4140-8f66-e01b26566ecf None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:21.090378 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fcba0-2642-4a6d-962c-80b5a5eaa9d8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:21.127935 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 400/821] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 18 10:20:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:20:21.129138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ce521-3423-4140-8f66-e01b26566ecf None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:21.149094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e06ff9-e7a9-40ca-9b4a-a5075eba84cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:21.149786 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e06ff9-e7a9-40ca-9b4a-a5075eba84cc None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:21.150069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e06ff9-e7a9-40ca-9b4a-a5075eba84cc None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:21.150754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e06ff9-e7a9-40ca-9b4a-a5075eba84cc None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:21.151529 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e06ff9-e7a9-40ca-9b4a-a5075eba84cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:21.151840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e06ff9-e7a9-40ca-9b4a-a5075eba84cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:21.154102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e06ff9-e7a9-40ca-9b4a-a5075eba84cc None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:21.170018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 422/822] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:21.171045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e06ff9-e7a9-40ca-9b4a-a5075eba84cc None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:21.202778 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:21.268204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ce521-3423-4140-8f66-e01b26566ecf None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:21.289693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e06ff9-e7a9-40ca-9b4a-a5075eba84cc None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:21.312272 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361e66a-98ea-420d-beaf-c6c0160cc6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:21.313442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361e66a-98ea-420d-beaf-c6c0160cc6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:21.313826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361e66a-98ea-420d-beaf-c6c0160cc6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:21.314199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361e66a-98ea-420d-beaf-c6c0160cc6e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:21.315054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361e66a-98ea-420d-beaf-c6c0160cc6e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:21.315455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361e66a-98ea-420d-beaf-c6c0160cc6e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:21.317187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361e66a-98ea-420d-beaf-c6c0160cc6e3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:21.329142 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f99ea-7fef-4415-b038-5222efdbff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:21.329813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f99ea-7fef-4415-b038-5222efdbff2e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:21.330098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f99ea-7fef-4415-b038-5222efdbff2e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:21.330431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f99ea-7fef-4415-b038-5222efdbff2e None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:21.331120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f99ea-7fef-4415-b038-5222efdbff2e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:21.331289 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 401/823] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:21.331467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f99ea-7fef-4415-b038-5222efdbff2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:21.332100 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361e66a-98ea-420d-beaf-c6c0160cc6e3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:21.335711 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f99ea-7fef-4415-b038-5222efdbff2e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:21.341903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 423/824] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 18 10:20:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:21.343757 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f99ea-7fef-4415-b038-5222efdbff2e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:21.375778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:21.461203 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361e66a-98ea-420d-beaf-c6c0160cc6e3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:21.462852 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:21.473877 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f99ea-7fef-4415-b038-5222efdbff2e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:21.508486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e15f89-d0c8-49d0-8141-4c245bb7b945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:21.510196 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e15f89-d0c8-49d0-8141-4c245bb7b945 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:21.510726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e15f89-d0c8-49d0-8141-4c245bb7b945 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:21.511221 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e15f89-d0c8-49d0-8141-4c245bb7b945 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:21.514821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe151bf-0ea3-4f3d-ab7b-7f5844f80224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:21.515614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe151bf-0ea3-4f3d-ab7b-7f5844f80224 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:21.515901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe151bf-0ea3-4f3d-ab7b-7f5844f80224 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:21.516178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe151bf-0ea3-4f3d-ab7b-7f5844f80224 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:21.520172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e15f89-d0c8-49d0-8141-4c245bb7b945 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:21.521980 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e15f89-d0c8-49d0-8141-4c245bb7b945 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:21.523720 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe151bf-0ea3-4f3d-ab7b-7f5844f80224 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:21.526154 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe151bf-0ea3-4f3d-ab7b-7f5844f80224 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:21.538601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-c7e15f89-d0c8-49d0-8141-4c245bb7b945 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:21.538601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:21.538601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:21.538601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:21.538601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:21.538601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:21.538601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:21.538601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:21.538601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:21.538601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:21.538601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:21.538601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:21.538601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:21.538601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:21.538601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:21.539568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:21.540452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:21.540452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:21.540452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:21.540452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:21.540452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:21.540452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:21.540452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:21.540452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:21.541441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-efe151bf-0ea3-4f3d-ab7b-7f5844f80224 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:21.541441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:21.541441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:21.541441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:21.541441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:21.541441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:21.541441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:21.541441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:21.541441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:21.541441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:21.541441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:21.541441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:21.541441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:21.541441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:21.541441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:21.542282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:21.543780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:21.543780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:21.543780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:21.543780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:21.543780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:21.543780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:21.543780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:21.543780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:21.545607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 402/825] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:21.546291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e15f89-d0c8-49d0-8141-4c245bb7b945 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:21.546886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 424/826] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:21.547953 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe151bf-0ea3-4f3d-ab7b-7f5844f80224 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:21.650730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:21.659039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe151bf-0ea3-4f3d-ab7b-7f5844f80224 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:21.660112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e15f89-d0c8-49d0-8141-4c245bb7b945 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:21.697675 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebff44-c482-4a05-9e15-e88779b4de9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:21.698371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebff44-c482-4a05-9e15-e88779b4de9e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:21.698655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebff44-c482-4a05-9e15-e88779b4de9e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:21.698934 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebff44-c482-4a05-9e15-e88779b4de9e None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:21.700127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebff44-c482-4a05-9e15-e88779b4de9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:21.700416 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721b47-65e2-4d08-9ff9-b40428a1c52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:21.700906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebff44-c482-4a05-9e15-e88779b4de9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:21.701685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721b47-65e2-4d08-9ff9-b40428a1c52d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:21.701933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebff44-c482-4a05-9e15-e88779b4de9e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:21.702312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721b47-65e2-4d08-9ff9-b40428a1c52d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:21.702789 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721b47-65e2-4d08-9ff9-b40428a1c52d None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:21.704023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32721b47-65e2-4d08-9ff9-b40428a1c52d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:21.705060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32721b47-65e2-4d08-9ff9-b40428a1c52d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:21.706822 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32721b47-65e2-4d08-9ff9-b40428a1c52d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:21.717440 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 403/827] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 18 10:20:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:21.717440 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721b47-65e2-4d08-9ff9-b40428a1c52d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:21.721008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 425/828] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:21.724594 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebff44-c482-4a05-9e15-e88779b4de9e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:21.738632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:21.834652 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721b47-65e2-4d08-9ff9-b40428a1c52d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:21.843503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebff44-c482-4a05-9e15-e88779b4de9e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:21.877895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0c203-7007-4423-a040-32135f2fb1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:21.878596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0c203-7007-4423-a040-32135f2fb1ff None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:21.879103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0c203-7007-4423-a040-32135f2fb1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:21.879103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0c203-7007-4423-a040-32135f2fb1ff None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:21.879893 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0c203-7007-4423-a040-32135f2fb1ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:21.880203 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0c203-7007-4423-a040-32135f2fb1ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:21.881878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0c203-7007-4423-a040-32135f2fb1ff None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:21.887519 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48904628-d4b1-4dc4-9046-45870920c26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:21.888592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48904628-d4b1-4dc4-9046-45870920c26f None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:21.889194 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48904628-d4b1-4dc4-9046-45870920c26f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:21.889812 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48904628-d4b1-4dc4-9046-45870920c26f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:21.891292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48904628-d4b1-4dc4-9046-45870920c26f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:21.894158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48904628-d4b1-4dc4-9046-45870920c26f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:21.897387 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 404/829] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:21.898786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0c203-7007-4423-a040-32135f2fb1ff None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:21.931459 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:22.018359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 426/830] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 18 10:20:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:20:22.018359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48904628-d4b1-4dc4-9046-45870920c26f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:22.045061 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0c203-7007-4423-a040-32135f2fb1ff None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:22.099154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33928c49-4941-4978-972b-86d69d3f43cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:22.099863 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33928c49-4941-4978-972b-86d69d3f43cc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:22.100144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33928c49-4941-4978-972b-86d69d3f43cc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:22.100412 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33928c49-4941-4978-972b-86d69d3f43cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:22.101257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33928c49-4941-4978-972b-86d69d3f43cc None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=f7abf6b71ac3454ca547a750cef9220a) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:22.101565 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33928c49-4941-4978-972b-86d69d3f43cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:22.103098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33928c49-4941-4978-972b-86d69d3f43cc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:22.112606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 405/831] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:20:21 2022] GET /identity/v3/role_assignments?user.id=f7abf6b71ac3454ca547a750cef9220a&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:22.174760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:22.234564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48904628-d4b1-4dc4-9046-45870920c26f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:22.279716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4765e5-222b-4188-9742-ec64744ea5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:22.280646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4765e5-222b-4188-9742-ec64744ea5f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:22.280925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4765e5-222b-4188-9742-ec64744ea5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:22.281200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4765e5-222b-4188-9742-ec64744ea5f4 None admin] PATH_INFO: `/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/a8ee2beff1a7487d92c1c5940f2784f1/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:22.283508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4765e5-222b-4188-9742-ec64744ea5f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=40e0b5ee15df481cbc01333131f3def0, user_id=a8ee2beff1a7487d92c1c5940f2784f1, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:22.285019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4765e5-222b-4188-9742-ec64744ea5f4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:22.357452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 427/832] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:20:22 2022] PUT /identity/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/a8ee2beff1a7487d92c1c5940f2784f1/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:20:22.434824 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81ebaf-ced2-4463-beef-e4b2e8998419 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:22.435188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81ebaf-ced2-4463-beef-e4b2e8998419 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:22.435402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81ebaf-ced2-4463-beef-e4b2e8998419 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:22.437180 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 406/833] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:22.443011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706b57a-8c95-41a5-aab1-de216019ae7a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:22.443309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706b57a-8c95-41a5-aab1-de216019ae7a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:22.443577 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706b57a-8c95-41a5-aab1-de216019ae7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:22.462191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f706b57a-8c95-41a5-aab1-de216019ae7a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:22.463446 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f706b57a-8c95-41a5-aab1-de216019ae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:22.556670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 428/834] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:22.580401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81ebaf-ced2-4463-beef-e4b2e8998419 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:22.674342 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:22.703676 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81ebaf-ced2-4463-beef-e4b2e8998419 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:22.741320 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136c235-15ab-4670-9588-17e91b92958a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:22.742124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136c235-15ab-4670-9588-17e91b92958a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:22.742434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136c235-15ab-4670-9588-17e91b92958a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:22.742715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136c235-15ab-4670-9588-17e91b92958a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:22.754678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136c235-15ab-4670-9588-17e91b92958a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-e136c235-15ab-4670-9588-17e91b92958a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:22.763615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:22.764616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:22.765453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:22.765453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:22.765453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:22.765453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:22.765453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:22.765453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:22.765453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:22.765453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:22.765453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:22.765453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:22.765453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:20:22.765453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:22.765453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 407/835] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:20:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:22.775551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706b57a-8c95-41a5-aab1-de216019ae7a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:22.839620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:22.902313 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706b57a-8c95-41a5-aab1-de216019ae7a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:22.944186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca521b-ec77-439a-bfb9-f89700ecf830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:22.944767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca521b-ec77-439a-bfb9-f89700ecf830 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:22.945081 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca521b-ec77-439a-bfb9-f89700ecf830 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:22.945354 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca521b-ec77-439a-bfb9-f89700ecf830 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:22.946101 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca521b-ec77-439a-bfb9-f89700ecf830 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:22.946491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca521b-ec77-439a-bfb9-f89700ecf830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:22.947983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca521b-ec77-439a-bfb9-f89700ecf830 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:22.964071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 429/836] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:20:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:22.970613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136c235-15ab-4670-9588-17e91b92958a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:23.087658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136c235-15ab-4670-9588-17e91b92958a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:23.123680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ec754-2b22-4443-94ed-7bf41b3845ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:23.124486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ec754-2b22-4443-94ed-7bf41b3845ac None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:23.124772 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ec754-2b22-4443-94ed-7bf41b3845ac None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:23.125045 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ec754-2b22-4443-94ed-7bf41b3845ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:23.128136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:23.137665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ec754-2b22-4443-94ed-7bf41b3845ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:23.142030 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ec754-2b22-4443-94ed-7bf41b3845ac None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:23.157722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-7e0ec754-2b22-4443-94ed-7bf41b3845ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:23.157722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:23.157722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:23.157722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:23.157722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:23.157722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:23.157722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:23.157722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:23.157722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:23.157722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:23.157722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:23.157722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:23.157722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:23.157722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:23.157722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:23.158742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:23.159678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:23.159678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:23.159678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:23.159678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:23.159678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 408/837] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:23.166135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca521b-ec77-439a-bfb9-f89700ecf830 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:23.277368 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca521b-ec77-439a-bfb9-f89700ecf830 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:23.296927 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:23.315720 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35998817-0423-4759-8db5-59243d14ed54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:23.316761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35998817-0423-4759-8db5-59243d14ed54 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:23.317323 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35998817-0423-4759-8db5-59243d14ed54 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:23.317804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35998817-0423-4759-8db5-59243d14ed54 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:23.318766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35998817-0423-4759-8db5-59243d14ed54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:23.319278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35998817-0423-4759-8db5-59243d14ed54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:23.320878 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35998817-0423-4759-8db5-59243d14ed54 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:23.336029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 430/838] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:23.341896 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ec754-2b22-4443-94ed-7bf41b3845ac None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:23.468473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ec754-2b22-4443-94ed-7bf41b3845ac None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:23.515535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8a1d9-832b-48fa-9e3c-aa9edaba65ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:23.516371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8a1d9-832b-48fa-9e3c-aa9edaba65ee None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:23.516663 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8a1d9-832b-48fa-9e3c-aa9edaba65ee None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:23.516954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8a1d9-832b-48fa-9e3c-aa9edaba65ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:23.525727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8a1d9-832b-48fa-9e3c-aa9edaba65ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:23.528683 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8a1d9-832b-48fa-9e3c-aa9edaba65ee None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-99c8a1d9-832b-48fa-9e3c-aa9edaba65ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:23.545532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:23.546923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:23.548353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:23.548353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:23.548353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:23.548353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:23.548353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:23.548353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:23.548353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:23.548353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:23.548353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:20:23.548353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:23.548353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 409/839] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 18 10:20:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:23.557073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35998817-0423-4759-8db5-59243d14ed54 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:23.674266 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35998817-0423-4759-8db5-59243d14ed54 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:23.714443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e17257-69a8-40ae-80c3-2a1632ac5e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:23.716082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e17257-69a8-40ae-80c3-2a1632ac5e1e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:23.716572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e17257-69a8-40ae-80c3-2a1632ac5e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:23.717048 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e17257-69a8-40ae-80c3-2a1632ac5e1e None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:23.718091 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e17257-69a8-40ae-80c3-2a1632ac5e1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:23.718665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e17257-69a8-40ae-80c3-2a1632ac5e1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:23.720351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e17257-69a8-40ae-80c3-2a1632ac5e1e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:23.744450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 431/840] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 18 10:20:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:23.751428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8a1d9-832b-48fa-9e3c-aa9edaba65ee None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:23.806629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:23.862854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8a1d9-832b-48fa-9e3c-aa9edaba65ee None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:23.901782 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be85bb8-69cd-436f-8a26-42b44c434c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:23.902523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be85bb8-69cd-436f-8a26-42b44c434c84 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:23.902811 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be85bb8-69cd-436f-8a26-42b44c434c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:23.903089 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be85bb8-69cd-436f-8a26-42b44c434c84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:23.977996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be85bb8-69cd-436f-8a26-42b44c434c84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:23.979511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be85bb8-69cd-436f-8a26-42b44c434c84 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:24.038719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:24.090628 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 410/841] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:20:23 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:20:24.096689 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e17257-69a8-40ae-80c3-2a1632ac5e1e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:24.146409 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:24.220111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e17257-69a8-40ae-80c3-2a1632ac5e1e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:24.258621 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e3d68-8507-4cb6-af44-2e2cf5d4969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:24.259806 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3d68-8507-4cb6-af44-2e2cf5d4969d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:24.260291 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3d68-8507-4cb6-af44-2e2cf5d4969d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:24.260827 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3d68-8507-4cb6-af44-2e2cf5d4969d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:24.274527 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e3d68-8507-4cb6-af44-2e2cf5d4969d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:24.276540 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e3d68-8507-4cb6-af44-2e2cf5d4969d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:24.298349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-890e3d68-8507-4cb6-af44-2e2cf5d4969d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:24.298349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:24.298349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:24.298349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:24.298349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:24.298349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:24.298349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:24.298349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:24.298349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:24.298349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:24.298349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:24.298349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:24.298349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:24.298349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:24.298349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:24.299385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:24.300283 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:24.300283 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:24.300283 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:24.300283 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:24.306700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 432/842] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:24.309047 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be85bb8-69cd-436f-8a26-42b44c434c84 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:24.336361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd14be-e1b1-475f-8396-f1fe3e443754 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:24.336711 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd14be-e1b1-475f-8396-f1fe3e443754 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:24.336905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd14be-e1b1-475f-8396-f1fe3e443754 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:24.338478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 433/843] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:24.346022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38695-e486-4d62-b76f-022b08c3ebdd None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:24.346355 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38695-e486-4d62-b76f-022b08c3ebdd None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:24.346662 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38695-e486-4d62-b76f-022b08c3ebdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:24.368740 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3fc38695-e486-4d62-b76f-022b08c3ebdd None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:24.369943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3fc38695-e486-4d62-b76f-022b08c3ebdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:24.466511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be85bb8-69cd-436f-8a26-42b44c434c84 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:24.470399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 434/844] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:20:24.470399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b96548-e356-414f-8dcc-10c54cbc5d5b None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:24.470399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b96548-e356-414f-8dcc-10c54cbc5d5b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:24.470399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b96548-e356-414f-8dcc-10c54cbc5d5b None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:24.474865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 435/845] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:24.476181 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a70dd2-4fe6-4242-b49e-8d1c4d0e7dd4 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:24.476470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a70dd2-4fe6-4242-b49e-8d1c4d0e7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:24.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a70dd2-4fe6-4242-b49e-8d1c4d0e7dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:24.496261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-67a70dd2-4fe6-4242-b49e-8d1c4d0e7dd4 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:24.497493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-67a70dd2-4fe6-4242-b49e-8d1c4d0e7dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:24.514200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:24.516157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828e876-0fb3-4739-aa0f-106eadb3947e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:24.516854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828e876-0fb3-4739-aa0f-106eadb3947e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:24.517148 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828e876-0fb3-4739-aa0f-106eadb3947e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:24.517436 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828e876-0fb3-4739-aa0f-106eadb3947e None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:24.518177 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828e876-0fb3-4739-aa0f-106eadb3947e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:24.518509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828e876-0fb3-4739-aa0f-106eadb3947e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:24.520110 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828e876-0fb3-4739-aa0f-106eadb3947e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:24.536277 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 411/846] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:24.542100 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828e876-0fb3-4739-aa0f-106eadb3947e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:24.550833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:24.580588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 436/847] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:24.581926 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c3470-ba7e-47e0-b1ec-665f18c490df None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:24.582218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c3470-ba7e-47e0-b1ec-665f18c490df None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:24.582544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c3470-ba7e-47e0-b1ec-665f18c490df None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:24.583803 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 437/848] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:24.584485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c3470-ba7e-47e0-b1ec-665f18c490df None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:24.653624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828e876-0fb3-4739-aa0f-106eadb3947e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:24.689090 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2853c-a713-4d80-b3fc-7e3355bbacec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:24.689956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2853c-a713-4d80-b3fc-7e3355bbacec None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:24.690271 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2853c-a713-4d80-b3fc-7e3355bbacec None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:24.690581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2853c-a713-4d80-b3fc-7e3355bbacec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:24.691283 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2853c-a713-4d80-b3fc-7e3355bbacec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:24.692706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2853c-a713-4d80-b3fc-7e3355bbacec None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-b3b2853c-a713-4d80-b3fc-7e3355bbacec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:24.705702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:24.706871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:24.707738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:24.707738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:24.707738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:24.707738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:24.707738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:24.707738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:24.707738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:24.707738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:24.707738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:24.707738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:24.707738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:24.707738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:24.707738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:20:24.707738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:24.707738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 412/849] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:20:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:24.708528 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5f58a-3e49-41d2-ae56-73206dbd464a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:24.708786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5f58a-3e49-41d2-ae56-73206dbd464a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:24.709021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5f58a-3e49-41d2-ae56-73206dbd464a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:24.713366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c3470-ba7e-47e0-b1ec-665f18c490df None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:24.727427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-28b5f58a-3e49-41d2-ae56-73206dbd464a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:24.728629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-28b5f58a-3e49-41d2-ae56-73206dbd464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:24.753990 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ee74e-2d81-41c2-94d2-09164e17233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:24.754967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ee74e-2d81-41c2-94d2-09164e17233a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:24.755316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ee74e-2d81-41c2-94d2-09164e17233a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:24.755642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ee74e-2d81-41c2-94d2-09164e17233a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:24.764151 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ee74e-2d81-41c2-94d2-09164e17233a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:24.765741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ee74e-2d81-41c2-94d2-09164e17233a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:24.780936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-871ee74e-2d81-41c2-94d2-09164e17233a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:24.780936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:24.780936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:24.780936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:24.780936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:24.780936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:24.780936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:24.780936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:24.780936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:24.780936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:24.780936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:24.780936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:24.780936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:24.780936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:24.780936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:24.782069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:24.783210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:24.783210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:24.783210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:24.783210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:24.783210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:24.783210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:24.783210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:24.783210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:24.783210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 438/850] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:24.783210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ee74e-2d81-41c2-94d2-09164e17233a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:24.799236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:24.835137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 413/851] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:24.836007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5f58a-3e49-41d2-ae56-73206dbd464a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:24.838916 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:24.909515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ee74e-2d81-41c2-94d2-09164e17233a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:24.966291 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d764d7-9b45-4b1d-815e-dbf02f060d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:24.967376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d764d7-9b45-4b1d-815e-dbf02f060d61 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:24.967771 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d764d7-9b45-4b1d-815e-dbf02f060d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:24.968133 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d764d7-9b45-4b1d-815e-dbf02f060d61 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:24.968874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d764d7-9b45-4b1d-815e-dbf02f060d61 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:24.970362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d764d7-9b45-4b1d-815e-dbf02f060d61 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:24.976088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5f58a-3e49-41d2-ae56-73206dbd464a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-f3d764d7-9b45-4b1d-815e-dbf02f060d61 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:24.983437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:24.985053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:24.987038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 439/852] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Jul 18 10:20:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:24.988604 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d764d7-9b45-4b1d-815e-dbf02f060d61 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:25.025343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78cac2-d2b2-40f9-b1a7-90b6b7db6ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:25.025882 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78cac2-d2b2-40f9-b1a7-90b6b7db6ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:25.026657 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78cac2-d2b2-40f9-b1a7-90b6b7db6ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:25.026657 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78cac2-d2b2-40f9-b1a7-90b6b7db6ba6 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:25.027815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78cac2-d2b2-40f9-b1a7-90b6b7db6ba6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:25.027815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78cac2-d2b2-40f9-b1a7-90b6b7db6ba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:25.029480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78cac2-d2b2-40f9-b1a7-90b6b7db6ba6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:25.035697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 414/853] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:20:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:25.036506 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78cac2-d2b2-40f9-b1a7-90b6b7db6ba6 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:25.074969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:25.109674 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:25.110193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d764d7-9b45-4b1d-815e-dbf02f060d61 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:25.149338 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78cac2-d2b2-40f9-b1a7-90b6b7db6ba6 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:25.150415 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b63b63-4e7f-4efc-80e8-2244e3921c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:25.151239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b63b63-4e7f-4efc-80e8-2244e3921c2a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:25.151629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b63b63-4e7f-4efc-80e8-2244e3921c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:25.151905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b63b63-4e7f-4efc-80e8-2244e3921c2a None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:25.153521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b63b63-4e7f-4efc-80e8-2244e3921c2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:25.153958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b63b63-4e7f-4efc-80e8-2244e3921c2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:25.155858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b63b63-4e7f-4efc-80e8-2244e3921c2a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:25.171191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 440/854] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:25.172023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b63b63-4e7f-4efc-80e8-2244e3921c2a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:25.193122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d466a1-c6e4-479d-a523-6ea7cd5df018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:25.193924 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d466a1-c6e4-479d-a523-6ea7cd5df018 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:25.194208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d466a1-c6e4-479d-a523-6ea7cd5df018 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:25.194522 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d466a1-c6e4-479d-a523-6ea7cd5df018 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:25.208952 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d466a1-c6e4-479d-a523-6ea7cd5df018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-f9d466a1-c6e4-479d-a523-6ea7cd5df018 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:25.217461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:25.218531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:25.219402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:25.219402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:25.219402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:25.219402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:25.219402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:25.219402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:25.219402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:25.219402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:25.219402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:25.219402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:25.219402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:25.219402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:25.219402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 415/855] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:20:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:25.220089 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d466a1-c6e4-479d-a523-6ea7cd5df018 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:25.294471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b63b63-4e7f-4efc-80e8-2244e3921c2a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:25.327741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:25.334813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586fe2c-c023-4d2d-ad1f-b1ece01ad04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:25.335559 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586fe2c-c023-4d2d-ad1f-b1ece01ad04b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:25.348613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586fe2c-c023-4d2d-ad1f-b1ece01ad04b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:25.348613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586fe2c-c023-4d2d-ad1f-b1ece01ad04b None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:25.348613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586fe2c-c023-4d2d-ad1f-b1ece01ad04b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:25.348613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586fe2c-c023-4d2d-ad1f-b1ece01ad04b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:25.348613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586fe2c-c023-4d2d-ad1f-b1ece01ad04b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:25.348613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 441/856] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 18 10:20:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:25.349066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586fe2c-c023-4d2d-ad1f-b1ece01ad04b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:25.356859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d466a1-c6e4-479d-a523-6ea7cd5df018 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:25.385456 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:25.401110 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a389c-4295-42ba-a010-744652b86dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:25.401860 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a389c-4295-42ba-a010-744652b86dec None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:25.403695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a389c-4295-42ba-a010-744652b86dec None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:25.404747 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a389c-4295-42ba-a010-744652b86dec None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:25.405709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a389c-4295-42ba-a010-744652b86dec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:25.406088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a389c-4295-42ba-a010-744652b86dec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:25.409000 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a389c-4295-42ba-a010-744652b86dec None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:25.414050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 416/857] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:20:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:25.414710 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a389c-4295-42ba-a010-744652b86dec None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:25.483747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586fe2c-c023-4d2d-ad1f-b1ece01ad04b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:25.530037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626c649-8056-469d-bdfe-54e4851dedd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:25.530897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c649-8056-469d-bdfe-54e4851dedd1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:25.531186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c649-8056-469d-bdfe-54e4851dedd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:25.531464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c649-8056-469d-bdfe-54e4851dedd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:25.532366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626c649-8056-469d-bdfe-54e4851dedd1 None admin] RBAC: Adding query filter params (role.id=509fcb6f06144cdd9803fb3910eb80bf, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=8c34067d12a34f8ab2061460e86ef135) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:25.532734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626c649-8056-469d-bdfe-54e4851dedd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:25.534284 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626c649-8056-469d-bdfe-54e4851dedd1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:25.554368 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 442/858] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:20:25 2022] GET /identity/v3/role_assignments?user.id=8c34067d12a34f8ab2061460e86ef135&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=509fcb6f06144cdd9803fb3910eb80bf => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:25.554368 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626c649-8056-469d-bdfe-54e4851dedd1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:25.576938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a389c-4295-42ba-a010-744652b86dec None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:25.630754 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf21a6-52ac-4247-9616-1ddf97a8ff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:25.632093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf21a6-52ac-4247-9616-1ddf97a8ff4d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:25.632936 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf21a6-52ac-4247-9616-1ddf97a8ff4d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:25.633233 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf21a6-52ac-4247-9616-1ddf97a8ff4d None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:25.634069 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf21a6-52ac-4247-9616-1ddf97a8ff4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:25.634619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf21a6-52ac-4247-9616-1ddf97a8ff4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:25.636674 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf21a6-52ac-4247-9616-1ddf97a8ff4d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:25.649499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 417/859] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:20:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:25.655444 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf21a6-52ac-4247-9616-1ddf97a8ff4d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:25.659876 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:25.704712 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626c649-8056-469d-bdfe-54e4851dedd1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:25.718298 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:25.762782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60edc4-ab69-45ad-ba4c-16fa53cf4b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:25.763513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60edc4-ab69-45ad-ba4c-16fa53cf4b13 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:25.763820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60edc4-ab69-45ad-ba4c-16fa53cf4b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:25.764110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60edc4-ab69-45ad-ba4c-16fa53cf4b13 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:25.764929 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60edc4-ab69-45ad-ba4c-16fa53cf4b13 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:25.765241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60edc4-ab69-45ad-ba4c-16fa53cf4b13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:25.769366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60edc4-ab69-45ad-ba4c-16fa53cf4b13 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:25.773928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 443/860] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 18 10:20:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:25.783408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf21a6-52ac-4247-9616-1ddf97a8ff4d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:25.827098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8ae05-c4e8-4b9e-8381-dd734c0707a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:25.827924 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8ae05-c4e8-4b9e-8381-dd734c0707a4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:25.828209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8ae05-c4e8-4b9e-8381-dd734c0707a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:25.828483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8ae05-c4e8-4b9e-8381-dd734c0707a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:25.842023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8ae05-c4e8-4b9e-8381-dd734c0707a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:25.843542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8ae05-c4e8-4b9e-8381-dd734c0707a4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:25.864284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-60c8ae05-c4e8-4b9e-8381-dd734c0707a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:25.864284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:25.864284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:25.864284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:25.864284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:25.864284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:25.864284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:25.864284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:25.864284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:25.864284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:25.864284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:25.864284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:25.864284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:25.864284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:25.864284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:25.865429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:25.866781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:25.866781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:25.866781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:25.866781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:25.866781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 418/861] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:25.875658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60edc4-ab69-45ad-ba4c-16fa53cf4b13 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:26.010874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60edc4-ab69-45ad-ba4c-16fa53cf4b13 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:26.039683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:26.052721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15157d-c91b-4aaf-a716-4ee035587f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:26.053525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15157d-c91b-4aaf-a716-4ee035587f80 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:26.057967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15157d-c91b-4aaf-a716-4ee035587f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:26.057967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15157d-c91b-4aaf-a716-4ee035587f80 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:26.057967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15157d-c91b-4aaf-a716-4ee035587f80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:26.057967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15157d-c91b-4aaf-a716-4ee035587f80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:26.057967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15157d-c91b-4aaf-a716-4ee035587f80 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:26.072580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 444/862] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:26.078622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8ae05-c4e8-4b9e-8381-dd734c0707a4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:26.191807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8ae05-c4e8-4b9e-8381-dd734c0707a4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:26.194764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:26.231915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8927c-5bd0-4ae6-a3a2-dc83731808f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:26.233086 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8927c-5bd0-4ae6-a3a2-dc83731808f9 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:26.233600 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8927c-5bd0-4ae6-a3a2-dc83731808f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:26.234081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8927c-5bd0-4ae6-a3a2-dc83731808f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:26.242344 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8927c-5bd0-4ae6-a3a2-dc83731808f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:26.244116 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8927c-5bd0-4ae6-a3a2-dc83731808f9 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-69a8927c-5bd0-4ae6-a3a2-dc83731808f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:26.260264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:26.261299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:26.262981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:26.262981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:26.262981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:26.262981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:26.262981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:26.262981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:26.262981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:26.262981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:26.262981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:20:26.262981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:26.265635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 419/863] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:20:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:26.271515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15157d-c91b-4aaf-a716-4ee035587f80 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:26.384264 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15157d-c91b-4aaf-a716-4ee035587f80 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:26.423883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368337c3-a559-4503-aa5d-b3a3881c81f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:26.425002 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368337c3-a559-4503-aa5d-b3a3881c81f8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:26.425501 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368337c3-a559-4503-aa5d-b3a3881c81f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:26.425998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368337c3-a559-4503-aa5d-b3a3881c81f8 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:26.427071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368337c3-a559-4503-aa5d-b3a3881c81f8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:26.427638 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368337c3-a559-4503-aa5d-b3a3881c81f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:26.429328 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368337c3-a559-4503-aa5d-b3a3881c81f8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:26.450392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 445/864] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 18 10:20:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:26.459585 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8927c-5bd0-4ae6-a3a2-dc83731808f9 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:26.573440 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8927c-5bd0-4ae6-a3a2-dc83731808f9 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:26.610904 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271c1f8-6f6c-43bf-90b3-6a2e7bdcef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:26.612098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271c1f8-6f6c-43bf-90b3-6a2e7bdcef3a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:26.612622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271c1f8-6f6c-43bf-90b3-6a2e7bdcef3a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:26.613119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271c1f8-6f6c-43bf-90b3-6a2e7bdcef3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:26.649647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:26.693272 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271c1f8-6f6c-43bf-90b3-6a2e7bdcef3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:26.695368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271c1f8-6f6c-43bf-90b3-6a2e7bdcef3a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:26.801031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 420/865] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:20:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:20:26.807033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368337c3-a559-4503-aa5d-b3a3881c81f8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:26.856326 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:26.917077 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368337c3-a559-4503-aa5d-b3a3881c81f8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:26.971696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab712a8-1284-49a1-b363-3f1777115e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:26.972635 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab712a8-1284-49a1-b363-3f1777115e91 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:26.972959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab712a8-1284-49a1-b363-3f1777115e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:26.973280 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab712a8-1284-49a1-b363-3f1777115e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:26.988358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab712a8-1284-49a1-b363-3f1777115e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:26.990217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab712a8-1284-49a1-b363-3f1777115e91 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:27.012995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-bab712a8-1284-49a1-b363-3f1777115e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:27.012995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:27.012995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:27.012995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:27.012995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:27.012995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:27.012995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:27.012995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:27.012995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:27.012995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:27.012995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:27.012995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:27.012995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:27.012995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:27.012995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:27.014382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:27.015288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:27.015288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:27.015288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:27.015288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:27.015288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 446/866] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:27.021874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271c1f8-6f6c-43bf-90b3-6a2e7bdcef3a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:27.103642 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:27.154437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271c1f8-6f6c-43bf-90b3-6a2e7bdcef3a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:27.197220 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e01f11-65b1-4997-b203-827127a39c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:27.197909 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e01f11-65b1-4997-b203-827127a39c2b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:27.198230 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e01f11-65b1-4997-b203-827127a39c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:27.198614 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e01f11-65b1-4997-b203-827127a39c2b None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:27.200065 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e01f11-65b1-4997-b203-827127a39c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:27.200377 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e01f11-65b1-4997-b203-827127a39c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:27.202019 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e01f11-65b1-4997-b203-827127a39c2b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:27.218660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 421/867] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:27.227442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab712a8-1284-49a1-b363-3f1777115e91 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:27.340760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:27.348993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab712a8-1284-49a1-b363-3f1777115e91 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:27.388307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec307f-9dcf-4626-a6df-06724ce539b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:27.389204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec307f-9dcf-4626-a6df-06724ce539b4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:27.389551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec307f-9dcf-4626-a6df-06724ce539b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:27.389890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec307f-9dcf-4626-a6df-06724ce539b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:27.398891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec307f-9dcf-4626-a6df-06724ce539b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:27.400570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec307f-9dcf-4626-a6df-06724ce539b4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:27.416633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-beec307f-9dcf-4626-a6df-06724ce539b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:27.416633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:27.416633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:27.416633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:27.416633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:27.416633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:27.416633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:27.416633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:27.416633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:27.416633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:27.416633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:27.416633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:27.416633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:27.416633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:27.416633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:27.417611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:27.419471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:27.419471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:27.419471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:27.419471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:27.419471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:27.419471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:27.419471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:27.419471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:27.419471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 447/868] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:27.427453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e01f11-65b1-4997-b203-827127a39c2b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:27.549539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e01f11-65b1-4997-b203-827127a39c2b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:27.570918 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436a332-b2f1-44f6-bf29-7ccdba6247f8 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:27.571565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436a332-b2f1-44f6-bf29-7ccdba6247f8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:27.571848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436a332-b2f1-44f6-bf29-7ccdba6247f8 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:27.573790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 448/869] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:27.580854 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c91e0-7d06-45c3-a607-e00ddab0a910 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:27.581447 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c91e0-7d06-45c3-a607-e00ddab0a910 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:27.581751 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c91e0-7d06-45c3-a607-e00ddab0a910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:27.584884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:27.595924 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace71046-e620-4233-a007-4a18f04d86dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:27.602450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace71046-e620-4233-a007-4a18f04d86dd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:27.602450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace71046-e620-4233-a007-4a18f04d86dd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:27.602450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace71046-e620-4233-a007-4a18f04d86dd None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:27.602450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace71046-e620-4233-a007-4a18f04d86dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:27.602450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace71046-e620-4233-a007-4a18f04d86dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:27.602450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace71046-e620-4233-a007-4a18f04d86dd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:27.608801 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-744c91e0-7d06-45c3-a607-e00ddab0a910 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:27.611314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-744c91e0-7d06-45c3-a607-e00ddab0a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:27.615748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 422/870] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:27.623570 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace71046-e620-4233-a007-4a18f04d86dd None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:27.727955 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 449/871] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:27.750456 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace71046-e620-4233-a007-4a18f04d86dd None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:27.753114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c91e0-7d06-45c3-a607-e00ddab0a910 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:27.794608 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be5e4c-997e-4f4d-a2ec-f496ff9b5faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:27.795380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5e4c-997e-4f4d-a2ec-f496ff9b5faf None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:27.795663 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5e4c-997e-4f4d-a2ec-f496ff9b5faf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:27.795936 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5e4c-997e-4f4d-a2ec-f496ff9b5faf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:27.796780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be5e4c-997e-4f4d-a2ec-f496ff9b5faf None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=a8ee2beff1a7487d92c1c5940f2784f1) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:27.797148 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be5e4c-997e-4f4d-a2ec-f496ff9b5faf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:27.798647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be5e4c-997e-4f4d-a2ec-f496ff9b5faf None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:27.814080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 423/872] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:20:27 2022] GET /identity/v3/role_assignments?user.id=a8ee2beff1a7487d92c1c5940f2784f1&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:27.854135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:27.874447 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c91e0-7d06-45c3-a607-e00ddab0a910 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:27.917317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b6569-2dbd-4269-8dd2-5ef18bf51e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:27.918839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b6569-2dbd-4269-8dd2-5ef18bf51e51 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:27.919152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b6569-2dbd-4269-8dd2-5ef18bf51e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:27.919493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b6569-2dbd-4269-8dd2-5ef18bf51e51 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:27.920219 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b6569-2dbd-4269-8dd2-5ef18bf51e51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:27.921678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b6569-2dbd-4269-8dd2-5ef18bf51e51 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:27.991363 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 450/873] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 18 10:20:27 2022] POST /identity/v3/services => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:20:28.081376 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a4b49-e948-43be-9dbf-72ce935fe7e6 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:28.082161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a4b49-e948-43be-9dbf-72ce935fe7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:28.082161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a4b49-e948-43be-9dbf-72ce935fe7e6 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:28.083548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 424/874] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:28.091095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156fc3d-3c35-44aa-b4fe-70fd538be57c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:28.092016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156fc3d-3c35-44aa-b4fe-70fd538be57c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:28.092787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156fc3d-3c35-44aa-b4fe-70fd538be57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:28.124657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d156fc3d-3c35-44aa-b4fe-70fd538be57c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:28.127333 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d156fc3d-3c35-44aa-b4fe-70fd538be57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:28.199558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7595d-c612-42ad-8bfa-596db6923add None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:28.199817 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7595d-c612-42ad-8bfa-596db6923add None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:28.200146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7595d-c612-42ad-8bfa-596db6923add None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:28.202422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 425/875] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:28.209594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0dde7-411d-4b57-8366-9a6690eb7d76 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:28.210099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0dde7-411d-4b57-8366-9a6690eb7d76 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:28.211104 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0dde7-411d-4b57-8366-9a6690eb7d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:28.239447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-01e0dde7-411d-4b57-8366-9a6690eb7d76 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:28.241558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-01e0dde7-411d-4b57-8366-9a6690eb7d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:28.250449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 451/876] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:28 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:28.274816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156fc3d-3c35-44aa-b4fe-70fd538be57c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:28.318743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:28.334598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 426/877] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:28 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:28.352630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:28.358725 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0dde7-411d-4b57-8366-9a6690eb7d76 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:28.390241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156fc3d-3c35-44aa-b4fe-70fd538be57c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:28.427551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a772eb-ba79-47c8-be55-c02ac34b9e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:28.428535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a772eb-ba79-47c8-be55-c02ac34b9e1c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:28.428887 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a772eb-ba79-47c8-be55-c02ac34b9e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:28.429669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a772eb-ba79-47c8-be55-c02ac34b9e1c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:28.447134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a772eb-ba79-47c8-be55-c02ac34b9e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-24a772eb-ba79-47c8-be55-c02ac34b9e1c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:28.459240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:28.463894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:28.465535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:28.465535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:28.465535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:28.465535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:28.465535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:28.465535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:28.465535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:28.465535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:28.465535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:28.465535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:28.465535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:20:28.465535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:28.468189 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 452/878] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 18 10:20:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:28.468952 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a772eb-ba79-47c8-be55-c02ac34b9e1c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:28.482389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0dde7-411d-4b57-8366-9a6690eb7d76 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:28.527984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537dd40-4bd2-4db1-80b3-de3bb85b0a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:28.529480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537dd40-4bd2-4db1-80b3-de3bb85b0a87 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:28.529956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537dd40-4bd2-4db1-80b3-de3bb85b0a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:28.530774 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537dd40-4bd2-4db1-80b3-de3bb85b0a87 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:28.532073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537dd40-4bd2-4db1-80b3-de3bb85b0a87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:28.534784 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537dd40-4bd2-4db1-80b3-de3bb85b0a87 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:28.595289 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 427/879] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 18 10:20:28 2022] POST /identity/v3/services => generated 269 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:20:28.598106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a772eb-ba79-47c8-be55-c02ac34b9e1c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:28.640634 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:28.655423 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b539f8-62dc-4eb7-8345-69867bf3ed66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:28.656125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b539f8-62dc-4eb7-8345-69867bf3ed66 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:28.656404 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b539f8-62dc-4eb7-8345-69867bf3ed66 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:28.656758 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b539f8-62dc-4eb7-8345-69867bf3ed66 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:28.657554 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b539f8-62dc-4eb7-8345-69867bf3ed66 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:28.657864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b539f8-62dc-4eb7-8345-69867bf3ed66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:28.659330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b539f8-62dc-4eb7-8345-69867bf3ed66 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:28.670941 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 453/880] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 18 10:20:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:28.679504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537dd40-4bd2-4db1-80b3-de3bb85b0a87 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:28.731238 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:28.801438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537dd40-4bd2-4db1-80b3-de3bb85b0a87 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:28.838797 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ef817-f6de-49ce-8a36-a24777097aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:28.840186 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ef817-f6de-49ce-8a36-a24777097aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:28.840484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ef817-f6de-49ce-8a36-a24777097aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:28.840780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ef817-f6de-49ce-8a36-a24777097aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:28.852917 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ef817-f6de-49ce-8a36-a24777097aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:28.854372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ef817-f6de-49ce-8a36-a24777097aa2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:28.874306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-d40ef817-f6de-49ce-8a36-a24777097aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:28.874306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:28.874306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:28.874306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:28.874306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:28.874306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:28.874306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:28.874306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:28.874306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:28.874306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:28.874306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:28.874306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:28.874306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:28.874306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:28.874306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:28.875326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:28.876655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:28.876655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:28.876655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:28.876655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:28.876655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 428/881] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:28.881746 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b539f8-62dc-4eb7-8345-69867bf3ed66 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:28.998828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b539f8-62dc-4eb7-8345-69867bf3ed66 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:29.037100 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d02973-e0df-4633-93d9-e83fded83f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:29.037761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d02973-e0df-4633-93d9-e83fded83f40 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:29.038040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d02973-e0df-4633-93d9-e83fded83f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:29.038315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d02973-e0df-4633-93d9-e83fded83f40 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:29.039068 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d02973-e0df-4633-93d9-e83fded83f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:29.039369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d02973-e0df-4633-93d9-e83fded83f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:29.040733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d02973-e0df-4633-93d9-e83fded83f40 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:29.054109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 454/882] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:29.059630 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ef817-f6de-49ce-8a36-a24777097aa2 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:29.168234 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:29.182789 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ef817-f6de-49ce-8a36-a24777097aa2 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:29.221231 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0fbfc-fc6e-4662-8046-e4cd3d70b58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:29.222442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0fbfc-fc6e-4662-8046-e4cd3d70b58e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:29.222982 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0fbfc-fc6e-4662-8046-e4cd3d70b58e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:29.223468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0fbfc-fc6e-4662-8046-e4cd3d70b58e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:29.233099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0fbfc-fc6e-4662-8046-e4cd3d70b58e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:29.235035 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0fbfc-fc6e-4662-8046-e4cd3d70b58e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-c0e0fbfc-fc6e-4662-8046-e4cd3d70b58e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:29.252757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:29.253769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:29.254755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:29.254755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:29.254755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:29.254755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:29.254755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:29.254755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:29.254755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:29.254755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:29.254755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:20:29.254755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:29.257500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 429/883] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 18 10:20:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:29.267467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d02973-e0df-4633-93d9-e83fded83f40 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:29.323786 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:29.381423 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d02973-e0df-4633-93d9-e83fded83f40 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:29.420151 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4a22b-8565-4a02-a641-5fcff5435fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:29.420780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4a22b-8565-4a02-a641-5fcff5435fcd None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:29.421064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4a22b-8565-4a02-a641-5fcff5435fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:29.421337 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4a22b-8565-4a02-a641-5fcff5435fcd None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:29.422167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4a22b-8565-4a02-a641-5fcff5435fcd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:29.422507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4a22b-8565-4a02-a641-5fcff5435fcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:29.423993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4a22b-8565-4a02-a641-5fcff5435fcd None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:29.443503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 455/884] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 18 10:20:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:29.451470 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0fbfc-fc6e-4662-8046-e4cd3d70b58e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:29.564960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0fbfc-fc6e-4662-8046-e4cd3d70b58e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:29.599766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613147eb-1310-46e0-8636-1efdd4dd3e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:29.600415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613147eb-1310-46e0-8636-1efdd4dd3e24 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:29.600694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613147eb-1310-46e0-8636-1efdd4dd3e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:29.600969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613147eb-1310-46e0-8636-1efdd4dd3e24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:29.623272 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:29.676685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613147eb-1310-46e0-8636-1efdd4dd3e24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:29.678144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613147eb-1310-46e0-8636-1efdd4dd3e24 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:29.785305 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 430/885] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:20:29 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:20:29.791021 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4a22b-8565-4a02-a641-5fcff5435fcd None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:29.908913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4a22b-8565-4a02-a641-5fcff5435fcd None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:29.918197 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:29.950645 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bafb37-6af8-4de1-8684-526668035c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:29.951587 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bafb37-6af8-4de1-8684-526668035c20 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:29.951875 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bafb37-6af8-4de1-8684-526668035c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:29.952154 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bafb37-6af8-4de1-8684-526668035c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:29.965136 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bafb37-6af8-4de1-8684-526668035c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:29.966932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bafb37-6af8-4de1-8684-526668035c20 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:29.987352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-09bafb37-6af8-4de1-8684-526668035c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:29.987352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:29.987352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:29.987352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:29.987352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:29.987352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:29.987352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:29.987352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:29.987352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:29.987352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:29.987352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:29.987352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:29.987352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:29.987352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:29.987352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:29.988314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:29.989665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:29.989665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:29.989665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:29.989665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:29.989665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 456/886] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:29.994671 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613147eb-1310-46e0-8636-1efdd4dd3e24 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:30.051187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:30.103880 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613147eb-1310-46e0-8636-1efdd4dd3e24 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:30.141893 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c1d74-168b-40e7-88b5-ee28d2c08781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:30.142609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c1d74-168b-40e7-88b5-ee28d2c08781 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:30.142910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c1d74-168b-40e7-88b5-ee28d2c08781 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:30.143186 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c1d74-168b-40e7-88b5-ee28d2c08781 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:30.143943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c1d74-168b-40e7-88b5-ee28d2c08781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:30.144267 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c1d74-168b-40e7-88b5-ee28d2c08781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:30.145660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c1d74-168b-40e7-88b5-ee28d2c08781 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:30.159411 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 431/887] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:30.164607 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bafb37-6af8-4de1-8684-526668035c20 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:30.241106 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423060a0-b2ef-4d89-a9e8-6375d51c7806 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:30.241771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423060a0-b2ef-4d89-a9e8-6375d51c7806 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:30.241771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423060a0-b2ef-4d89-a9e8-6375d51c7806 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:30.243384 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 432/888] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:30.249481 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e619a84-ca95-41a8-aee6-7cbb0dc126db None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:30.249774 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e619a84-ca95-41a8-aee6-7cbb0dc126db None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:30.250149 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e619a84-ca95-41a8-aee6-7cbb0dc126db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:30.269369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3e619a84-ca95-41a8-aee6-7cbb0dc126db None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:30.270730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3e619a84-ca95-41a8-aee6-7cbb0dc126db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:30.274645 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bafb37-6af8-4de1-8684-526668035c20 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:30.313673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3c68e-ea18-4418-bd96-56808763996e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:30.314540 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3c68e-ea18-4418-bd96-56808763996e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:30.314829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3c68e-ea18-4418-bd96-56808763996e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:30.315107 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3c68e-ea18-4418-bd96-56808763996e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:30.323301 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3c68e-ea18-4418-bd96-56808763996e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:30.325602 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3c68e-ea18-4418-bd96-56808763996e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:30.341809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-ebb3c68e-ea18-4418-bd96-56808763996e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:30.341809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:30.341809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:30.341809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:30.341809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:30.341809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:30.341809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:30.341809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:30.341809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:30.341809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:30.341809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:30.341809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:30.341809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:30.341809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:30.341809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:30.342966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:30.343861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:30.343861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:30.343861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:30.343861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:30.343861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:30.343861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:30.343861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:30.343861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:30.343861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 457/889] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:30.344354 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd00cf7-a04c-4f72-a9a1-ecad46e2d81d None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:30.344975 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd00cf7-a04c-4f72-a9a1-ecad46e2d81d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:30.344975 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd00cf7-a04c-4f72-a9a1-ecad46e2d81d None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:30.346258 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 458/890] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:30.348858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd00cf7-a04c-4f72-a9a1-ecad46e2d81d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:30.350732 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 433/891] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:20:30.352132 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b7948-e4af-45b3-9341-d61da3576c60 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:30.352502 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b7948-e4af-45b3-9341-d61da3576c60 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:30.352866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b7948-e4af-45b3-9341-d61da3576c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:30.372233 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-984b7948-e4af-45b3-9341-d61da3576c60 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:30.373892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-984b7948-e4af-45b3-9341-d61da3576c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:30.375239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:30.412604 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:30.467035 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 434/892] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:30.468221 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b7948-e4af-45b3-9341-d61da3576c60 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:30.488750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd00cf7-a04c-4f72-a9a1-ecad46e2d81d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:30.533159 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a005f-6a93-4703-9424-4347fda3df63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:30.533727 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a005f-6a93-4703-9424-4347fda3df63 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:30.534006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a005f-6a93-4703-9424-4347fda3df63 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:30.534304 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a005f-6a93-4703-9424-4347fda3df63 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:30.535083 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a005f-6a93-4703-9424-4347fda3df63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:30.535407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a005f-6a93-4703-9424-4347fda3df63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:30.536841 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a005f-6a93-4703-9424-4347fda3df63 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:30.556339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 459/893] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:30.556339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a005f-6a93-4703-9424-4347fda3df63 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:30.584107 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b7948-e4af-45b3-9341-d61da3576c60 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:30.625886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93507409-42ec-4193-92ac-05e76c80e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:30.626726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93507409-42ec-4193-92ac-05e76c80e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:30.627009 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93507409-42ec-4193-92ac-05e76c80e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:30.627285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93507409-42ec-4193-92ac-05e76c80e9c3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:30.627987 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93507409-42ec-4193-92ac-05e76c80e9c3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:30.629368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93507409-42ec-4193-92ac-05e76c80e9c3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-93507409-42ec-4193-92ac-05e76c80e9c3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:30.642749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:30.643825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:30.644719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:30.644719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:30.644719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:30.644719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:30.644719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:30.644719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:30.644719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:30.644719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:30.644719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:30.644719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:30.644719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:30.644719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:30.644719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:20:30.644719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:30.644719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 435/894] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 18 10:20:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:30.645523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93507409-42ec-4193-92ac-05e76c80e9c3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:30.653229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:30.678433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a005f-6a93-4703-9424-4347fda3df63 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:30.691924 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:30.719596 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff9600-7d9a-46da-b8d9-399e69f920b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:30.720388 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff9600-7d9a-46da-b8d9-399e69f920b1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:30.720685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff9600-7d9a-46da-b8d9-399e69f920b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:30.721015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff9600-7d9a-46da-b8d9-399e69f920b1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:30.721933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff9600-7d9a-46da-b8d9-399e69f920b1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:30.723351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff9600-7d9a-46da-b8d9-399e69f920b1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-b8ff9600-7d9a-46da-b8d9-399e69f920b1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:30.736931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:30.739218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:30.740238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:30.740238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:30.740238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:30.740238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:30.740238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:30.740238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:30.740238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:30.740238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:30.740238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:30.740238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:30.740238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:30.740238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:30.740238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:20:30.740238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:30.740238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 460/895] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:20:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:30.741110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff9600-7d9a-46da-b8d9-399e69f920b1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:30.774218 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93507409-42ec-4193-92ac-05e76c80e9c3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:30.817371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14288493-6f21-4903-8d2b-cd053a43701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:30.817926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14288493-6f21-4903-8d2b-cd053a43701e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:30.818208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14288493-6f21-4903-8d2b-cd053a43701e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:30.818597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14288493-6f21-4903-8d2b-cd053a43701e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:30.819439 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14288493-6f21-4903-8d2b-cd053a43701e None admin] RBAC: Adding query filter params (role.id=bcef1c0f49bf4bd5a5946b34ab8ba902, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=8c34067d12a34f8ab2061460e86ef135) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:30.819754 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14288493-6f21-4903-8d2b-cd053a43701e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:30.821261 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14288493-6f21-4903-8d2b-cd053a43701e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:30.834761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 436/896] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:20:30 2022] GET /identity/v3/role_assignments?user.id=8c34067d12a34f8ab2061460e86ef135&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=bcef1c0f49bf4bd5a5946b34ab8ba902 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:30.835578 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14288493-6f21-4903-8d2b-cd053a43701e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:30.871579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff9600-7d9a-46da-b8d9-399e69f920b1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:30.928554 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e0f00-2dc0-4ad7-8e41-7d3d4dd1be75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:30.930298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e0f00-2dc0-4ad7-8e41-7d3d4dd1be75 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:30.930905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e0f00-2dc0-4ad7-8e41-7d3d4dd1be75 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:30.931438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e0f00-2dc0-4ad7-8e41-7d3d4dd1be75 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:30.932553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e0f00-2dc0-4ad7-8e41-7d3d4dd1be75 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:30.934757 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e0f00-2dc0-4ad7-8e41-7d3d4dd1be75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:30.937120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e0f00-2dc0-4ad7-8e41-7d3d4dd1be75 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:30.950439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 461/897] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 18 10:20:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:30.950439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825032c6-19bb-4a12-9503-882bf42416f0 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:30.950439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825032c6-19bb-4a12-9503-882bf42416f0 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:30.950439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825032c6-19bb-4a12-9503-882bf42416f0 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:30.950439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 462/898] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:30.956064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825032c6-19bb-4a12-9503-882bf42416f0 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:30.973705 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:30.999011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:31.003202 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14288493-6f21-4903-8d2b-cd053a43701e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:31.044615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecba11-e733-4e3b-94be-531a9fe15499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:31.045298 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecba11-e733-4e3b-94be-531a9fe15499 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:31.045577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecba11-e733-4e3b-94be-531a9fe15499 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:31.045877 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecba11-e733-4e3b-94be-531a9fe15499 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:31.046651 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecba11-e733-4e3b-94be-531a9fe15499 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:31.046954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecba11-e733-4e3b-94be-531a9fe15499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:31.048378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecba11-e733-4e3b-94be-531a9fe15499 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:31.055941 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 437/899] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:20:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:31.057481 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745952a-dbe8-4791-8fe9-ce1f009f493d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:31.059210 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745952a-dbe8-4791-8fe9-ce1f009f493d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:31.059210 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745952a-dbe8-4791-8fe9-ce1f009f493d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:31.081069 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2745952a-dbe8-4791-8fe9-ce1f009f493d None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:31.082217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2745952a-dbe8-4791-8fe9-ce1f009f493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:31.112658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825032c6-19bb-4a12-9503-882bf42416f0 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:31.159341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae5748-65cd-4041-8479-c4a99dffb9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:31.159588 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 438/900] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:31.160479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745952a-dbe8-4791-8fe9-ce1f009f493d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:31.160790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae5748-65cd-4041-8479-c4a99dffb9ef None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:31.161257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae5748-65cd-4041-8479-c4a99dffb9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:31.161540 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae5748-65cd-4041-8479-c4a99dffb9ef None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:31.162292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae5748-65cd-4041-8479-c4a99dffb9ef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:31.162637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae5748-65cd-4041-8479-c4a99dffb9ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:31.164023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae5748-65cd-4041-8479-c4a99dffb9ef None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:31.180717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 463/901] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 18 10:20:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:31.183768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae5748-65cd-4041-8479-c4a99dffb9ef None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:31.285162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:31.296529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745952a-dbe8-4791-8fe9-ce1f009f493d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:31.326737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:31.338831 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0dd50-2e9f-4de1-856a-482bc6dcaef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:31.340732 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0dd50-2e9f-4de1-856a-482bc6dcaef5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:31.341273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0dd50-2e9f-4de1-856a-482bc6dcaef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:31.341769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0dd50-2e9f-4de1-856a-482bc6dcaef5 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:31.342755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0dd50-2e9f-4de1-856a-482bc6dcaef5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:31.343290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0dd50-2e9f-4de1-856a-482bc6dcaef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:31.344909 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0dd50-2e9f-4de1-856a-482bc6dcaef5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:31.350405 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae5748-65cd-4041-8479-c4a99dffb9ef None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:31.353585 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 439/902] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:20:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:31.361104 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0dd50-2e9f-4de1-856a-482bc6dcaef5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:31.403673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3d3d6-050a-4753-ad15-716afcad96a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:31.405068 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3d3d6-050a-4753-ad15-716afcad96a4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:31.405660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3d3d6-050a-4753-ad15-716afcad96a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:31.406280 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3d3d6-050a-4753-ad15-716afcad96a4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:31.407639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3d3d6-050a-4753-ad15-716afcad96a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:31.410404 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3d3d6-050a-4753-ad15-716afcad96a4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-24c3d3d6-050a-4753-ad15-716afcad96a4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:31.429150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:31.430182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:31.431320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:31.431320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:31.431320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:31.431320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:31.431320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:31.431320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:31.431320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:31.431320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:31.431320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:31.431320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:31.431320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:31.431320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:31.431320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:31.431320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:20:31.431320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:31.436264 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 464/903] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Jul 18 10:20:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:31.440484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3d3d6-050a-4753-ad15-716afcad96a4 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:31.482655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0dd50-2e9f-4de1-856a-482bc6dcaef5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:31.523582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3278c-07a5-4451-b0f4-15c49e677c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:31.524677 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3278c-07a5-4451-b0f4-15c49e677c89 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:31.525168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3278c-07a5-4451-b0f4-15c49e677c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:31.525720 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3278c-07a5-4451-b0f4-15c49e677c89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:31.526758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3278c-07a5-4451-b0f4-15c49e677c89 None admin] RBAC: Adding query filter params (interface=public, service_id=6c8638f157b149fa8a6e4f1f069273f9, region_id=RegionOne) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:31.527348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3278c-07a5-4451-b0f4-15c49e677c89 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:31.529049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3278c-07a5-4451-b0f4-15c49e677c89 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:31.535371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 440/904] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 18 10:20:31 2022] GET /identity/v3/endpoints?service_id=6c8638f157b149fa8a6e4f1f069273f9&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:31.544950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3278c-07a5-4451-b0f4-15c49e677c89 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:31.572924 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:31.593345 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3d3d6-050a-4753-ad15-716afcad96a4 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:31.637830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f053293-1242-4c36-817a-6134e9b8e1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:31.638811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f053293-1242-4c36-817a-6134e9b8e1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:31.639339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f053293-1242-4c36-817a-6134e9b8e1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:31.639763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f053293-1242-4c36-817a-6134e9b8e1f7 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:31.640628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f053293-1242-4c36-817a-6134e9b8e1f7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:31.641087 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f053293-1242-4c36-817a-6134e9b8e1f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:31.642772 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f053293-1242-4c36-817a-6134e9b8e1f7 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:31.644340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:31.649811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 465/905] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 18 10:20:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:31.658541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f053293-1242-4c36-817a-6134e9b8e1f7 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:31.663873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3278c-07a5-4451-b0f4-15c49e677c89 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:31.705583 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2edd5-12e5-4a59-85ff-35523901cd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:31.706671 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2edd5-12e5-4a59-85ff-35523901cd51 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:31.707032 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2edd5-12e5-4a59-85ff-35523901cd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:31.707386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2edd5-12e5-4a59-85ff-35523901cd51 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:31.708160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2edd5-12e5-4a59-85ff-35523901cd51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:31.709608 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2edd5-12e5-4a59-85ff-35523901cd51 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:31.717574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 441/906] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 18 10:20:31 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:20:31.784278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f053293-1242-4c36-817a-6134e9b8e1f7 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:31.823357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969cc50-f983-4596-8675-352e1412e546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:31.824914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969cc50-f983-4596-8675-352e1412e546 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:31.825202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969cc50-f983-4596-8675-352e1412e546 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:31.825571 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969cc50-f983-4596-8675-352e1412e546 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:31.826302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969cc50-f983-4596-8675-352e1412e546 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:31.826633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969cc50-f983-4596-8675-352e1412e546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:31.828037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969cc50-f983-4596-8675-352e1412e546 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:31.838466 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 466/907] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 18 10:20:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:31.840843 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2edd5-12e5-4a59-85ff-35523901cd51 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:31.938205 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:31.955465 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2edd5-12e5-4a59-85ff-35523901cd51 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:31.993379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ad145-adca-4e4e-bba3-ad00f1f9d68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:31.994044 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ad145-adca-4e4e-bba3-ad00f1f9d68b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:31.994349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ad145-adca-4e4e-bba3-ad00f1f9d68b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:31.994631 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ad145-adca-4e4e-bba3-ad00f1f9d68b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:31.995463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ad145-adca-4e4e-bba3-ad00f1f9d68b None admin] RBAC: Adding query filter params (interface=public, service_id=6023628d00a449d1aaa853dd6517aeb0, region_id=RegionOne) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:31.996295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ad145-adca-4e4e-bba3-ad00f1f9d68b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:31.997675 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ad145-adca-4e4e-bba3-ad00f1f9d68b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:32.008527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 442/908] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 18 10:20:31 2022] GET /identity/v3/endpoints?service_id=6023628d00a449d1aaa853dd6517aeb0&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:32.010036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969cc50-f983-4596-8675-352e1412e546 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:32.079007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:32.120421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969cc50-f983-4596-8675-352e1412e546 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:32.158921 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6588065-b41a-4e7d-bea9-4198db0d750d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:32.159618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588065-b41a-4e7d-bea9-4198db0d750d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:32.159907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588065-b41a-4e7d-bea9-4198db0d750d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:32.160184 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588065-b41a-4e7d-bea9-4198db0d750d None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:32.160943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6588065-b41a-4e7d-bea9-4198db0d750d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:32.162559 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6588065-b41a-4e7d-bea9-4198db0d750d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:32.174495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 467/909] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 18 10:20:32 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:20:33.006782 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fab1b-eae2-4a3b-93a7-841d5e9e1e18 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:33.007329 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fab1b-eae2-4a3b-93a7-841d5e9e1e18 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:33.007329 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fab1b-eae2-4a3b-93a7-841d5e9e1e18 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:33.009267 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 443/910] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:33.014626 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba63dc-e5b9-4449-84ab-9e54b630084c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:33.015033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba63dc-e5b9-4449-84ab-9e54b630084c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:33.015223 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba63dc-e5b9-4449-84ab-9e54b630084c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:33.032567 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e1ba63dc-e5b9-4449-84ab-9e54b630084c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:33.033745 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e1ba63dc-e5b9-4449-84ab-9e54b630084c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:33.103497 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 468/911] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:33.126004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fab1b-eae2-4a3b-93a7-841d5e9e1e18 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:33.231192 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fab1b-eae2-4a3b-93a7-841d5e9e1e18 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:33.267770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ed768-627a-4309-97a8-8ca240283261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:33.268592 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ed768-627a-4309-97a8-8ca240283261 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:33.268871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ed768-627a-4309-97a8-8ca240283261 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:33.269142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ed768-627a-4309-97a8-8ca240283261 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:33.280455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ed768-627a-4309-97a8-8ca240283261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-1c7ed768-627a-4309-97a8-8ca240283261 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:33.288740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:33.289688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:33.290580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:33.290580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:33.290580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:33.290580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:33.290580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:33.290580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:33.290580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:33.290580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:33.290580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:33.290580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:33.290580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:20:33.290580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:33.290580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 444/912] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 18 10:20:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:33.296805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba63dc-e5b9-4449-84ab-9e54b630084c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:33.315341 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a54bd-fc1d-44f0-bc84-c9867b929ef8 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:33.315669 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a54bd-fc1d-44f0-bc84-c9867b929ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:33.315893 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a54bd-fc1d-44f0-bc84-c9867b929ef8 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:33.317516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 445/913] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:33.323629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597c679-3bc0-499f-aab0-6fb5cdb2f4e4 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:33.324452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597c679-3bc0-499f-aab0-6fb5cdb2f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:33.324849 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597c679-3bc0-499f-aab0-6fb5cdb2f4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:33.345479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4597c679-3bc0-499f-aab0-6fb5cdb2f4e4 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:33.347158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4597c679-3bc0-499f-aab0-6fb5cdb2f4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:33.362710 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:33.365625 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:33.422209 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba63dc-e5b9-4449-84ab-9e54b630084c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:33.434745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 446/914] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:20:33.448371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597c679-3bc0-499f-aab0-6fb5cdb2f4e4 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:33.461757 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8743e35-769b-4ce1-995e-bd7534a2b06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:33.462804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8743e35-769b-4ce1-995e-bd7534a2b06e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:33.463325 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8743e35-769b-4ce1-995e-bd7534a2b06e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:33.464033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8743e35-769b-4ce1-995e-bd7534a2b06e None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:33.465849 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8743e35-769b-4ce1-995e-bd7534a2b06e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:33.466456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8743e35-769b-4ce1-995e-bd7534a2b06e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:33.468162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8743e35-769b-4ce1-995e-bd7534a2b06e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:33.478360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 469/915] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 18 10:20:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:33.484195 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8743e35-769b-4ce1-995e-bd7534a2b06e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:33.572376 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597c679-3bc0-499f-aab0-6fb5cdb2f4e4 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:33.617255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9bc24-cac1-4c90-a443-9f0027e8723f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:33.618299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9bc24-cac1-4c90-a443-9f0027e8723f None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:33.618789 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8743e35-769b-4ce1-995e-bd7534a2b06e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:33.619062 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9bc24-cac1-4c90-a443-9f0027e8723f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:33.619541 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9bc24-cac1-4c90-a443-9f0027e8723f None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:33.621344 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9bc24-cac1-4c90-a443-9f0027e8723f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:33.623917 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9bc24-cac1-4c90-a443-9f0027e8723f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:33.638547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:33.655390 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e0241-39f2-4e80-b305-db2aeabfca27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:33.656180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e0241-39f2-4e80-b305-db2aeabfca27 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:33.656461 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e0241-39f2-4e80-b305-db2aeabfca27 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:33.656734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e0241-39f2-4e80-b305-db2aeabfca27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:33.668198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e0241-39f2-4e80-b305-db2aeabfca27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:33.669737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e0241-39f2-4e80-b305-db2aeabfca27 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:33.687473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:33.690252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-451e0241-39f2-4e80-b305-db2aeabfca27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:33.690252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:33.690252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:33.690252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:33.690252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:33.690252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:33.690252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:33.690252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:33.690252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:33.690252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:33.690252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:33.690252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:33.690252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:33.690252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:33.690252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:33.691198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:33.692122 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:33.692122 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:33.692122 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:33.692122 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:33.694404 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 470/916] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:33.699870 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e0241-39f2-4e80-b305-db2aeabfca27 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:33.710626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 447/917] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 18 10:20:33 2022] POST /identity/v3/services => generated 241 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:20:33.825094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e0241-39f2-4e80-b305-db2aeabfca27 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:33.875508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455b650-a864-412d-84af-455b6be295f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:33.876217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455b650-a864-412d-84af-455b6be295f7 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:33.876510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455b650-a864-412d-84af-455b6be295f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:33.876787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455b650-a864-412d-84af-455b6be295f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:33.877525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455b650-a864-412d-84af-455b6be295f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:33.877856 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455b650-a864-412d-84af-455b6be295f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:33.879276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455b650-a864-412d-84af-455b6be295f7 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:33.894145 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 471/918] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:33.899928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9bc24-cac1-4c90-a443-9f0027e8723f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:33.930716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0b418-2ebe-40b1-b81e-aa7edf6b355d None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:33.931063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0b418-2ebe-40b1-b81e-aa7edf6b355d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:33.931276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0b418-2ebe-40b1-b81e-aa7edf6b355d None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:33.932964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 472/919] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:33.939348 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f577dfd-ae80-43db-930a-a26b13a34f0a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:33.939348 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f577dfd-ae80-43db-930a-a26b13a34f0a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:33.939348 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f577dfd-ae80-43db-930a-a26b13a34f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:33.960429 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0f577dfd-ae80-43db-930a-a26b13a34f0a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:33.961927 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0f577dfd-ae80-43db-930a-a26b13a34f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:33.986088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:34.028777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9bc24-cac1-4c90-a443-9f0027e8723f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:34.038371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 473/920] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:20:34.068223 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f577dfd-ae80-43db-930a-a26b13a34f0a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:34.071972 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd04ef-f33a-4776-ad3b-2ce7f0af7faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:34.073091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd04ef-f33a-4776-ad3b-2ce7f0af7faf None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:34.073733 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd04ef-f33a-4776-ad3b-2ce7f0af7faf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:34.074813 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd04ef-f33a-4776-ad3b-2ce7f0af7faf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:34.084027 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd04ef-f33a-4776-ad3b-2ce7f0af7faf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:34.085812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd04ef-f33a-4776-ad3b-2ce7f0af7faf None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-50dd04ef-f33a-4776-ad3b-2ce7f0af7faf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:34.102805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:34.103895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:34.104851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:34.104851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:34.104851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:34.104851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:34.104851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:34.104851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:34.104851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:34.104851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:34.104851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:20:34.104851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:34.112471 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 448/921] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 18 10:20:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:34.113750 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd04ef-f33a-4776-ad3b-2ce7f0af7faf None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:34.178700 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:34.179048 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f577dfd-ae80-43db-930a-a26b13a34f0a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:34.218762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161d818-6b9f-4a73-a9ed-fb698543cf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:34.219610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161d818-6b9f-4a73-a9ed-fb698543cf7e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:34.219893 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161d818-6b9f-4a73-a9ed-fb698543cf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:34.220167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161d818-6b9f-4a73-a9ed-fb698543cf7e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:34.220827 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161d818-6b9f-4a73-a9ed-fb698543cf7e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:34.222462 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161d818-6b9f-4a73-a9ed-fb698543cf7e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:34.228341 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd04ef-f33a-4776-ad3b-2ce7f0af7faf None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e161d818-6b9f-4a73-a9ed-fb698543cf7e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:34.235138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:34.236227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:34.237110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:34.237110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:34.237110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:34.237110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:34.237110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:34.237110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:34.237110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:34.237110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:34.237110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:34.237110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:34.237110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:34.237110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:34.237110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:20:34.237110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:34.241346 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 474/922] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:20:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:34.242501 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161d818-6b9f-4a73-a9ed-fb698543cf7e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:34.270225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcbd74-6a8f-4034-9103-3054cd8036b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:34.270833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:34.271403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcbd74-6a8f-4034-9103-3054cd8036b6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:34.271860 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcbd74-6a8f-4034-9103-3054cd8036b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:34.272300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcbd74-6a8f-4034-9103-3054cd8036b6 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:34.273572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcbd74-6a8f-4034-9103-3054cd8036b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:34.274053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcbd74-6a8f-4034-9103-3054cd8036b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:34.275731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcbd74-6a8f-4034-9103-3054cd8036b6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:34.301533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 449/923] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 18 10:20:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:34.301533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bfbcc-68ce-4d13-bf43-79c1af30af03 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:34.301533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bfbcc-68ce-4d13-bf43-79c1af30af03 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:34.301533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bfbcc-68ce-4d13-bf43-79c1af30af03 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:34.301533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 450/924] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:34.306405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bfbcc-68ce-4d13-bf43-79c1af30af03 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:34.356029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161d818-6b9f-4a73-a9ed-fb698543cf7e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:34.394548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01e950-206e-477c-930d-4fbeee695420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:34.395219 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01e950-206e-477c-930d-4fbeee695420 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:34.395505 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01e950-206e-477c-930d-4fbeee695420 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:34.396147 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01e950-206e-477c-930d-4fbeee695420 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:34.396864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01e950-206e-477c-930d-4fbeee695420 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:34.397497 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01e950-206e-477c-930d-4fbeee695420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:34.398922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01e950-206e-477c-930d-4fbeee695420 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:34.404245 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 475/925] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:20:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:34.405548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378261f6-7f71-4adb-b034-aa595ec8b07a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:34.405839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378261f6-7f71-4adb-b034-aa595ec8b07a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:34.406168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378261f6-7f71-4adb-b034-aa595ec8b07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:34.424906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-378261f6-7f71-4adb-b034-aa595ec8b07a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:34.426105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-378261f6-7f71-4adb-b034-aa595ec8b07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:34.428430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bfbcc-68ce-4d13-bf43-79c1af30af03 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:34.446975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:34.465271 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801dc37-9e46-4912-9e62-ad52fe9538d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:34.466108 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801dc37-9e46-4912-9e62-ad52fe9538d6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:34.466417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801dc37-9e46-4912-9e62-ad52fe9538d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:34.466685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801dc37-9e46-4912-9e62-ad52fe9538d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:34.479081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801dc37-9e46-4912-9e62-ad52fe9538d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:34.480605 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801dc37-9e46-4912-9e62-ad52fe9538d6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:34.504148 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 476/926] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:34.505094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-7801dc37-9e46-4912-9e62-ad52fe9538d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:34.505094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:34.505094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:34.505094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:34.505094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:34.505094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:34.505094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:34.505094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:34.505094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:34.505094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:34.505094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:34.505094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:34.505094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:34.505094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:34.505094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:34.506120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:34.507302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:34.507302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:34.507302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:34.507302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:34.507302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 451/927] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:34.508201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378261f6-7f71-4adb-b034-aa595ec8b07a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:34.517259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801dc37-9e46-4912-9e62-ad52fe9538d6 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:34.526130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:34.615932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378261f6-7f71-4adb-b034-aa595ec8b07a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:34.623323 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801dc37-9e46-4912-9e62-ad52fe9538d6 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:34.653948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2acec-f292-47c7-b237-bb156527bd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:34.654639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2acec-f292-47c7-b237-bb156527bd24 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:34.654922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2acec-f292-47c7-b237-bb156527bd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:34.655193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2acec-f292-47c7-b237-bb156527bd24 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:34.656009 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2acec-f292-47c7-b237-bb156527bd24 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:34.656436 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2acec-f292-47c7-b237-bb156527bd24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:34.657807 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2acec-f292-47c7-b237-bb156527bd24 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:34.661324 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e76a6e-7276-4a36-8c32-137ee795c2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:34.661984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e76a6e-7276-4a36-8c32-137ee795c2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:34.662266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e76a6e-7276-4a36-8c32-137ee795c2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:34.662580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e76a6e-7276-4a36-8c32-137ee795c2d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:34.668388 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 477/928] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 18 10:20:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:34.668552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e76a6e-7276-4a36-8c32-137ee795c2d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:34.668552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e76a6e-7276-4a36-8c32-137ee795c2d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:34.668849 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2acec-f292-47c7-b237-bb156527bd24 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:34.669015 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e76a6e-7276-4a36-8c32-137ee795c2d4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:34.680050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 452/929] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:34.680675 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e76a6e-7276-4a36-8c32-137ee795c2d4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:34.715319 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:34.760260 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:34.782394 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2acec-f292-47c7-b237-bb156527bd24 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:34.796223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e76a6e-7276-4a36-8c32-137ee795c2d4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:34.820329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0d5ec-9358-4ad9-82e4-9d51389e607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:34.821081 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0d5ec-9358-4ad9-82e4-9d51389e607e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:34.821368 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0d5ec-9358-4ad9-82e4-9d51389e607e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:34.821642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0d5ec-9358-4ad9-82e4-9d51389e607e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:34.822294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0d5ec-9358-4ad9-82e4-9d51389e607e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:34.823705 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0d5ec-9358-4ad9-82e4-9d51389e607e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:34.833571 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd83d8-5904-46b9-8fd7-9f6a23fb456d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:34.834227 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd83d8-5904-46b9-8fd7-9f6a23fb456d None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:34.834545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd83d8-5904-46b9-8fd7-9f6a23fb456d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:34.834823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd83d8-5904-46b9-8fd7-9f6a23fb456d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:34.835560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd83d8-5904-46b9-8fd7-9f6a23fb456d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-06e0d5ec-9358-4ad9-82e4-9d51389e607e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:34.836437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:34.837330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:34.844019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:34.844019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:34.844019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:34.844019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:34.844019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:34.844019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:34.844019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:34.844019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:34.844019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:34.844019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:34.844019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:34.844019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:34.844019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:34.844019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:20:34.844019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:34.844843 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd83d8-5904-46b9-8fd7-9f6a23fb456d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:34.844918 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 478/930] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Jul 18 10:20:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:34.844918 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0d5ec-9358-4ad9-82e4-9d51389e607e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:34.920787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 453/931] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 18 10:20:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:20:34.922098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd83d8-5904-46b9-8fd7-9f6a23fb456d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:34.967609 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0d5ec-9358-4ad9-82e4-9d51389e607e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:35.017732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95c175-b4ac-4575-9fcf-c5d76e848940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:35.018621 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c175-b4ac-4575-9fcf-c5d76e848940 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:35.018902 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c175-b4ac-4575-9fcf-c5d76e848940 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:35.019186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c175-b4ac-4575-9fcf-c5d76e848940 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:35.028278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95c175-b4ac-4575-9fcf-c5d76e848940 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:35.029903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95c175-b4ac-4575-9fcf-c5d76e848940 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:35.032364 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:35.048294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-ff95c175-b4ac-4575-9fcf-c5d76e848940 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:35.048294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:35.048294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:35.048294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:35.048294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:35.048294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:35.048294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:35.048294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:35.048294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:35.048294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:35.048294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:35.048294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:35.048294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:35.048294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:35.048294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:35.049706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:35.050657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:35.050657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:35.050657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:35.050657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:35.050657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:35.050657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:35.050657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:35.050657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:35.054575 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 479/932] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:35.055855 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:35.056833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95c175-b4ac-4575-9fcf-c5d76e848940 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:35.079458 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd83d8-5904-46b9-8fd7-9f6a23fb456d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:35.130192 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fdaf1-8cbc-4e5c-9d25-e8453922a990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:35.131148 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fdaf1-8cbc-4e5c-9d25-e8453922a990 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:35.131444 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fdaf1-8cbc-4e5c-9d25-e8453922a990 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:35.131753 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fdaf1-8cbc-4e5c-9d25-e8453922a990 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:35.133382 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fdaf1-8cbc-4e5c-9d25-e8453922a990 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:35.133712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fdaf1-8cbc-4e5c-9d25-e8453922a990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:35.136586 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fdaf1-8cbc-4e5c-9d25-e8453922a990 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:35.143727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 454/933] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 18 10:20:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:35.149292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fdaf1-8cbc-4e5c-9d25-e8453922a990 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:35.179822 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95c175-b4ac-4575-9fcf-c5d76e848940 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:35.224166 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e4554-b42c-476c-9082-fe2c7e619fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:35.224870 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e4554-b42c-476c-9082-fe2c7e619fad None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:35.225157 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e4554-b42c-476c-9082-fe2c7e619fad None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:35.225437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e4554-b42c-476c-9082-fe2c7e619fad None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:35.226512 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e4554-b42c-476c-9082-fe2c7e619fad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:35.226832 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e4554-b42c-476c-9082-fe2c7e619fad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:35.229051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e4554-b42c-476c-9082-fe2c7e619fad None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:35.250470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 480/934] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:35.253295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e4554-b42c-476c-9082-fe2c7e619fad None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:35.281294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fdaf1-8cbc-4e5c-9d25-e8453922a990 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:35.321593 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31db2c5-6580-4baf-a704-068f16f14b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:35.322706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31db2c5-6580-4baf-a704-068f16f14b79 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:35.323231 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31db2c5-6580-4baf-a704-068f16f14b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:35.323723 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31db2c5-6580-4baf-a704-068f16f14b79 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:35.325456 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31db2c5-6580-4baf-a704-068f16f14b79 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:35.326009 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31db2c5-6580-4baf-a704-068f16f14b79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:35.327722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31db2c5-6580-4baf-a704-068f16f14b79 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:35.338537 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 455/935] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 18 10:20:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:35.338945 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:35.340689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31db2c5-6580-4baf-a704-068f16f14b79 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:35.358712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:35.391977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e4554-b42c-476c-9082-fe2c7e619fad None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:35.437511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2416d-a0d6-4a70-b979-6e9602e9f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:35.438521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2416d-a0d6-4a70-b979-6e9602e9f077 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:35.438922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2416d-a0d6-4a70-b979-6e9602e9f077 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:35.439210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2416d-a0d6-4a70-b979-6e9602e9f077 None admin] PATH_INFO: `/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/8c34067d12a34f8ab2061460e86ef135/roles/bcef1c0f49bf4bd5a5946b34ab8ba902` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:35.442093 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2416d-a0d6-4a70-b979-6e9602e9f077 None admin] RBAC: Authorizing `identity:create_grant(project_id=40e0b5ee15df481cbc01333131f3def0, user_id=8c34067d12a34f8ab2061460e86ef135, role_id=bcef1c0f49bf4bd5a5946b34ab8ba902)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:35.443615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2416d-a0d6-4a70-b979-6e9602e9f077 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:35.459375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31db2c5-6580-4baf-a704-068f16f14b79 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:35.499464 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912c8f6-d119-4695-b3f8-196f5a8c29af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:35.500132 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912c8f6-d119-4695-b3f8-196f5a8c29af None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:35.500427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912c8f6-d119-4695-b3f8-196f5a8c29af None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:35.500695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912c8f6-d119-4695-b3f8-196f5a8c29af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:35.501438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912c8f6-d119-4695-b3f8-196f5a8c29af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:35.502889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912c8f6-d119-4695-b3f8-196f5a8c29af None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:35.522093 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 481/936] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:20:35 2022] PUT /identity/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/8c34067d12a34f8ab2061460e86ef135/roles/bcef1c0f49bf4bd5a5946b34ab8ba902 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:20:35.591926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 456/937] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 18 10:20:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:20:35.844015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d40ff-28a6-402d-838c-7cdc92ae1c1e None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:35.844437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d40ff-28a6-402d-838c-7cdc92ae1c1e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:35.844616 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d40ff-28a6-402d-838c-7cdc92ae1c1e None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:35.846198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 482/938] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:35.851629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ee35d-e973-4e0c-9882-e564db67cc2e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:35.851922 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ee35d-e973-4e0c-9882-e564db67cc2e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:35.852202 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ee35d-e973-4e0c-9882-e564db67cc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:35.870062 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-616ee35d-e973-4e0c-9882-e564db67cc2e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:35.871639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-616ee35d-e973-4e0c-9882-e564db67cc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:35.936544 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:35.947677 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 457/939] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:20:35.971709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d40ff-28a6-402d-838c-7cdc92ae1c1e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:36.089310 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d40ff-28a6-402d-838c-7cdc92ae1c1e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:36.109754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:36.129788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d20b30-c565-422e-81ac-b67ab21b8713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:36.130640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d20b30-c565-422e-81ac-b67ab21b8713 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:36.130923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d20b30-c565-422e-81ac-b67ab21b8713 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:36.131202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d20b30-c565-422e-81ac-b67ab21b8713 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:36.131913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d20b30-c565-422e-81ac-b67ab21b8713 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:36.133588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d20b30-c565-422e-81ac-b67ab21b8713 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-94d20b30-c565-422e-81ac-b67ab21b8713 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:36.148352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:36.150228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:36.151167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:36.151167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:36.151167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:36.151167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:36.151167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:36.151167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:36.151167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:36.151167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:36.151167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:36.151167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:36.151167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:36.151167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:36.151167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:20:36.151167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:36.151167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 483/940] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 18 10:20:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:36.156504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ee35d-e973-4e0c-9882-e564db67cc2e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:36.268130 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ee35d-e973-4e0c-9882-e564db67cc2e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:36.305397 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af0d9e-1d45-4e22-a188-cca73d1b6655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:36.306069 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af0d9e-1d45-4e22-a188-cca73d1b6655 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:36.306374 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af0d9e-1d45-4e22-a188-cca73d1b6655 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:36.306654 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af0d9e-1d45-4e22-a188-cca73d1b6655 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:36.307367 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af0d9e-1d45-4e22-a188-cca73d1b6655 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:36.307672 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af0d9e-1d45-4e22-a188-cca73d1b6655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:36.309931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af0d9e-1d45-4e22-a188-cca73d1b6655 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:36.315576 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 458/941] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 18 10:20:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:36.323447 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d20b30-c565-422e-81ac-b67ab21b8713 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:36.431161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d20b30-c565-422e-81ac-b67ab21b8713 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:36.467669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18257ba-680a-4221-8e81-1295fa6ee68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:36.468331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18257ba-680a-4221-8e81-1295fa6ee68c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:36.468676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18257ba-680a-4221-8e81-1295fa6ee68c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:36.468953 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18257ba-680a-4221-8e81-1295fa6ee68c None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:36.469707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18257ba-680a-4221-8e81-1295fa6ee68c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:36.470019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18257ba-680a-4221-8e81-1295fa6ee68c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:36.471422 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18257ba-680a-4221-8e81-1295fa6ee68c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:36.477018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 484/942] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 18 10:20:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:36.483688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af0d9e-1d45-4e22-a188-cca73d1b6655 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:36.546484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:36.591140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af0d9e-1d45-4e22-a188-cca73d1b6655 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:36.629858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c4bf8-86f8-4132-b1e1-6806ce0d071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:36.630551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c4bf8-86f8-4132-b1e1-6806ce0d071d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:36.630839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c4bf8-86f8-4132-b1e1-6806ce0d071d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:36.631120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c4bf8-86f8-4132-b1e1-6806ce0d071d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:36.631914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c4bf8-86f8-4132-b1e1-6806ce0d071d None admin] RBAC: Adding query filter params (interface=public, service_id=20ad60ec0f9e45fcb854e94f7ba8e859, region_id=RegionOne) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:36.632224 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c4bf8-86f8-4132-b1e1-6806ce0d071d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:36.633867 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c4bf8-86f8-4132-b1e1-6806ce0d071d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:36.640653 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 459/943] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 18 10:20:36 2022] GET /identity/v3/endpoints?service_id=20ad60ec0f9e45fcb854e94f7ba8e859&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:36.646041 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18257ba-680a-4221-8e81-1295fa6ee68c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:36.697239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:36.759596 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18257ba-680a-4221-8e81-1295fa6ee68c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:36.797204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72151561-e2ec-4833-a2df-454117be0fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:36.797869 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72151561-e2ec-4833-a2df-454117be0fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:36.798148 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72151561-e2ec-4833-a2df-454117be0fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:36.798455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72151561-e2ec-4833-a2df-454117be0fc3 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:36.799201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72151561-e2ec-4833-a2df-454117be0fc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:36.800583 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72151561-e2ec-4833-a2df-454117be0fc3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:36.807411 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 485/944] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 18 10:20:36 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:20:37.159036 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a30c0-56ab-4dc4-9b83-64fe6be4c9bc None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:37.159036 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a30c0-56ab-4dc4-9b83-64fe6be4c9bc None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:37.159036 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a30c0-56ab-4dc4-9b83-64fe6be4c9bc None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:37.160320 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 460/945] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:37.168099 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe8ecf-e18b-42fe-bc9a-6f980ccc6d03 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:37.168099 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe8ecf-e18b-42fe-bc9a-6f980ccc6d03 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:37.168099 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe8ecf-e18b-42fe-bc9a-6f980ccc6d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:37.185119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-01fe8ecf-e18b-42fe-bc9a-6f980ccc6d03 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:37.186732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-01fe8ecf-e18b-42fe-bc9a-6f980ccc6d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:37.265471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 486/946] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:37.290582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a30c0-56ab-4dc4-9b83-64fe6be4c9bc None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:37.405364 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a30c0-56ab-4dc4-9b83-64fe6be4c9bc None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:37.430050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:37.442418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7301a15-7521-4ed3-94a0-68a9f8e39323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:37.443123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7301a15-7521-4ed3-94a0-68a9f8e39323 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:37.443404 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7301a15-7521-4ed3-94a0-68a9f8e39323 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:37.443679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7301a15-7521-4ed3-94a0-68a9f8e39323 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:37.444440 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7301a15-7521-4ed3-94a0-68a9f8e39323 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:37.445925 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7301a15-7521-4ed3-94a0-68a9f8e39323 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:37.447346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: WARNING keystone.server.flask.common [None req-f7301a15-7521-4ed3-94a0-68a9f8e39323 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 18 10:20:37.486845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.sql.core [None req-f7301a15-7521-4ed3-94a0-68a9f8e39323 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 10:20:37.486845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 10:20:37.486845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [parameters: {'id': '0ea52faf6bc64589b0bd3eccf5061c30', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 10:20:37.486845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80336) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 10:20:37.495199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-f7301a15-7521-4ed3-94a0-68a9f8e39323 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0ea52faf6bc64589b0bd3eccf5061c30.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0ea52faf6bc64589b0bd3eccf5061c30. Jul 18 10:20:37.495199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:37.495199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 10:20:37.495199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 10:20:37.495199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 10:20:37.495199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 10:20:37.495199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 10:20:37.495199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 10:20:37.495199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 10:20:37.495199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application conn.query(q) Jul 18 10:20:37.495199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 10:20:37.495199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 10:20:37.495199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result.read() Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 18 10:20:37.496577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application next(self.gen) Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application yield resource Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application next(self.gen) Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise self.value Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application session.commit() Jul 18 10:20:37.498120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.session.flush() Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application compat.raise_( Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 10:20:37.499961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 10:20:37.502112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 10:20:37.502112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 10:20:37.502112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 10:20:37.502112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 10:20:37.502112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 10:20:37.502112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 10:20:37.502112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 10:20:37.502112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 10:20:37.502112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 10:20:37.502112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 10:20:37.502112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 10:20:37.502112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 10:20:37.502112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 10:20:37.502112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 10:20:37.502112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application conn.query(q) Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result.read() Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 10:20:37.503679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 10:20:37.504594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 10:20:37.504594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 10:20:37.504594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 10:20:37.504594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 10:20:37.504594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 10:20:37.504594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 10:20:37.504594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 10:20:37.504594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 10:20:37.504594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [parameters: {'id': '0ea52faf6bc64589b0bd3eccf5061c30', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 10:20:37.504594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 10:20:37.504594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:37.504594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:37.504594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:37.504594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:37.504594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:37.505494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:37.506499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:37.506499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 18 10:20:37.506499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 18 10:20:37.506499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:37.506499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:37.506499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 18 10:20:37.506499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 18 10:20:37.506499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0ea52faf6bc64589b0bd3eccf5061c30. Jul 18 10:20:37.506499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:37.506499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 461/947] 10.222.0.16 () {60 vars in 1140 bytes} [Mon Jul 18 10:20:37 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:37.507105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe8ecf-e18b-42fe-bc9a-6f980ccc6d03 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:37.551788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:37.618197 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe8ecf-e18b-42fe-bc9a-6f980ccc6d03 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:37.657777 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f0393-f0b7-4339-a982-f5abca34ee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:37.659021 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0393-f0b7-4339-a982-f5abca34ee9d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:37.659495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0393-f0b7-4339-a982-f5abca34ee9d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:37.659958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0393-f0b7-4339-a982-f5abca34ee9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:37.668059 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f0393-f0b7-4339-a982-f5abca34ee9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:37.669999 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f0393-f0b7-4339-a982-f5abca34ee9d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:37.685726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-0b6f0393-f0b7-4339-a982-f5abca34ee9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:37.685726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:37.685726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:37.685726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:37.685726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:37.685726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:37.685726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:37.685726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:37.685726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:37.685726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:37.685726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:37.685726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:37.685726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:37.685726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:37.685726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:37.686913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:37.688064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:37.688064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:37.688064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:37.688064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:37.688064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:37.688064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:37.688064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:37.688064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:37.690265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 487/948] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:37.696722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7301a15-7521-4ed3-94a0-68a9f8e39323 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:37.697272 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdc9fa-7f93-4c73-a0a9-836776c3142c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:37.697565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdc9fa-7f93-4c73-a0a9-836776c3142c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:37.697847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdc9fa-7f93-4c73-a0a9-836776c3142c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:37.700107 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 488/949] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:37.705219 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0accc-0f2d-4f76-970c-f819724c2f86 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:37.705511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0accc-0f2d-4f76-970c-f819724c2f86 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:37.705795 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0accc-0f2d-4f76-970c-f819724c2f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:37.723678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-07c0accc-0f2d-4f76-970c-f819724c2f86 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:37.724883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-07c0accc-0f2d-4f76-970c-f819724c2f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:37.809993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 489/950] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:20:37.825765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7301a15-7521-4ed3-94a0-68a9f8e39323 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:37.827913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234e9a3-adc0-404a-8f43-1e678bee6e80 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:37.828207 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234e9a3-adc0-404a-8f43-1e678bee6e80 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:37.828483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234e9a3-adc0-404a-8f43-1e678bee6e80 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:37.830426 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 490/951] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:37.835585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234e9a3-adc0-404a-8f43-1e678bee6e80 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:37.867197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391e828-267e-4116-9c60-23b11e942045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:37.868139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391e828-267e-4116-9c60-23b11e942045 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:37.868298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:37.868470 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391e828-267e-4116-9c60-23b11e942045 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:37.868704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391e828-267e-4116-9c60-23b11e942045 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:37.869476 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391e828-267e-4116-9c60-23b11e942045 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:37.869769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391e828-267e-4116-9c60-23b11e942045 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:37.872377 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391e828-267e-4116-9c60-23b11e942045 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:37.901408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 462/952] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 18 10:20:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:37.901408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e963c1-f8cb-4487-9971-f9ed9b79dc01 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:37.901408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e963c1-f8cb-4487-9971-f9ed9b79dc01 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:37.901408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e963c1-f8cb-4487-9971-f9ed9b79dc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:37.915485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-46e963c1-f8cb-4487-9971-f9ed9b79dc01 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:37.917427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-46e963c1-f8cb-4487-9971-f9ed9b79dc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:37.966688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:37.968999 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234e9a3-adc0-404a-8f43-1e678bee6e80 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:38.019386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 463/953] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:38.028023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aaeb6-cf31-43e6-a0f6-cc41a525d42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:38.029493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aaeb6-cf31-43e6-a0f6-cc41a525d42a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:38.030001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aaeb6-cf31-43e6-a0f6-cc41a525d42a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:38.030550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aaeb6-cf31-43e6-a0f6-cc41a525d42a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:38.042393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e963c1-f8cb-4487-9971-f9ed9b79dc01 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:38.044143 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aaeb6-cf31-43e6-a0f6-cc41a525d42a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-cd8aaeb6-cf31-43e6-a0f6-cc41a525d42a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:38.054421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:38.055555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:38.056544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:38.056544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:38.056544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:38.056544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:38.056544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:38.056544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:38.056544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:38.056544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:38.056544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:38.056544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:38.056544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:20:38.056544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:38.061556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 491/954] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 18 10:20:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:38.062859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aaeb6-cf31-43e6-a0f6-cc41a525d42a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:38.175194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e963c1-f8cb-4487-9971-f9ed9b79dc01 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:38.203896 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:38.218993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aaeb6-cf31-43e6-a0f6-cc41a525d42a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:38.223599 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5c2aa-8ff5-4f0c-a1ba-842dff5b6b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:38.224404 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5c2aa-8ff5-4f0c-a1ba-842dff5b6b11 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:38.224682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5c2aa-8ff5-4f0c-a1ba-842dff5b6b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:38.224956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5c2aa-8ff5-4f0c-a1ba-842dff5b6b11 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:38.225609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5c2aa-8ff5-4f0c-a1ba-842dff5b6b11 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:38.227075 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5c2aa-8ff5-4f0c-a1ba-842dff5b6b11 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-95f5c2aa-8ff5-4f0c-a1ba-842dff5b6b11 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:38.243478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:38.244682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:38.246536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:38.246536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:38.246536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:38.246536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:38.246536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:38.246536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:38.246536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:38.246536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:38.246536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:38.246536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:38.246536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:38.246536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:38.246536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:20:38.246536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:38.246536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 464/955] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:38.254195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5c2aa-8ff5-4f0c-a1ba-842dff5b6b11 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:38.273329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c430512-e237-4f48-93c5-3e4a8654f2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:38.274468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c430512-e237-4f48-93c5-3e4a8654f2cd None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:38.274893 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c430512-e237-4f48-93c5-3e4a8654f2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:38.275373 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c430512-e237-4f48-93c5-3e4a8654f2cd None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:38.276346 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c430512-e237-4f48-93c5-3e4a8654f2cd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:38.276757 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c430512-e237-4f48-93c5-3e4a8654f2cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:38.279069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c430512-e237-4f48-93c5-3e4a8654f2cd None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:38.289173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 492/956] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 18 10:20:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:38.294900 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:38.296644 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c430512-e237-4f48-93c5-3e4a8654f2cd None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:38.380100 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5c2aa-8ff5-4f0c-a1ba-842dff5b6b11 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:38.434706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47deec3-11ee-4da7-b039-2878391a29c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:38.435921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47deec3-11ee-4da7-b039-2878391a29c7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:38.436479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47deec3-11ee-4da7-b039-2878391a29c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:38.436815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c430512-e237-4f48-93c5-3e4a8654f2cd None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:38.437206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47deec3-11ee-4da7-b039-2878391a29c7 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:38.438554 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47deec3-11ee-4da7-b039-2878391a29c7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:38.439150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47deec3-11ee-4da7-b039-2878391a29c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:38.441896 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47deec3-11ee-4da7-b039-2878391a29c7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:38.456050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 465/957] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 18 10:20:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:38.456707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47deec3-11ee-4da7-b039-2878391a29c7 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:38.481972 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991e142-20aa-45ea-8a14-4ec99b248f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:38.482684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991e142-20aa-45ea-8a14-4ec99b248f9c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:38.483027 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991e142-20aa-45ea-8a14-4ec99b248f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:38.483432 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991e142-20aa-45ea-8a14-4ec99b248f9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:38.498856 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991e142-20aa-45ea-8a14-4ec99b248f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:38.500511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991e142-20aa-45ea-8a14-4ec99b248f9c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:38.523925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-1991e142-20aa-45ea-8a14-4ec99b248f9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:38.523925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:38.523925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:38.523925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:38.523925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:38.523925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:38.523925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:38.523925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:38.523925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:38.523925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:38.523925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:38.523925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:38.523925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:38.523925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:38.523925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:38.524937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:38.525863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:38.525863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:38.525863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:38.525863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:38.531408 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 493/958] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:38.532874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991e142-20aa-45ea-8a14-4ec99b248f9c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:38.537900 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:38.602749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:38.612723 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47deec3-11ee-4da7-b039-2878391a29c7 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:38.661334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991e142-20aa-45ea-8a14-4ec99b248f9c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:38.661653 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513a61a-7e17-48d2-815c-0c714e9e92cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:38.662685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513a61a-7e17-48d2-815c-0c714e9e92cd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:38.663440 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513a61a-7e17-48d2-815c-0c714e9e92cd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:38.663933 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513a61a-7e17-48d2-815c-0c714e9e92cd None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:38.665840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513a61a-7e17-48d2-815c-0c714e9e92cd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:38.666426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513a61a-7e17-48d2-815c-0c714e9e92cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:38.668922 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513a61a-7e17-48d2-815c-0c714e9e92cd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:38.682587 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 466/959] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 18 10:20:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:38.713586 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7304ad3-5691-494c-b1c3-07f2b8d3ae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:38.714387 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7304ad3-5691-494c-b1c3-07f2b8d3ae6c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:38.714722 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7304ad3-5691-494c-b1c3-07f2b8d3ae6c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:38.715188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7304ad3-5691-494c-b1c3-07f2b8d3ae6c None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:38.715986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7304ad3-5691-494c-b1c3-07f2b8d3ae6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:38.716301 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7304ad3-5691-494c-b1c3-07f2b8d3ae6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:38.717886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7304ad3-5691-494c-b1c3-07f2b8d3ae6c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:38.738490 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 494/960] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:38.740659 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513a61a-7e17-48d2-815c-0c714e9e92cd None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:38.863785 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513a61a-7e17-48d2-815c-0c714e9e92cd None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:38.911753 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee49397-7211-41d3-8a20-952e56212a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:38.912994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee49397-7211-41d3-8a20-952e56212a4b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:38.913482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee49397-7211-41d3-8a20-952e56212a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:38.913992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee49397-7211-41d3-8a20-952e56212a4b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:38.923025 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee49397-7211-41d3-8a20-952e56212a4b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:38.924837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee49397-7211-41d3-8a20-952e56212a4b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-eee49397-7211-41d3-8a20-952e56212a4b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:38.942738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:38.943895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:38.944908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:38.944908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:38.944908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:38.944908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:38.944908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:38.944908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:38.944908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:38.944908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:38.944908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:20:38.944908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:38.947751 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 467/961] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 18 10:20:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:38.954095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7304ad3-5691-494c-b1c3-07f2b8d3ae6c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:39.006656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8e6b2-f379-48fc-8693-de26853dc6a9 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:39.007037 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8e6b2-f379-48fc-8693-de26853dc6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:39.007281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8e6b2-f379-48fc-8693-de26853dc6a9 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:39.010168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 468/962] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:39.016732 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857c621-bdfb-4c3e-b84b-83fbd003b335 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:39.017061 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857c621-bdfb-4c3e-b84b-83fbd003b335 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:39.017479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857c621-bdfb-4c3e-b84b-83fbd003b335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:39.032962 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:39.039971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-5857c621-bdfb-4c3e-b84b-83fbd003b335 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:39.044539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5857c621-bdfb-4c3e-b84b-83fbd003b335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:39.062772 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:39.090862 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7304ad3-5691-494c-b1c3-07f2b8d3ae6c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:39.134765 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d3c9c-da10-4bbb-a4d6-6a9571e03977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:39.135975 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d3c9c-da10-4bbb-a4d6-6a9571e03977 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:39.137174 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d3c9c-da10-4bbb-a4d6-6a9571e03977 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:39.137738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d3c9c-da10-4bbb-a4d6-6a9571e03977 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:39.138977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d3c9c-da10-4bbb-a4d6-6a9571e03977 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:39.139591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d3c9c-da10-4bbb-a4d6-6a9571e03977 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:39.141681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d3c9c-da10-4bbb-a4d6-6a9571e03977 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:39.142663 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 469/963] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:20:39.165643 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 495/964] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 18 10:20:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:39.165961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857c621-bdfb-4c3e-b84b-83fbd003b335 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:39.171559 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d3c9c-da10-4bbb-a4d6-6a9571e03977 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:39.294083 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857c621-bdfb-4c3e-b84b-83fbd003b335 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:39.304065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d3c9c-da10-4bbb-a4d6-6a9571e03977 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:39.335657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:39.339911 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8935900-96d4-4254-806f-a49613703f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:39.341499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8935900-96d4-4254-806f-a49613703f37 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:39.342053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8935900-96d4-4254-806f-a49613703f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:39.342644 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8935900-96d4-4254-806f-a49613703f37 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:39.343564 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8935900-96d4-4254-806f-a49613703f37 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:39.345361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8935900-96d4-4254-806f-a49613703f37 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:39.348576 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eeb9b2-4b46-4bc9-baa9-8f0ca7efd149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:39.349711 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eeb9b2-4b46-4bc9-baa9-8f0ca7efd149 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:39.350076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eeb9b2-4b46-4bc9-baa9-8f0ca7efd149 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:39.350460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eeb9b2-4b46-4bc9-baa9-8f0ca7efd149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-e8935900-96d4-4254-806f-a49613703f37 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:39.362007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:39.363290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:39.364375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:39.364375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:39.364375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:39.364375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:39.364375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:39.364375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:39.364375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:39.364375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:39.364375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:39.364375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:39.364375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:39.364375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:39.364375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:20:39.364375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:39.369035 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 470/965] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 18 10:20:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:39.375677 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8935900-96d4-4254-806f-a49613703f37 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:39.442703 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eeb9b2-4b46-4bc9-baa9-8f0ca7efd149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:39.444145 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eeb9b2-4b46-4bc9-baa9-8f0ca7efd149 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:39.446690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:39.518488 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8935900-96d4-4254-806f-a49613703f37 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:39.563832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9352d-5e74-485d-bc27-2292e40ddac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:39.564513 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9352d-5e74-485d-bc27-2292e40ddac6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:39.564815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9352d-5e74-485d-bc27-2292e40ddac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:39.565126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9352d-5e74-485d-bc27-2292e40ddac6 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:39.566511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9352d-5e74-485d-bc27-2292e40ddac6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:39.566829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9352d-5e74-485d-bc27-2292e40ddac6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:39.568405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9352d-5e74-485d-bc27-2292e40ddac6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:39.574832 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 496/966] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:20:39 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:20:39.582368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 471/967] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 18 10:20:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:39.583401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eeb9b2-4b46-4bc9-baa9-8f0ca7efd149 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:39.583707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9352d-5e74-485d-bc27-2292e40ddac6 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:39.610440 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:39.695655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:39.719378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9352d-5e74-485d-bc27-2292e40ddac6 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:39.742945 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eeb9b2-4b46-4bc9-baa9-8f0ca7efd149 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:39.758951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f8a32-9c46-4c9a-a25c-8009f92a21bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:39.759623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f8a32-9c46-4c9a-a25c-8009f92a21bf None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:39.759910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f8a32-9c46-4c9a-a25c-8009f92a21bf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:39.760189 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f8a32-9c46-4c9a-a25c-8009f92a21bf None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:39.760903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f8a32-9c46-4c9a-a25c-8009f92a21bf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:39.761267 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f8a32-9c46-4c9a-a25c-8009f92a21bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:39.763199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f8a32-9c46-4c9a-a25c-8009f92a21bf None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:39.774356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 472/968] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 18 10:20:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:39.779825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f8a32-9c46-4c9a-a25c-8009f92a21bf None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:39.808071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab3d93-44c9-42a9-902a-b156c4e53cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:39.809085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab3d93-44c9-42a9-902a-b156c4e53cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:39.809370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab3d93-44c9-42a9-902a-b156c4e53cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:39.809648 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab3d93-44c9-42a9-902a-b156c4e53cd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:39.826170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab3d93-44c9-42a9-902a-b156c4e53cd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:39.829624 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab3d93-44c9-42a9-902a-b156c4e53cd9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:39.868254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-a0ab3d93-44c9-42a9-902a-b156c4e53cd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:39.868254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:39.868254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:39.868254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:39.868254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:39.868254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:39.868254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:39.868254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:39.868254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:39.868254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:39.868254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:39.868254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:39.868254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:39.868254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:39.868254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:39.870046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:39.872140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:39.872140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:39.872140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:39.872140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:39.876092 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 497/969] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:39.883631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab3d93-44c9-42a9-902a-b156c4e53cd9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:39.965823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f8a32-9c46-4c9a-a25c-8009f92a21bf None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:40.002090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:40.010105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd377c6c-e9d3-4362-9e36-b39dbc87a6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:40.010944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd377c6c-e9d3-4362-9e36-b39dbc87a6c0 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:40.011920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd377c6c-e9d3-4362-9e36-b39dbc87a6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:40.012169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd377c6c-e9d3-4362-9e36-b39dbc87a6c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:40.013114 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd377c6c-e9d3-4362-9e36-b39dbc87a6c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:40.014836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd377c6c-e9d3-4362-9e36-b39dbc87a6c0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:40.039765 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab3d93-44c9-42a9-902a-b156c4e53cd9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:40.065025 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:40.081405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 473/970] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 18 10:20:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:20:40.095697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fb742-0560-44f9-9485-a74b3e5ecb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:40.096501 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fb742-0560-44f9-9485-a74b3e5ecb63 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:40.096858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fb742-0560-44f9-9485-a74b3e5ecb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:40.097347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fb742-0560-44f9-9485-a74b3e5ecb63 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:40.098268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fb742-0560-44f9-9485-a74b3e5ecb63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:40.098674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fb742-0560-44f9-9485-a74b3e5ecb63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:40.100397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fb742-0560-44f9-9485-a74b3e5ecb63 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:40.124677 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 498/971] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:40.126267 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd377c6c-e9d3-4362-9e36-b39dbc87a6c0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:40.244798 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeafb00-20b4-4376-b622-4397133a828b None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:40.245146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeafb00-20b4-4376-b622-4397133a828b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:40.245376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeafb00-20b4-4376-b622-4397133a828b None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:40.247722 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 499/972] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:40.253585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981f78d-2c9f-4d02-a9a6-0cc179c360a2 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:40.253916 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981f78d-2c9f-4d02-a9a6-0cc179c360a2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:40.254164 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981f78d-2c9f-4d02-a9a6-0cc179c360a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:40.266836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd377c6c-e9d3-4362-9e36-b39dbc87a6c0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:40.276775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b981f78d-2c9f-4d02-a9a6-0cc179c360a2 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:40.278703 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b981f78d-2c9f-4d02-a9a6-0cc179c360a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:40.316154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd85ac-c6f3-4b6f-b625-3821933a1d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:40.317024 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd85ac-c6f3-4b6f-b625-3821933a1d93 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:40.317309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd85ac-c6f3-4b6f-b625-3821933a1d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:40.317585 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd85ac-c6f3-4b6f-b625-3821933a1d93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:40.328498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd85ac-c6f3-4b6f-b625-3821933a1d93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:40.328498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd85ac-c6f3-4b6f-b625-3821933a1d93 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:40.345711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-a0dd85ac-c6f3-4b6f-b625-3821933a1d93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:40.345711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:40.345711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:40.345711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:40.345711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:40.345711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:40.345711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:40.345711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:40.345711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:40.345711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:40.345711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:40.345711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:40.345711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:40.345711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:40.345711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:40.346744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:40.347713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:40.347713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:40.347713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:40.347713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:40.347713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:40.347713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:40.347713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:40.347713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:40.347713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 474/973] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:40.354752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd85ac-c6f3-4b6f-b625-3821933a1d93 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:40.386712 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 500/974] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:40.408979 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981f78d-2c9f-4d02-a9a6-0cc179c360a2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:40.438299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:40.488911 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:40.496763 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd85ac-c6f3-4b6f-b625-3821933a1d93 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:40.542027 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38a611-18c5-4483-a218-b1f9218c88c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:40.543138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a611-18c5-4483-a218-b1f9218c88c6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:40.543434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a611-18c5-4483-a218-b1f9218c88c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:40.543764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a611-18c5-4483-a218-b1f9218c88c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:40.544716 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38a611-18c5-4483-a218-b1f9218c88c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:40.545028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38a611-18c5-4483-a218-b1f9218c88c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:40.546557 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38a611-18c5-4483-a218-b1f9218c88c6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:40.553337 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981f78d-2c9f-4d02-a9a6-0cc179c360a2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:40.561093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 475/975] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:40.567562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38a611-18c5-4483-a218-b1f9218c88c6 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:40.603614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df80368-e1f5-446a-a771-8e613f146274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:40.604487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df80368-e1f5-446a-a771-8e613f146274 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:40.604889 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df80368-e1f5-446a-a771-8e613f146274 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:40.605714 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df80368-e1f5-446a-a771-8e613f146274 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:40.606474 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df80368-e1f5-446a-a771-8e613f146274 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:40.609036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df80368-e1f5-446a-a771-8e613f146274 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:40.610832 dv-cinder-849498-1-smb devstack@keystone.service[80335]: WARNING keystone.server.flask.common [None req-2df80368-e1f5-446a-a771-8e613f146274 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 18 10:20:40.660222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.sql.core [None req-2df80368-e1f5-446a-a771-8e613f146274 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 10:20:40.660222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 10:20:40.660222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [parameters: {'user_id': 'b9785f2bda1c4f4ba1a0799680d84b96', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 10:20:40.660222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80335) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 10:20:40.687359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-2df80368-e1f5-446a-a771-8e613f146274 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 10:20:40.687359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:40.687359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 10:20:40.687359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 10:20:40.687359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 10:20:40.687359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 10:20:40.687359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 10:20:40.687359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 10:20:40.687359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 10:20:40.687359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application conn.query(q) Jul 18 10:20:40.687359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 10:20:40.687359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 10:20:40.687359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 10:20:40.687359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application result.read() Jul 18 10:20:40.687359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 10:20:40.688329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application next(self.gen) Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application yield resource Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application next(self.gen) Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise self.value Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application session.commit() Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 10:20:40.689329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.session.flush() Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application compat.raise_( Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 10:20:40.690717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 10:20:40.692391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application conn.query(q) Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application result.read() Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 10:20:40.694362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 10:20:40.696205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 10:20:40.696205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 10:20:40.696205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 10:20:40.696205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 10:20:40.696205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 10:20:40.696205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 10:20:40.696205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b9785f2bda1c4f4ba1a0799680d84b96', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 10:20:40.696205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 10:20:40.696205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:40.696205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:40.696205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:40.696205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:40.696205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:40.696205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:40.696205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 18 10:20:40.697950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 18 10:20:40.701780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 18 10:20:40.701780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 18 10:20:40.701780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 10:20:40.701780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 10:20:40.701780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 10:20:40.701780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:40.701780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 501/976] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jul 18 10:20:40 2022] POST /identity/v3/users => generated 160 bytes in 286 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:40.701780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df80368-e1f5-446a-a771-8e613f146274 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:40.711796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38a611-18c5-4483-a218-b1f9218c88c6 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:40.734656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:40.755679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029e10c-6660-4c34-8578-9f4dc295706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:40.756639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029e10c-6660-4c34-8578-9f4dc295706c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:40.757105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029e10c-6660-4c34-8578-9f4dc295706c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:40.757867 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029e10c-6660-4c34-8578-9f4dc295706c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:40.758957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029e10c-6660-4c34-8578-9f4dc295706c None admin] RBAC: Adding query filter params (role.id=bcef1c0f49bf4bd5a5946b34ab8ba902, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=8c34067d12a34f8ab2061460e86ef135) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:40.759630 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029e10c-6660-4c34-8578-9f4dc295706c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:40.761457 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029e10c-6660-4c34-8578-9f4dc295706c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:40.774614 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 476/977] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:20:40 2022] GET /identity/v3/role_assignments?user.id=8c34067d12a34f8ab2061460e86ef135&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=bcef1c0f49bf4bd5a5946b34ab8ba902 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:40.853188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df80368-e1f5-446a-a771-8e613f146274 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:40.892575 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:40.909182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4269e-1b0f-41e7-91bb-d05ed176859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:40.910175 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4269e-1b0f-41e7-91bb-d05ed176859f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:40.910536 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4269e-1b0f-41e7-91bb-d05ed176859f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:40.910905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4269e-1b0f-41e7-91bb-d05ed176859f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:40.920216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44e012-e546-4e51-9c2a-6675122b0f17 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:40.920523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44e012-e546-4e51-9c2a-6675122b0f17 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:40.920792 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44e012-e546-4e51-9c2a-6675122b0f17 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:40.921984 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4269e-1b0f-41e7-91bb-d05ed176859f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:40.923858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4269e-1b0f-41e7-91bb-d05ed176859f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:40.925568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 477/978] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:40.929262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3ed57-45cc-4a16-9e33-f8bdd3fcbb03 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:40.929262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3ed57-45cc-4a16-9e33-f8bdd3fcbb03 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:40.929503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3ed57-45cc-4a16-9e33-f8bdd3fcbb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-81a4269e-1b0f-41e7-91bb-d05ed176859f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:40.946517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:40.947693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:40.949682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:40.949682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:40.949682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:40.949682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:40.949682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:40.949682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:40.949682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:40.949682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:40.949682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:20:40.949682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:40.951213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 502/979] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:20:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:40.955743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4269e-1b0f-41e7-91bb-d05ed176859f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:40.956268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4ff3ed57-45cc-4a16-9e33-f8bdd3fcbb03 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:40.957515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4ff3ed57-45cc-4a16-9e33-f8bdd3fcbb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:41.054961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 478/980] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:41.087386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3ed57-45cc-4a16-9e33-f8bdd3fcbb03 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:41.093228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4269e-1b0f-41e7-91bb-d05ed176859f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:41.134796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb545204-0e56-49dc-8372-acb601870d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:41.135471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb545204-0e56-49dc-8372-acb601870d3d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:41.135751 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb545204-0e56-49dc-8372-acb601870d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:41.136028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb545204-0e56-49dc-8372-acb601870d3d None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:41.137549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb545204-0e56-49dc-8372-acb601870d3d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:41.137856 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb545204-0e56-49dc-8372-acb601870d3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:41.140232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb545204-0e56-49dc-8372-acb601870d3d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:41.193421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 503/981] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 18 10:20:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:41.217952 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3ed57-45cc-4a16-9e33-f8bdd3fcbb03 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:41.256560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:41.262886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb31d90-ca37-4013-bece-dad0fe153e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:41.263576 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb31d90-ca37-4013-bece-dad0fe153e9b None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:41.263869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb31d90-ca37-4013-bece-dad0fe153e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:41.264157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb31d90-ca37-4013-bece-dad0fe153e9b None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:41.264908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb31d90-ca37-4013-bece-dad0fe153e9b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:41.266352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb31d90-ca37-4013-bece-dad0fe153e9b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:41.358284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 479/982] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 18 10:20:41 2022] POST /identity/v3/services => generated 242 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:20:42.335027 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f5f10-035d-44ce-840d-72648e00990a None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:42.335834 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f5f10-035d-44ce-840d-72648e00990a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:42.336448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f5f10-035d-44ce-840d-72648e00990a None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:42.339223 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 504/983] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:42.347935 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4d5c9-3294-4887-b2b8-87c05fb6c26c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:42.348445 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4d5c9-3294-4887-b2b8-87c05fb6c26c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:42.348951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4d5c9-3294-4887-b2b8-87c05fb6c26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:42.377540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-91c4d5c9-3294-4887-b2b8-87c05fb6c26c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:42.379763 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-91c4d5c9-3294-4887-b2b8-87c05fb6c26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:42.482695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 480/984] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:42.526195 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f5f10-035d-44ce-840d-72648e00990a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:42.578787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:42.642983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f5f10-035d-44ce-840d-72648e00990a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:42.679815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0abf6-ef62-4719-9815-e4af8d959a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:42.680626 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0abf6-ef62-4719-9815-e4af8d959a96 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:42.680911 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0abf6-ef62-4719-9815-e4af8d959a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:42.681187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0abf6-ef62-4719-9815-e4af8d959a96 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:42.681845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0abf6-ef62-4719-9815-e4af8d959a96 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:42.683811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0abf6-ef62-4719-9815-e4af8d959a96 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-dff0abf6-ef62-4719-9815-e4af8d959a96 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:42.696531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:42.697695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:42.699631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:42.699631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:42.699631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:42.699631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:42.699631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:42.699631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:42.699631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:42.699631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:42.699631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:42.699631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:42.699631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:42.699631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:42.699631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:20:42.699631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:42.701212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 505/985] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 18 10:20:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:42.704581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4d5c9-3294-4887-b2b8-87c05fb6c26c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:42.858452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:42.863198 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4d5c9-3294-4887-b2b8-87c05fb6c26c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:42.902282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035ad66-459e-46b1-bce0-55f4ab87dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:42.903101 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035ad66-459e-46b1-bce0-55f4ab87dbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:42.903430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035ad66-459e-46b1-bce0-55f4ab87dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:42.903661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035ad66-459e-46b1-bce0-55f4ab87dbd6 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:42.904425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035ad66-459e-46b1-bce0-55f4ab87dbd6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:42.904865 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035ad66-459e-46b1-bce0-55f4ab87dbd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:42.906250 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035ad66-459e-46b1-bce0-55f4ab87dbd6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:42.912687 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 481/986] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 18 10:20:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:42.918902 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0abf6-ef62-4719-9815-e4af8d959a96 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:43.033369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171825cb-3d4e-4ae7-9840-6c7f8c8f71b7 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:43.033646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171825cb-3d4e-4ae7-9840-6c7f8c8f71b7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:43.033929 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171825cb-3d4e-4ae7-9840-6c7f8c8f71b7 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:43.036045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0abf6-ef62-4719-9815-e4af8d959a96 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:43.036332 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 482/987] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:43.039612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:43.041689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fac681-2276-49ff-87cc-5f76f21af654 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:43.042070 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fac681-2276-49ff-87cc-5f76f21af654 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:43.042994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fac681-2276-49ff-87cc-5f76f21af654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:43.064409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-41fac681-2276-49ff-87cc-5f76f21af654 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:43.065876 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-41fac681-2276-49ff-87cc-5f76f21af654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:43.079789 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc743279-64a6-4675-b289-0636a96cb4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:43.080947 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743279-64a6-4675-b289-0636a96cb4fc None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:43.081515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743279-64a6-4675-b289-0636a96cb4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:43.081761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743279-64a6-4675-b289-0636a96cb4fc None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:43.082563 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc743279-64a6-4675-b289-0636a96cb4fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:43.082919 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc743279-64a6-4675-b289-0636a96cb4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:43.084450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc743279-64a6-4675-b289-0636a96cb4fc None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:43.095354 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 506/988] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 18 10:20:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:43.096724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc743279-64a6-4675-b289-0636a96cb4fc None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:43.156265 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 483/989] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:43.193007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fac681-2276-49ff-87cc-5f76f21af654 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:43.267755 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc743279-64a6-4675-b289-0636a96cb4fc None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:43.310208 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60551f56-660f-417f-979e-932431570704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:43.310908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60551f56-660f-417f-979e-932431570704 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:43.311233 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60551f56-660f-417f-979e-932431570704 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:43.311471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60551f56-660f-417f-979e-932431570704 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:43.312334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60551f56-660f-417f-979e-932431570704 None admin] RBAC: Adding query filter params (interface=admin, service_id=20ad60ec0f9e45fcb854e94f7ba8e859, region_id=RegionOne) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:43.312708 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60551f56-660f-417f-979e-932431570704 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:43.314018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60551f56-660f-417f-979e-932431570704 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:43.320339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 507/990] 10.222.0.16 () {56 vars in 1249 bytes} [Mon Jul 18 10:20:43 2022] GET /identity/v3/endpoints?service_id=20ad60ec0f9e45fcb854e94f7ba8e859&interface=admin®ion_id=RegionOne => generated 193 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:43.329551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60551f56-660f-417f-979e-932431570704 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:43.334139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:43.344991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fac681-2276-49ff-87cc-5f76f21af654 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:43.370041 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:43.392058 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f5d89-3698-42bb-a173-c669d1ba4edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:43.393043 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f5d89-3698-42bb-a173-c669d1ba4edc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:43.393378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f5d89-3698-42bb-a173-c669d1ba4edc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:43.393723 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f5d89-3698-42bb-a173-c669d1ba4edc None admin] PATH_INFO: `/v3/services/image` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:43.394575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f5d89-3698-42bb-a173-c669d1ba4edc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:43.396283 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f5d89-3698-42bb-a173-c669d1ba4edc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-6e6f5d89-3698-42bb-a173-c669d1ba4edc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:43.411963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:43.413206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:43.414138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:43.414138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:43.414138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:43.414138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:43.414138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:43.414138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:43.414138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:43.414138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:43.414138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:43.414138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:43.414138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:43.414138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:43.414138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:20:43.414138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:43.414138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 484/991] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Jul 18 10:20:43 2022] GET /identity/v3/services/image => generated 86 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:43.420016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f5d89-3698-42bb-a173-c669d1ba4edc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:43.460045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60551f56-660f-417f-979e-932431570704 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:43.510181 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0675f-d00f-49ab-bd24-fb43e53defb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:43.511124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0675f-d00f-49ab-bd24-fb43e53defb1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:43.512122 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0675f-d00f-49ab-bd24-fb43e53defb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:43.512430 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0675f-d00f-49ab-bd24-fb43e53defb1 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:43.513360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0675f-d00f-49ab-bd24-fb43e53defb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:43.514928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0675f-d00f-49ab-bd24-fb43e53defb1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:43.526694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 508/992] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 18 10:20:43 2022] GET /identity/v3/services => generated 1727 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:20:43.547049 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fac84d-57b9-4810-9932-ce350dad42e8 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:43.547411 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fac84d-57b9-4810-9932-ce350dad42e8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:43.547611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fac84d-57b9-4810-9932-ce350dad42e8 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:43.548877 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f5d89-3698-42bb-a173-c669d1ba4edc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:43.549427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 509/993] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:43.556397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4959c5-9394-4e04-8a7f-3adc8a3ef15c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:43.556721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4959c5-9394-4e04-8a7f-3adc8a3ef15c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:43.556959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4959c5-9394-4e04-8a7f-3adc8a3ef15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:43.576026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2f4959c5-9394-4e04-8a7f-3adc8a3ef15c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:43.577690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2f4959c5-9394-4e04-8a7f-3adc8a3ef15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:43.597186 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc95865-082e-42e9-8c9b-f593b1542bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:43.597931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc95865-082e-42e9-8c9b-f593b1542bad None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:43.598354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc95865-082e-42e9-8c9b-f593b1542bad None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:43.598718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc95865-082e-42e9-8c9b-f593b1542bad None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:43.599833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc95865-082e-42e9-8c9b-f593b1542bad None admin] RBAC: Adding query filter params (name=image) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:43.600357 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc95865-082e-42e9-8c9b-f593b1542bad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:43.602258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc95865-082e-42e9-8c9b-f593b1542bad None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:43.609857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 485/994] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:43.615815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc95865-082e-42e9-8c9b-f593b1542bad None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:43.646600 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:43.662634 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 510/995] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:20:43.689583 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4959c5-9394-4e04-8a7f-3adc8a3ef15c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:43.720403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:43.743913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc95865-082e-42e9-8c9b-f593b1542bad None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:43.787269 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea02626-9626-438f-ac5d-a4d5ddff2b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:43.788266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea02626-9626-438f-ac5d-a4d5ddff2b50 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:43.788611 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea02626-9626-438f-ac5d-a4d5ddff2b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:43.788950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea02626-9626-438f-ac5d-a4d5ddff2b50 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:43.789777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea02626-9626-438f-ac5d-a4d5ddff2b50 None admin] RBAC: Adding query filter params (type=image) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:43.790081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea02626-9626-438f-ac5d-a4d5ddff2b50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:43.791708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea02626-9626-438f-ac5d-a4d5ddff2b50 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:43.797316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 486/996] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:43 2022] GET /identity/v3/services?type=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:43.814844 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4959c5-9394-4e04-8a7f-3adc8a3ef15c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:43.859680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d95bd-2f81-4218-ba68-a8e6f1b76aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:43.860689 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d95bd-2f81-4218-ba68-a8e6f1b76aec None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:43.861019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d95bd-2f81-4218-ba68-a8e6f1b76aec None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:43.861304 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d95bd-2f81-4218-ba68-a8e6f1b76aec None admin] PATH_INFO: `/v3/services/compute` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:43.862121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d95bd-2f81-4218-ba68-a8e6f1b76aec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:43.863682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d95bd-2f81-4218-ba68-a8e6f1b76aec None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-df8d95bd-2f81-4218-ba68-a8e6f1b76aec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:43.878738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:43.879828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:43.880750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:43.880750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:43.880750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:43.880750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:43.880750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:43.880750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:43.880750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:43.880750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:43.880750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:43.880750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:43.880750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:43.880750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:43.880750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:20:43.880750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:43.880750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 511/997] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:43.887239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea02626-9626-438f-ac5d-a4d5ddff2b50 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:44.000151 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:44.019166 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea02626-9626-438f-ac5d-a4d5ddff2b50 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:44.062115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee0e98-84f9-4c94-b88c-602822835323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:44.064359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee0e98-84f9-4c94-b88c-602822835323 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:44.064359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee0e98-84f9-4c94-b88c-602822835323 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:44.064359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee0e98-84f9-4c94-b88c-602822835323 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:44.064678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee0e98-84f9-4c94-b88c-602822835323 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:44.064934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee0e98-84f9-4c94-b88c-602822835323 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:44.066612 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee0e98-84f9-4c94-b88c-602822835323 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:44.073030 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 487/998] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 18 10:20:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:44.080217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d95bd-2f81-4218-ba68-a8e6f1b76aec None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:44.184186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:44.194735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d95bd-2f81-4218-ba68-a8e6f1b76aec None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:44.233064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabb672-aa94-4af7-bae1-2ef314a7763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:44.233745 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabb672-aa94-4af7-bae1-2ef314a7763b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:44.234028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabb672-aa94-4af7-bae1-2ef314a7763b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:44.234309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabb672-aa94-4af7-bae1-2ef314a7763b None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:44.235087 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabb672-aa94-4af7-bae1-2ef314a7763b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:44.235394 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabb672-aa94-4af7-bae1-2ef314a7763b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:44.236774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabb672-aa94-4af7-bae1-2ef314a7763b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:44.246576 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 512/999] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 18 10:20:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:44.249058 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee0e98-84f9-4c94-b88c-602822835323 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:44.365376 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee0e98-84f9-4c94-b88c-602822835323 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:44.406574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef667ca5-03dc-4647-99f2-08063f7c70fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:44.408146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef667ca5-03dc-4647-99f2-08063f7c70fa None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:44.408640 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef667ca5-03dc-4647-99f2-08063f7c70fa None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:44.409124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef667ca5-03dc-4647-99f2-08063f7c70fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:44.410140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef667ca5-03dc-4647-99f2-08063f7c70fa None admin] RBAC: Adding query filter params (interface=public, service_id=97326469c838472d9e09f53f1ab62c23, region_id=RegionOne) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:44.410728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef667ca5-03dc-4647-99f2-08063f7c70fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:44.412567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef667ca5-03dc-4647-99f2-08063f7c70fa None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:44.423780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 488/1000] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 18 10:20:44 2022] GET /identity/v3/endpoints?service_id=97326469c838472d9e09f53f1ab62c23&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:44.425100 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabb672-aa94-4af7-bae1-2ef314a7763b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:44.555430 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabb672-aa94-4af7-bae1-2ef314a7763b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:44.597535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb103b-7ae6-46de-b378-7de509d9e4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:44.598400 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb103b-7ae6-46de-b378-7de509d9e4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:44.598824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb103b-7ae6-46de-b378-7de509d9e4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:44.599194 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb103b-7ae6-46de-b378-7de509d9e4f2 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:44.599880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb103b-7ae6-46de-b378-7de509d9e4f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:44.601273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb103b-7ae6-46de-b378-7de509d9e4f2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:44.617007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 513/1001] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 18 10:20:44 2022] GET /identity/v3/services => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:20:45.690275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168ba59-33be-4521-b5b3-e5a3d6dd3c47 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:45.690855 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168ba59-33be-4521-b5b3-e5a3d6dd3c47 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:45.690855 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168ba59-33be-4521-b5b3-e5a3d6dd3c47 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:45.692289 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 489/1002] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:45.698052 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55a676-13de-431d-b82b-a077087309c0 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:45.698522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55a676-13de-431d-b82b-a077087309c0 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:45.698717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55a676-13de-431d-b82b-a077087309c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:45.718898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7d55a676-13de-431d-b82b-a077087309c0 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:45.720078 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7d55a676-13de-431d-b82b-a077087309c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:45.735622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:45.797205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 514/1003] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:45.819647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168ba59-33be-4521-b5b3-e5a3d6dd3c47 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:45.835252 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:45.886941 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aff99-25a0-4029-a25c-1a0c3129f2ca None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:45.887402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aff99-25a0-4029-a25c-1a0c3129f2ca None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:45.887625 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aff99-25a0-4029-a25c-1a0c3129f2ca None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:45.889366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 515/1004] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:45.896198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ad304-edb0-4d1f-9c75-8729eb6de204 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:45.896490 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ad304-edb0-4d1f-9c75-8729eb6de204 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:45.896764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ad304-edb0-4d1f-9c75-8729eb6de204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:45.919898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8f9ad304-edb0-4d1f-9c75-8729eb6de204 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:45.921474 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8f9ad304-edb0-4d1f-9c75-8729eb6de204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:45.939644 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168ba59-33be-4521-b5b3-e5a3d6dd3c47 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:45.994011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052f831-2fc9-4ac0-9870-7818e535aaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:45.995618 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f831-2fc9-4ac0-9870-7818e535aaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:45.996270 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f831-2fc9-4ac0-9870-7818e535aaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:45.996619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f831-2fc9-4ac0-9870-7818e535aaa9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:45.997704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052f831-2fc9-4ac0-9870-7818e535aaa9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:46.000075 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052f831-2fc9-4ac0-9870-7818e535aaa9 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:46.009354 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 516/1005] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-d052f831-2fc9-4ac0-9870-7818e535aaa9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:46.016818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:46.018017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:46.018993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:46.018993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:46.018993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:46.018993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:46.018993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:46.018993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:46.018993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:46.018993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:46.018993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:46.018993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:46.018993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:46.018993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:46.018993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:20:46.018993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:46.020598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 490/1006] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 18 10:20:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:46.025024 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ad304-edb0-4d1f-9c75-8729eb6de204 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:46.032868 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052f831-2fc9-4ac0-9870-7818e535aaa9 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:46.124792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:46.129446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:46.151255 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ad304-edb0-4d1f-9c75-8729eb6de204 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:46.160315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052f831-2fc9-4ac0-9870-7818e535aaa9 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:46.194891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dc320-425d-4b7e-8916-0ddd3fb7141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:46.195572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dc320-425d-4b7e-8916-0ddd3fb7141a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:46.195839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dc320-425d-4b7e-8916-0ddd3fb7141a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:46.196113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dc320-425d-4b7e-8916-0ddd3fb7141a None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:46.196820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28dc320-425d-4b7e-8916-0ddd3fb7141a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:46.197124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28dc320-425d-4b7e-8916-0ddd3fb7141a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:46.198528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28dc320-425d-4b7e-8916-0ddd3fb7141a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:46.199306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0f2f5-3c4f-41e2-a352-e57acb94f569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:46.200292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0f2f5-3c4f-41e2-a352-e57acb94f569 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:46.200626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0f2f5-3c4f-41e2-a352-e57acb94f569 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:46.201250 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0f2f5-3c4f-41e2-a352-e57acb94f569 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:46.202105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0f2f5-3c4f-41e2-a352-e57acb94f569 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:46.203992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0f2f5-3c4f-41e2-a352-e57acb94f569 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:46.206703 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 517/1007] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 18 10:20:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:46.209834 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dc320-425d-4b7e-8916-0ddd3fb7141a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:46.282567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 491/1008] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 18 10:20:46 2022] POST /identity/v3/services => generated 242 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:20:46.333537 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dc320-425d-4b7e-8916-0ddd3fb7141a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:46.385848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4a489-bd1a-424b-b084-3cd00a8dbe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:46.387137 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4a489-bd1a-424b-b084-3cd00a8dbe97 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:46.387425 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4a489-bd1a-424b-b084-3cd00a8dbe97 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:46.387679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4a489-bd1a-424b-b084-3cd00a8dbe97 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:46.388410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4a489-bd1a-424b-b084-3cd00a8dbe97 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:46.388729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4a489-bd1a-424b-b084-3cd00a8dbe97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:46.390169 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4a489-bd1a-424b-b084-3cd00a8dbe97 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:46.396327 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 518/1009] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 18 10:20:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:46.402386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0f2f5-3c4f-41e2-a352-e57acb94f569 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:46.533132 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0f2f5-3c4f-41e2-a352-e57acb94f569 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:46.570015 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f6e0c-cbd8-4975-b0c4-81304b1e0e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:46.570712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f6e0c-cbd8-4975-b0c4-81304b1e0e09 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:46.571018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f6e0c-cbd8-4975-b0c4-81304b1e0e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:46.571299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f6e0c-cbd8-4975-b0c4-81304b1e0e09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:46.572051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f6e0c-cbd8-4975-b0c4-81304b1e0e09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:46.573517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f6e0c-cbd8-4975-b0c4-81304b1e0e09 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:46.579250 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:46.683999 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 492/1010] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 18 10:20:46 2022] POST /identity/v3/endpoints => generated 325 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:20:46.727662 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220b399-62f2-4352-96ae-f4af70cbe02b None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:46.728225 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220b399-62f2-4352-96ae-f4af70cbe02b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:46.728225 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220b399-62f2-4352-96ae-f4af70cbe02b None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:46.730539 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 519/1011] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:46.736451 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaa5e1-ddf2-4188-99dc-99a350d845ed None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:46.736982 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaa5e1-ddf2-4188-99dc-99a350d845ed None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:46.737057 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaa5e1-ddf2-4188-99dc-99a350d845ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:46.756003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6dcaa5e1-ddf2-4188-99dc-99a350d845ed None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:46.757262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6dcaa5e1-ddf2-4188-99dc-99a350d845ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:46.849345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 493/1012] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:46 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:46.874144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220b399-62f2-4352-96ae-f4af70cbe02b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:46.877301 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:47.000788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220b399-62f2-4352-96ae-f4af70cbe02b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:47.037457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c195c3b-b505-4272-b103-ac1afe4730e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:47.038249 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c195c3b-b505-4272-b103-ac1afe4730e2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:47.038561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c195c3b-b505-4272-b103-ac1afe4730e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:47.038838 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c195c3b-b505-4272-b103-ac1afe4730e2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:47.039485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c195c3b-b505-4272-b103-ac1afe4730e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:47.040878 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c195c3b-b505-4272-b103-ac1afe4730e2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-9c195c3b-b505-4272-b103-ac1afe4730e2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:47.054578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:47.055753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:47.056847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:47.056847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:47.056847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:47.056847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:47.056847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:47.056847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:47.056847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:47.056847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:47.056847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:47.056847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:47.056847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:47.056847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:47.056847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:20:47.056847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:47.056847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 520/1013] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:47.063192 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcaa5e1-ddf2-4188-99dc-99a350d845ed None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:47.178980 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcaa5e1-ddf2-4188-99dc-99a350d845ed None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:47.205447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:47.218145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f2c1b-5c4e-449b-95d3-f3fa8c843851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:47.219843 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f2c1b-5c4e-449b-95d3-f3fa8c843851 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:47.219843 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f2c1b-5c4e-449b-95d3-f3fa8c843851 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:47.219843 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f2c1b-5c4e-449b-95d3-f3fa8c843851 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:47.220991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f2c1b-5c4e-449b-95d3-f3fa8c843851 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:47.221464 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f2c1b-5c4e-449b-95d3-f3fa8c843851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:47.223036 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f2c1b-5c4e-449b-95d3-f3fa8c843851 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:47.229356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 494/1014] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 18 10:20:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:47.236603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c195c3b-b505-4272-b103-ac1afe4730e2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:47.323790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:47.367320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c195c3b-b505-4272-b103-ac1afe4730e2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:47.407683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a984de2-a762-4469-bb62-5fb5abe5ce6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:47.408377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a984de2-a762-4469-bb62-5fb5abe5ce6e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:47.408656 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a984de2-a762-4469-bb62-5fb5abe5ce6e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:47.408928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a984de2-a762-4469-bb62-5fb5abe5ce6e None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:47.409654 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a984de2-a762-4469-bb62-5fb5abe5ce6e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:47.409992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a984de2-a762-4469-bb62-5fb5abe5ce6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:47.411412 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a984de2-a762-4469-bb62-5fb5abe5ce6e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:47.422384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 521/1015] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 18 10:20:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:47.425978 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f2c1b-5c4e-449b-95d3-f3fa8c843851 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:47.547934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f2c1b-5c4e-449b-95d3-f3fa8c843851 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:47.593197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b3edc-7470-4572-aadf-e9a9479c2254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:47.593925 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b3edc-7470-4572-aadf-e9a9479c2254 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:47.594232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b3edc-7470-4572-aadf-e9a9479c2254 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:47.594537 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b3edc-7470-4572-aadf-e9a9479c2254 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:47.595334 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b3edc-7470-4572-aadf-e9a9479c2254 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:47.596936 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b3edc-7470-4572-aadf-e9a9479c2254 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:47.826654 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 495/1016] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 18 10:20:47 2022] POST /identity/v3/endpoints => generated 334 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:20:48.474243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec381e-8725-44d5-bc0b-a81a9492575b None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:48.474901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec381e-8725-44d5-bc0b-a81a9492575b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:48.474901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec381e-8725-44d5-bc0b-a81a9492575b None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:48.476387 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 522/1017] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:48.482217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762ce62-221b-4566-850b-12101693324d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:48.482552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762ce62-221b-4566-850b-12101693324d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:48.482838 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762ce62-221b-4566-850b-12101693324d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:48.500886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d762ce62-221b-4566-850b-12101693324d None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:48.502099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d762ce62-221b-4566-850b-12101693324d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:48.543118 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:48.587474 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 496/1018] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:48.609641 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec381e-8725-44d5-bc0b-a81a9492575b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:48.742059 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec381e-8725-44d5-bc0b-a81a9492575b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:48.775550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:48.782557 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cfe39-7537-400d-864f-c50a49de73a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:48.789824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cfe39-7537-400d-864f-c50a49de73a8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:48.789824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cfe39-7537-400d-864f-c50a49de73a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:48.789824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cfe39-7537-400d-864f-c50a49de73a8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:48.789824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cfe39-7537-400d-864f-c50a49de73a8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:48.789824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cfe39-7537-400d-864f-c50a49de73a8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-f86cfe39-7537-400d-864f-c50a49de73a8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:48.799585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:48.801022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:48.802034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:48.802034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:48.802034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:48.802034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:48.802034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:48.802034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:48.802034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:48.802034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:48.802034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:48.802034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:48.802034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:48.802034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:48.802034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:20:48.802034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:48.804278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 523/1019] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Jul 18 10:20:48 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:48.811590 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762ce62-221b-4566-850b-12101693324d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:48.909123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40460ddc-b5c0-42c6-b774-e6e3f1bd490b None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:48.909454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40460ddc-b5c0-42c6-b774-e6e3f1bd490b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:48.909738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40460ddc-b5c0-42c6-b774-e6e3f1bd490b None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:48.911430 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 524/1020] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:48.916796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fc93a-f70a-454d-8584-f2ff7722b6f8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:48.917109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fc93a-f70a-454d-8584-f2ff7722b6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:48.917473 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fc93a-f70a-454d-8584-f2ff7722b6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:48.925040 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762ce62-221b-4566-850b-12101693324d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:48.936148 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-870fc93a-f70a-454d-8584-f2ff7722b6f8 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:48.937444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-870fc93a-f70a-454d-8584-f2ff7722b6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:48.976029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd31d8-5df8-46d2-b0ea-00a7dd81b14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:48.976766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd31d8-5df8-46d2-b0ea-00a7dd81b14a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:48.977074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd31d8-5df8-46d2-b0ea-00a7dd81b14a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:48.977434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd31d8-5df8-46d2-b0ea-00a7dd81b14a None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:48.978310 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd31d8-5df8-46d2-b0ea-00a7dd81b14a None admin] RBAC: Adding query filter params (name=image) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:48.978708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd31d8-5df8-46d2-b0ea-00a7dd81b14a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:48.980332 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd31d8-5df8-46d2-b0ea-00a7dd81b14a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:48.986343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 497/1021] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:48.992908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd31d8-5df8-46d2-b0ea-00a7dd81b14a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:49.020904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 525/1022] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:20:49.031906 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:49.048284 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fc93a-f70a-454d-8584-f2ff7722b6f8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:49.133925 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd31d8-5df8-46d2-b0ea-00a7dd81b14a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:49.181331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fc93a-f70a-454d-8584-f2ff7722b6f8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:49.184288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5777936-3caa-4431-a189-721dd16500fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:49.184968 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5777936-3caa-4431-a189-721dd16500fb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:49.185243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5777936-3caa-4431-a189-721dd16500fb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:49.185519 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5777936-3caa-4431-a189-721dd16500fb None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:49.186222 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5777936-3caa-4431-a189-721dd16500fb None admin] RBAC: Adding query filter params (type=image) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:49.186548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5777936-3caa-4431-a189-721dd16500fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:49.187928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5777936-3caa-4431-a189-721dd16500fb None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:49.199229 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 498/1023] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:49.200836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5777936-3caa-4431-a189-721dd16500fb None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:49.211895 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:49.225126 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab65478-e2e0-4f74-9db0-6bd542188351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:49.226083 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab65478-e2e0-4f74-9db0-6bd542188351 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:49.226437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab65478-e2e0-4f74-9db0-6bd542188351 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:49.226805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab65478-e2e0-4f74-9db0-6bd542188351 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:49.228248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab65478-e2e0-4f74-9db0-6bd542188351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:49.230750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab65478-e2e0-4f74-9db0-6bd542188351 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:49.233010 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 526/1024] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:49.238724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab65478-e2e0-4f74-9db0-6bd542188351 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:49.328800 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:49.335712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5777936-3caa-4431-a189-721dd16500fb None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:49.365400 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab65478-e2e0-4f74-9db0-6bd542188351 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:49.382550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a01e2-e07e-4a7f-9cbf-d17554b2caf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:49.383665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a01e2-e07e-4a7f-9cbf-d17554b2caf4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:49.383996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a01e2-e07e-4a7f-9cbf-d17554b2caf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:49.384573 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a01e2-e07e-4a7f-9cbf-d17554b2caf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:49.385425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a01e2-e07e-4a7f-9cbf-d17554b2caf4 None admin] RBAC: Adding query filter params (interface=public, service_id=7bf4689e10764a3b9ca772541c28a8aa, region_id=RegionOne) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:49.385737 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a01e2-e07e-4a7f-9cbf-d17554b2caf4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:49.388656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a01e2-e07e-4a7f-9cbf-d17554b2caf4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:49.401489 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 499/1025] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 18 10:20:49 2022] GET /identity/v3/endpoints?service_id=7bf4689e10764a3b9ca772541c28a8aa&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:49.403082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417d3d6-52df-4cea-b8ba-0cc08622edc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:49.403257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a01e2-e07e-4a7f-9cbf-d17554b2caf4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:49.403813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417d3d6-52df-4cea-b8ba-0cc08622edc7 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:49.404093 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417d3d6-52df-4cea-b8ba-0cc08622edc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:49.404366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417d3d6-52df-4cea-b8ba-0cc08622edc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:49.405078 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417d3d6-52df-4cea-b8ba-0cc08622edc7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:49.406553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417d3d6-52df-4cea-b8ba-0cc08622edc7 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:49.509501 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a01e2-e07e-4a7f-9cbf-d17554b2caf4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:49.514357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 527/1026] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 18 10:20:49 2022] POST /identity/v3/projects => generated 311 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:20:49.548777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19200f69-5cec-4a23-8054-986b3fbf9c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:49.549470 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19200f69-5cec-4a23-8054-986b3fbf9c14 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:49.549797 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19200f69-5cec-4a23-8054-986b3fbf9c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:49.550076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19200f69-5cec-4a23-8054-986b3fbf9c14 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:49.550797 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19200f69-5cec-4a23-8054-986b3fbf9c14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:49.552207 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19200f69-5cec-4a23-8054-986b3fbf9c14 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:49.560417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 500/1027] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 18 10:20:49 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:20:50.085414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb19ea-8a1d-4dfe-9786-196d1562a97d None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:50.085933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb19ea-8a1d-4dfe-9786-196d1562a97d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:50.086442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb19ea-8a1d-4dfe-9786-196d1562a97d None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:50.088039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 528/1028] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:50.096264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e62e24-7d2b-46ae-88cf-c0f14da3a705 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:50.097257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e62e24-7d2b-46ae-88cf-c0f14da3a705 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:50.097968 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e62e24-7d2b-46ae-88cf-c0f14da3a705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:50.126395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-25e62e24-7d2b-46ae-88cf-c0f14da3a705 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:50.128437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-25e62e24-7d2b-46ae-88cf-c0f14da3a705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:50.163112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:50.226362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 501/1029] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:20:50.259913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb19ea-8a1d-4dfe-9786-196d1562a97d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:50.316987 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:50.382010 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb19ea-8a1d-4dfe-9786-196d1562a97d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:50.423347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dc08a-3b30-422d-9765-a6afdc95a6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:50.424213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dc08a-3b30-422d-9765-a6afdc95a6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:50.424514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dc08a-3b30-422d-9765-a6afdc95a6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:50.424802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dc08a-3b30-422d-9765-a6afdc95a6c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:50.439473 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773dc08a-3b30-422d-9765-a6afdc95a6c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-773dc08a-3b30-422d-9765-a6afdc95a6c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:50.455773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:50.457251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:50.459237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:50.459237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:50.459237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:50.459237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:50.459237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:50.459237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:50.459237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:50.459237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:50.459237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:50.459237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:50.459237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:20:50.459237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:50.462700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 529/1030] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 18 10:20:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:50.467433 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e62e24-7d2b-46ae-88cf-c0f14da3a705 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:50.593954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e62e24-7d2b-46ae-88cf-c0f14da3a705 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:50.640287 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a7318-f6fe-4e93-a983-5b4346926347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:50.642134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a7318-f6fe-4e93-a983-5b4346926347 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:50.642694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a7318-f6fe-4e93-a983-5b4346926347 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:50.643262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a7318-f6fe-4e93-a983-5b4346926347 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:50.644801 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a7318-f6fe-4e93-a983-5b4346926347 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:50.645339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a7318-f6fe-4e93-a983-5b4346926347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:50.648297 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a7318-f6fe-4e93-a983-5b4346926347 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:50.670366 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 502/1031] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 18 10:20:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:50.673262 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dc08a-3b30-422d-9765-a6afdc95a6c0 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:50.802826 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dc08a-3b30-422d-9765-a6afdc95a6c0 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:50.806858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:50.847609 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ca623-ce43-4da3-bb75-fbd97182d582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:50.848345 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ca623-ce43-4da3-bb75-fbd97182d582 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:50.848682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ca623-ce43-4da3-bb75-fbd97182d582 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:50.848967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ca623-ce43-4da3-bb75-fbd97182d582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:50.861731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ca623-ce43-4da3-bb75-fbd97182d582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:50.863353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ca623-ce43-4da3-bb75-fbd97182d582 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:50.884614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-405ca623-ce43-4da3-bb75-fbd97182d582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:50.884614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:50.884614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:50.884614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:50.884614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:50.884614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:50.884614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:50.884614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:50.884614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:50.884614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:50.884614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:50.884614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:50.884614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:50.884614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:50.884614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:50.887608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:50.891130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:50.891130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:50.891130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:50.891130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:50.891130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 530/1032] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:50.895566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a7318-f6fe-4e93-a983-5b4346926347 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:50.918292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:51.041894 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a7318-f6fe-4e93-a983-5b4346926347 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:51.083332 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c99ef0-0c67-4243-8932-79d64088066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:51.084024 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c99ef0-0c67-4243-8932-79d64088066e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:51.084310 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c99ef0-0c67-4243-8932-79d64088066e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:51.084637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c99ef0-0c67-4243-8932-79d64088066e None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:51.085390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c99ef0-0c67-4243-8932-79d64088066e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:51.085745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c99ef0-0c67-4243-8932-79d64088066e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:51.087272 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c99ef0-0c67-4243-8932-79d64088066e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:51.102195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 503/1033] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:51.109166 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ca623-ce43-4da3-bb75-fbd97182d582 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:51.236184 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ca623-ce43-4da3-bb75-fbd97182d582 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:51.276123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d527355-c7a2-416f-8a4d-2310cd2c686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:51.277086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d527355-c7a2-416f-8a4d-2310cd2c686b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:51.277466 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d527355-c7a2-416f-8a4d-2310cd2c686b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:51.277892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d527355-c7a2-416f-8a4d-2310cd2c686b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:51.287055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d527355-c7a2-416f-8a4d-2310cd2c686b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:51.288521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d527355-c7a2-416f-8a4d-2310cd2c686b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-0d527355-c7a2-416f-8a4d-2310cd2c686b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:51.305017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:51.311924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:51.313669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:51.313669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:51.313669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:51.313669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:51.313669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:51.313669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:51.313669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:51.313669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:51.313669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:20:51.313669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:51.313669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 531/1034] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 18 10:20:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:51.319667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c99ef0-0c67-4243-8932-79d64088066e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:51.425718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:51.438302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c99ef0-0c67-4243-8932-79d64088066e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:51.478268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ca9a2-1671-4f51-982a-b71cfb336815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:51.478970 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ca9a2-1671-4f51-982a-b71cfb336815 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:51.479309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ca9a2-1671-4f51-982a-b71cfb336815 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:51.479629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ca9a2-1671-4f51-982a-b71cfb336815 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:51.481116 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ca9a2-1671-4f51-982a-b71cfb336815 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:51.481484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ca9a2-1671-4f51-982a-b71cfb336815 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:51.483013 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ca9a2-1671-4f51-982a-b71cfb336815 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:51.509751 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 504/1035] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 18 10:20:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:51.511046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d527355-c7a2-416f-8a4d-2310cd2c686b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:51.531697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:51.622829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d527355-c7a2-416f-8a4d-2310cd2c686b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:51.661201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bedd9-7598-4493-baff-f65972117cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:51.661951 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bedd9-7598-4493-baff-f65972117cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:51.662257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bedd9-7598-4493-baff-f65972117cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:51.662651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bedd9-7598-4493-baff-f65972117cd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:51.741568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bedd9-7598-4493-baff-f65972117cd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:51.743128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bedd9-7598-4493-baff-f65972117cd1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:51.764458 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:51.787617 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c14d9-4504-48d9-910d-5970deef721d None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:51.787948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c14d9-4504-48d9-910d-5970deef721d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:51.788180 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c14d9-4504-48d9-910d-5970deef721d None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:51.789745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 505/1036] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:51.791523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8b13a-7aa5-4841-9552-3dec591ca782 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:51.791901 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8b13a-7aa5-4841-9552-3dec591ca782 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:51.792321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8b13a-7aa5-4841-9552-3dec591ca782 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:51.793904 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 506/1037] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:51.795111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d3a86-10ac-4419-92f7-d081336fd9e8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:51.795425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d3a86-10ac-4419-92f7-d081336fd9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:51.795707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d3a86-10ac-4419-92f7-d081336fd9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:51.814620 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1a6d3a86-10ac-4419-92f7-d081336fd9e8 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:51.815891 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1a6d3a86-10ac-4419-92f7-d081336fd9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:51.868526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 532/1038] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:20:51 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 10:20:51.869825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b79a7b-78b6-44f2-8c1d-23b55cb3a06e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:51.870117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b79a7b-78b6-44f2-8c1d-23b55cb3a06e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:51.871107 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b79a7b-78b6-44f2-8c1d-23b55cb3a06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:51.887798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 507/1039] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:51.888798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d3a86-10ac-4419-92f7-d081336fd9e8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:51.889111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-56b79a7b-78b6-44f2-8c1d-23b55cb3a06e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:51.890308 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-56b79a7b-78b6-44f2-8c1d-23b55cb3a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:51.964872 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:51.966827 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 533/1040] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:51.967790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b79a7b-78b6-44f2-8c1d-23b55cb3a06e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:52.007944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d3a86-10ac-4419-92f7-d081336fd9e8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:52.022399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:52.043609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a6ec0-8d6a-43f5-88ae-3ef2c363bd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:52.044424 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a6ec0-8d6a-43f5-88ae-3ef2c363bd66 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:52.044709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a6ec0-8d6a-43f5-88ae-3ef2c363bd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:52.044984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a6ec0-8d6a-43f5-88ae-3ef2c363bd66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:52.056287 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a6ec0-8d6a-43f5-88ae-3ef2c363bd66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:52.057711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a6ec0-8d6a-43f5-88ae-3ef2c363bd66 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:52.077330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-986a6ec0-8d6a-43f5-88ae-3ef2c363bd66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:52.077330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:52.077330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:52.077330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:52.077330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:52.077330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:52.077330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:52.077330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:52.077330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:52.077330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:52.077330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:52.077330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:52.077330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:52.077330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:52.077330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:52.078365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:52.079288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:52.079288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:52.079288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:52.079288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:52.079288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 508/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:52.079595 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a6ec0-8d6a-43f5-88ae-3ef2c363bd66 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:52.085003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b79a7b-78b6-44f2-8c1d-23b55cb3a06e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:52.125764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a376b-b5b5-4356-8b40-52b55fd00769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:52.127091 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a376b-b5b5-4356-8b40-52b55fd00769 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:52.127561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a376b-b5b5-4356-8b40-52b55fd00769 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:52.128046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a376b-b5b5-4356-8b40-52b55fd00769 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:52.129982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a376b-b5b5-4356-8b40-52b55fd00769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:52.132596 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a376b-b5b5-4356-8b40-52b55fd00769 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:52.142235 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 534/1042] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:52.142235 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a376b-b5b5-4356-8b40-52b55fd00769 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:52.195325 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a6ec0-8d6a-43f5-88ae-3ef2c363bd66 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:52.213529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:52.232116 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d0b54-e350-4cd6-b5ef-d7676610f393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:52.232899 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0b54-e350-4cd6-b5ef-d7676610f393 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:52.233179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0b54-e350-4cd6-b5ef-d7676610f393 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:52.233455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0b54-e350-4cd6-b5ef-d7676610f393 None admin] PATH_INFO: `/v3/services/image` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:52.234177 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d0b54-e350-4cd6-b5ef-d7676610f393 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:52.235499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d0b54-e350-4cd6-b5ef-d7676610f393 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-ff7d0b54-e350-4cd6-b5ef-d7676610f393 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:52.248143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:52.249285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:52.250584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:52.250584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:52.250584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:52.250584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:52.250584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:52.250584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:52.250584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:52.250584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:52.250584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:52.250584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:52.250584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:20:52.250584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:20:52.250584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:20:52.250584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:52.250584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 509/1043] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Jul 18 10:20:52 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:52.252172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d0b54-e350-4cd6-b5ef-d7676610f393 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:52.300715 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a376b-b5b5-4356-8b40-52b55fd00769 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:52.316118 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:52.337593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbb504-f3a2-4d53-b0b8-1ae509329065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:52.338410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb504-f3a2-4d53-b0b8-1ae509329065 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:52.338925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb504-f3a2-4d53-b0b8-1ae509329065 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:52.339828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb504-f3a2-4d53-b0b8-1ae509329065 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:52.340595 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbb504-f3a2-4d53-b0b8-1ae509329065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:52.340969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbb504-f3a2-4d53-b0b8-1ae509329065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:52.342450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbb504-f3a2-4d53-b0b8-1ae509329065 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:52.357556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 535/1044] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:52.358444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbb504-f3a2-4d53-b0b8-1ae509329065 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:52.384858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d0b54-e350-4cd6-b5ef-d7676610f393 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:52.431263 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25064c-1b36-4bde-894b-40113337a7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:52.431957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25064c-1b36-4bde-894b-40113337a7f7 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:52.432241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25064c-1b36-4bde-894b-40113337a7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:52.432518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25064c-1b36-4bde-894b-40113337a7f7 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:52.433798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25064c-1b36-4bde-894b-40113337a7f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:52.435362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25064c-1b36-4bde-894b-40113337a7f7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:52.468290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbb504-f3a2-4d53-b0b8-1ae509329065 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:52.505183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3c2a2-09aa-4a10-b33a-9c3496060a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:52.505847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3c2a2-09aa-4a10-b33a-9c3496060a5e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:52.506133 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3c2a2-09aa-4a10-b33a-9c3496060a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:52.506440 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3c2a2-09aa-4a10-b33a-9c3496060a5e None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:52.507193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3c2a2-09aa-4a10-b33a-9c3496060a5e None admin] RBAC: Adding query filter params (name=image) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:52.507500 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3c2a2-09aa-4a10-b33a-9c3496060a5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:52.509251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3c2a2-09aa-4a10-b33a-9c3496060a5e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:52.515210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 536/1045] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:52.515996 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3c2a2-09aa-4a10-b33a-9c3496060a5e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:52.561148 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:52.564493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 510/1046] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:20:52 2022] POST /identity/v3/users => generated 285 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:20:52.565126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25064c-1b36-4bde-894b-40113337a7f7 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:52.612494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:52.666756 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3c2a2-09aa-4a10-b33a-9c3496060a5e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:52.718084 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77123b-e241-4ea5-a65e-78873a7fa698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:52.719010 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77123b-e241-4ea5-a65e-78873a7fa698 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:52.719346 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77123b-e241-4ea5-a65e-78873a7fa698 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:52.719683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77123b-e241-4ea5-a65e-78873a7fa698 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:52.728929 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77123b-e241-4ea5-a65e-78873a7fa698 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:52.731253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77123b-e241-4ea5-a65e-78873a7fa698 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:52.732754 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25064c-1b36-4bde-894b-40113337a7f7 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:52.747592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-ab77123b-e241-4ea5-a65e-78873a7fa698 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:52.747592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:52.747592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:52.747592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:52.747592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:52.747592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:52.747592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:52.747592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:52.747592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:52.747592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:52.747592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:52.747592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:52.747592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:52.747592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:52.747592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:52.749802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:52.751542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:52.751542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:52.751542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:52.751542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:52.751542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:52.751542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:52.751542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:52.751542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:52.751542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 537/1047] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:52.754941 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77123b-e241-4ea5-a65e-78873a7fa698 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:52.800007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910231f6-ed45-48bc-8701-0866314d9fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:52.800735 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910231f6-ed45-48bc-8701-0866314d9fbd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:52.801040 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910231f6-ed45-48bc-8701-0866314d9fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:52.801322 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910231f6-ed45-48bc-8701-0866314d9fbd None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:52.802038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910231f6-ed45-48bc-8701-0866314d9fbd None admin] RBAC: Adding query filter params (type=image) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:52.802368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910231f6-ed45-48bc-8701-0866314d9fbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:52.803763 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910231f6-ed45-48bc-8701-0866314d9fbd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:52.812262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 511/1048] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:52.819296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910231f6-ed45-48bc-8701-0866314d9fbd None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:52.891995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:52.897874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77123b-e241-4ea5-a65e-78873a7fa698 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:52.944593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67186e5-aecc-4bb2-a887-dd018d7417af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:52.945252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67186e5-aecc-4bb2-a887-dd018d7417af None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:52.945532 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67186e5-aecc-4bb2-a887-dd018d7417af None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:52.945840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67186e5-aecc-4bb2-a887-dd018d7417af None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:52.946659 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67186e5-aecc-4bb2-a887-dd018d7417af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:52.946967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67186e5-aecc-4bb2-a887-dd018d7417af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:52.948445 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67186e5-aecc-4bb2-a887-dd018d7417af None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:52.960552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:52.964910 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 538/1049] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:52.965306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910231f6-ed45-48bc-8701-0866314d9fbd None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:52.970750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67186e5-aecc-4bb2-a887-dd018d7417af None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:53.006692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060a5ba-548b-4d66-95c1-e03f614a0df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:53.007352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060a5ba-548b-4d66-95c1-e03f614a0df9 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:53.008214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060a5ba-548b-4d66-95c1-e03f614a0df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:53.008496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060a5ba-548b-4d66-95c1-e03f614a0df9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:53.009229 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060a5ba-548b-4d66-95c1-e03f614a0df9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:53.010668 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060a5ba-548b-4d66-95c1-e03f614a0df9 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:53.077832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 512/1050] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 18 10:20:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:20:53.132399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67186e5-aecc-4bb2-a887-dd018d7417af None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:53.188793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008aa17-bee3-424b-8c6e-6844c1ae70de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:53.189465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008aa17-bee3-424b-8c6e-6844c1ae70de None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:53.189743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008aa17-bee3-424b-8c6e-6844c1ae70de None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:53.190003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008aa17-bee3-424b-8c6e-6844c1ae70de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:53.190869 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008aa17-bee3-424b-8c6e-6844c1ae70de None admin] RBAC: Adding query filter params (role.id=bcef1c0f49bf4bd5a5946b34ab8ba902, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=f7abf6b71ac3454ca547a750cef9220a) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:53.191177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008aa17-bee3-424b-8c6e-6844c1ae70de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:53.192721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008aa17-bee3-424b-8c6e-6844c1ae70de None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:53.201216 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 539/1051] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:20:52 2022] GET /identity/v3/role_assignments?user.id=f7abf6b71ac3454ca547a750cef9220a&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=bcef1c0f49bf4bd5a5946b34ab8ba902 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:54.802990 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14fded-c143-45a8-b1fd-f8056a026fa0 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:54.803828 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14fded-c143-45a8-b1fd-f8056a026fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:54.803971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14fded-c143-45a8-b1fd-f8056a026fa0 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:54.805634 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 513/1052] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:54.811692 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b40eef-e5f5-4592-af3e-05743a0ce5dd None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:54.812409 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b40eef-e5f5-4592-af3e-05743a0ce5dd None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:54.812716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b40eef-e5f5-4592-af3e-05743a0ce5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:54.831140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e0b40eef-e5f5-4592-af3e-05743a0ce5dd None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:54.832519 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e0b40eef-e5f5-4592-af3e-05743a0ce5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:54.848902 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:54.914305 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 540/1053] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:20:54.943945 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14fded-c143-45a8-b1fd-f8056a026fa0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:55.061983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14fded-c143-45a8-b1fd-f8056a026fa0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:55.098483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e897f-85c7-4393-b049-ec10fa540ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:55.099398 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e897f-85c7-4393-b049-ec10fa540ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:55.099682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e897f-85c7-4393-b049-ec10fa540ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:55.099954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e897f-85c7-4393-b049-ec10fa540ce1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:55.113844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e897f-85c7-4393-b049-ec10fa540ce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-3e2e897f-85c7-4393-b049-ec10fa540ce1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:55.122175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:55.123243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:55.124093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:55.124093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:55.124093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:55.124093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:55.124093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:55.124093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:55.124093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:55.124093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:55.124093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:55.124093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:55.124093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:55.124093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:55.126409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 514/1054] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:20:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:55.129715 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b40eef-e5f5-4592-af3e-05743a0ce5dd None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:55.202936 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89e40-ebb4-4ac6-ae2c-f35e6fea62ad None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:55.203326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89e40-ebb4-4ac6-ae2c-f35e6fea62ad None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:55.203615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89e40-ebb4-4ac6-ae2c-f35e6fea62ad None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:55.205134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 515/1055] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:20:55.210459 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577f391-7630-4f27-9f3d-7010ec3c1ad7 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:55.210742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577f391-7630-4f27-9f3d-7010ec3c1ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:55.211020 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577f391-7630-4f27-9f3d-7010ec3c1ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:55.228585 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1577f391-7630-4f27-9f3d-7010ec3c1ad7 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:55.229785 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1577f391-7630-4f27-9f3d-7010ec3c1ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:55.241311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:55.242980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b40eef-e5f5-4592-af3e-05743a0ce5dd None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:55.283273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2fab5-9f5b-4cbd-8769-100a4af9c76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:55.283936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2fab5-9f5b-4cbd-8769-100a4af9c76f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:55.284242 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2fab5-9f5b-4cbd-8769-100a4af9c76f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:55.284513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2fab5-9f5b-4cbd-8769-100a4af9c76f None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:55.285251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2fab5-9f5b-4cbd-8769-100a4af9c76f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:55.285580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2fab5-9f5b-4cbd-8769-100a4af9c76f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:55.286991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2fab5-9f5b-4cbd-8769-100a4af9c76f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:55.296501 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 541/1056] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:20:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:55.302315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2fab5-9f5b-4cbd-8769-100a4af9c76f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:55.310072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 516/1057] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:20:55.316339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:55.333510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577f391-7630-4f27-9f3d-7010ec3c1ad7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:55.422836 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2fab5-9f5b-4cbd-8769-100a4af9c76f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:55.445240 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577f391-7630-4f27-9f3d-7010ec3c1ad7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:55.460794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd846a-1d2b-4035-a1a2-f6c453702d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:55.461668 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd846a-1d2b-4035-a1a2-f6c453702d69 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:55.461950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd846a-1d2b-4035-a1a2-f6c453702d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:55.462224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd846a-1d2b-4035-a1a2-f6c453702d69 None admin] PATH_INFO: `/v3/users/710428ab24224b6991c5080fdbbe6a8e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:55.479877 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd846a-1d2b-4035-a1a2-f6c453702d69 None admin] RBAC: Authorizing `identity:get_user(user_id=710428ab24224b6991c5080fdbbe6a8e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:55.485864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd846a-1d2b-4035-a1a2-f6c453702d69 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:55.485864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 542/1058] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:20:55 2022] GET /identity/v3/users/710428ab24224b6991c5080fdbbe6a8e => generated 285 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:55.485864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ec2bc-c3eb-461f-b1c6-2023446d3729 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:55.485864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ec2bc-c3eb-461f-b1c6-2023446d3729 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:55.485864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ec2bc-c3eb-461f-b1c6-2023446d3729 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:55.486696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 543/1059] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:55.492974 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ec2bc-c3eb-461f-b1c6-2023446d3729 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:55.505279 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d07e40-f44c-47e3-b302-250c2d534133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:55.506090 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d07e40-f44c-47e3-b302-250c2d534133 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:55.506465 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d07e40-f44c-47e3-b302-250c2d534133 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:55.506845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d07e40-f44c-47e3-b302-250c2d534133 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:55.523908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:55.640236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:55.644190 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d07e40-f44c-47e3-b302-250c2d534133 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:55.645690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d07e40-f44c-47e3-b302-250c2d534133 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:55.680798 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ec2bc-c3eb-461f-b1c6-2023446d3729 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:55.720865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dc116-1d19-4956-80a9-da9cc374e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:55.721517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dc116-1d19-4956-80a9-da9cc374e454 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:55.721806 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dc116-1d19-4956-80a9-da9cc374e454 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:55.722083 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dc116-1d19-4956-80a9-da9cc374e454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:55.754750 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 517/1060] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:20:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:20:55.756051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae194cd-4888-4d82-a0a7-694db8339437 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:55.756338 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae194cd-4888-4d82-a0a7-694db8339437 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:55.756611 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae194cd-4888-4d82-a0a7-694db8339437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:55.774428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6ae194cd-4888-4d82-a0a7-694db8339437 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:55.775628 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6ae194cd-4888-4d82-a0a7-694db8339437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:55.798548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651dc116-1d19-4956-80a9-da9cc374e454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:55.800581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651dc116-1d19-4956-80a9-da9cc374e454 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:55.820604 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:55.853074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 518/1061] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:55.855355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae194cd-4888-4d82-a0a7-694db8339437 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:55.878768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:55.918161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 544/1062] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:20:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 10:20:55.918161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dc116-1d19-4956-80a9-da9cc374e454 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:55.981677 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae194cd-4888-4d82-a0a7-694db8339437 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:56.034315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a1963-1d87-4b07-b739-0fde2a03749b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:56.035622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a1963-1d87-4b07-b739-0fde2a03749b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:56.036087 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a1963-1d87-4b07-b739-0fde2a03749b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:56.036554 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a1963-1d87-4b07-b739-0fde2a03749b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:56.051848 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a1963-1d87-4b07-b739-0fde2a03749b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:56.053313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a1963-1d87-4b07-b739-0fde2a03749b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:56.055472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dc116-1d19-4956-80a9-da9cc374e454 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:56.071552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-da9a1963-1d87-4b07-b739-0fde2a03749b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:56.071552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:56.071552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:56.071552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:56.071552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:56.071552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:56.071552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:56.071552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:56.071552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:56.071552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:56.071552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:56.071552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:56.071552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:56.071552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:56.071552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:56.072673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:56.079455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:56.079455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:56.079455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:56.079455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:56.079455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 519/1063] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:56.079455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a1963-1d87-4b07-b739-0fde2a03749b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:56.095301 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c879d-aa00-4013-b2a9-83952e0a3316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:56.096114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c879d-aa00-4013-b2a9-83952e0a3316 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:56.096397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c879d-aa00-4013-b2a9-83952e0a3316 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:56.096672 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c879d-aa00-4013-b2a9-83952e0a3316 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:56.103342 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:56.107960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c879d-aa00-4013-b2a9-83952e0a3316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e01c879d-aa00-4013-b2a9-83952e0a3316 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:56.116331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:56.122914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:56.124821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:56.124821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:56.124821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:56.124821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:56.124821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:56.124821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:56.124821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:56.124821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:56.124821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:56.124821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:56.124821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:20:56.124821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:56.124821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 545/1064] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 18 10:20:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:56.124821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c879d-aa00-4013-b2a9-83952e0a3316 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:56.153455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:56.205606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a1963-1d87-4b07-b739-0fde2a03749b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:56.241469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ca97d-7b2c-42ae-8687-bc382bcd5d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:56.242349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ca97d-7b2c-42ae-8687-bc382bcd5d55 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:56.242640 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ca97d-7b2c-42ae-8687-bc382bcd5d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:56.242920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ca97d-7b2c-42ae-8687-bc382bcd5d55 None admin] PATH_INFO: `/v3/projects/0f08796900fd45d99c86e9e8ff2778e6` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:56.244107 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ca97d-7b2c-42ae-8687-bc382bcd5d55 None admin] RBAC: Authorizing `identity:get_project(project_id=0f08796900fd45d99c86e9e8ff2778e6)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:56.246066 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ca97d-7b2c-42ae-8687-bc382bcd5d55 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:56.248066 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 520/1065] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:20:56 2022] GET /identity/v3/projects/0f08796900fd45d99c86e9e8ff2778e6 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:56.248653 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ca97d-7b2c-42ae-8687-bc382bcd5d55 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:56.250392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c879d-aa00-4013-b2a9-83952e0a3316 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:56.292422 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47f28b-8ae3-4f46-9271-22322fa9bb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:56.293659 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47f28b-8ae3-4f46-9271-22322fa9bb2f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:56.294124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47f28b-8ae3-4f46-9271-22322fa9bb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:56.294706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47f28b-8ae3-4f46-9271-22322fa9bb2f None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:56.295951 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47f28b-8ae3-4f46-9271-22322fa9bb2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:56.296462 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47f28b-8ae3-4f46-9271-22322fa9bb2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:56.298709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47f28b-8ae3-4f46-9271-22322fa9bb2f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:56.318352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 546/1066] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:56.319551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47f28b-8ae3-4f46-9271-22322fa9bb2f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:56.380076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:56.387452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ca97d-7b2c-42ae-8687-bc382bcd5d55 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:56.439290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0abbd-0bc8-4318-ab0e-a3a4efaa9dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:56.440523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0abbd-0bc8-4318-ab0e-a3a4efaa9dee None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:56.441063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0abbd-0bc8-4318-ab0e-a3a4efaa9dee None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:56.441587 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0abbd-0bc8-4318-ab0e-a3a4efaa9dee None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:56.443217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0abbd-0bc8-4318-ab0e-a3a4efaa9dee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:56.443805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0abbd-0bc8-4318-ab0e-a3a4efaa9dee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:56.446728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0abbd-0bc8-4318-ab0e-a3a4efaa9dee None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:56.454283 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:56.465369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 521/1067] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 18 10:20:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:56.471797 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0abbd-0bc8-4318-ab0e-a3a4efaa9dee None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:56.475951 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47f28b-8ae3-4f46-9271-22322fa9bb2f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:56.549955 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d481715-2f10-4c2c-bdda-3804dee909f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:56.551187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d481715-2f10-4c2c-bdda-3804dee909f2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:56.551714 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d481715-2f10-4c2c-bdda-3804dee909f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:56.552242 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d481715-2f10-4c2c-bdda-3804dee909f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:56.553965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d481715-2f10-4c2c-bdda-3804dee909f2 None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=0f08796900fd45d99c86e9e8ff2778e6, user.id=710428ab24224b6991c5080fdbbe6a8e) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:56.554839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d481715-2f10-4c2c-bdda-3804dee909f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:56.557477 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d481715-2f10-4c2c-bdda-3804dee909f2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:56.569560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 547/1068] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:20:56 2022] GET /identity/v3/role_assignments?user.id=710428ab24224b6991c5080fdbbe6a8e&scope.project.id=0f08796900fd45d99c86e9e8ff2778e6&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:56.604499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0abbd-0bc8-4318-ab0e-a3a4efaa9dee None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:56.653006 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f52e6-df47-4b03-80ba-c47784ec902d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:56.653827 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f52e6-df47-4b03-80ba-c47784ec902d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:56.654111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f52e6-df47-4b03-80ba-c47784ec902d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:56.654439 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f52e6-df47-4b03-80ba-c47784ec902d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:56.668648 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f52e6-df47-4b03-80ba-c47784ec902d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:56.670167 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f52e6-df47-4b03-80ba-c47784ec902d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:56.690597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-bf9f52e6-df47-4b03-80ba-c47784ec902d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:56.690597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:56.690597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:56.690597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:56.690597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:56.690597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:56.690597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:56.690597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:56.690597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:56.690597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:56.690597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:56.690597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:56.690597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:56.690597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:56.690597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:56.692403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:56.694109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:56.694109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:56.694109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:56.694109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:56.694109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 522/1069] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:56.699746 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d481715-2f10-4c2c-bdda-3804dee909f2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:56.805699 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d481715-2f10-4c2c-bdda-3804dee909f2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:56.841441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43ee7a-1647-4783-9bbb-a45d83704281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:56.842112 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43ee7a-1647-4783-9bbb-a45d83704281 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:56.842428 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43ee7a-1647-4783-9bbb-a45d83704281 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:56.842707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43ee7a-1647-4783-9bbb-a45d83704281 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:56.843425 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43ee7a-1647-4783-9bbb-a45d83704281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:56.843734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43ee7a-1647-4783-9bbb-a45d83704281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:56.845106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43ee7a-1647-4783-9bbb-a45d83704281 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:56.858209 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 548/1070] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:56.863838 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f52e6-df47-4b03-80ba-c47784ec902d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:56.877691 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:56.969310 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f52e6-df47-4b03-80ba-c47784ec902d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:57.003531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def356c-7e9b-44b4-ad6c-a7ed1f6a67e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:57.004323 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def356c-7e9b-44b4-ad6c-a7ed1f6a67e7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:57.004602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def356c-7e9b-44b4-ad6c-a7ed1f6a67e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:57.004873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def356c-7e9b-44b4-ad6c-a7ed1f6a67e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:57.013375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def356c-7e9b-44b4-ad6c-a7ed1f6a67e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:57.014864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def356c-7e9b-44b4-ad6c-a7ed1f6a67e7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-6def356c-7e9b-44b4-ad6c-a7ed1f6a67e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:20:57.029712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:57.030934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:57.032077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:57.032077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:57.032077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:20:57.032077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:20:57.032077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:20:57.032077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:20:57.032077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:20:57.032077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:20:57.032077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:20:57.032077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:57.034488 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 523/1071] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 18 10:20:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:57.036593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43ee7a-1647-4783-9bbb-a45d83704281 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:57.052447 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:57.142537 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43ee7a-1647-4783-9bbb-a45d83704281 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:57.177668 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a69c90-8203-45f3-8456-3edfc09b27f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:57.178372 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a69c90-8203-45f3-8456-3edfc09b27f6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:57.178662 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a69c90-8203-45f3-8456-3edfc09b27f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:57.178939 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a69c90-8203-45f3-8456-3edfc09b27f6 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:57.179784 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a69c90-8203-45f3-8456-3edfc09b27f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:57.180095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a69c90-8203-45f3-8456-3edfc09b27f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:57.181551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a69c90-8203-45f3-8456-3edfc09b27f6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:57.200120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 549/1072] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 18 10:20:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:57.205945 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def356c-7e9b-44b4-ad6c-a7ed1f6a67e7 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:57.277354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:57.310456 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def356c-7e9b-44b4-ad6c-a7ed1f6a67e7 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:57.344944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91e904-f889-4bf1-8506-7d5ac64dc0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:57.345741 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91e904-f889-4bf1-8506-7d5ac64dc0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:57.346025 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91e904-f889-4bf1-8506-7d5ac64dc0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:57.346302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91e904-f889-4bf1-8506-7d5ac64dc0b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:57.357747 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91e904-f889-4bf1-8506-7d5ac64dc0b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:57.359372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91e904-f889-4bf1-8506-7d5ac64dc0b1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:57.377098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-6c91e904-f889-4bf1-8506-7d5ac64dc0b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:57.377098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:57.377098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:57.377098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:57.377098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:57.377098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:57.377098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:57.377098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:57.377098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:57.377098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:57.377098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:57.377098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:57.377098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:20:57.377098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:20:57.377098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:57.378280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:57.379639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:20:57.379639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:20:57.379639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:20:57.379639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:57.379639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 524/1073] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:20:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:20:57.384606 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a69c90-8203-45f3-8456-3edfc09b27f6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:57.455549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:57.489189 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a69c90-8203-45f3-8456-3edfc09b27f6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:57.523376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a59aa1-e73f-492c-b28d-bbe079dc580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:57.524045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a59aa1-e73f-492c-b28d-bbe079dc580d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:57.524328 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a59aa1-e73f-492c-b28d-bbe079dc580d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:57.524605 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a59aa1-e73f-492c-b28d-bbe079dc580d None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:57.525347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a59aa1-e73f-492c-b28d-bbe079dc580d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:57.525657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a59aa1-e73f-492c-b28d-bbe079dc580d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:57.527613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a59aa1-e73f-492c-b28d-bbe079dc580d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:57.539929 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 550/1074] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:57.546615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91e904-f889-4bf1-8506-7d5ac64dc0b1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:57.651057 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91e904-f889-4bf1-8506-7d5ac64dc0b1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:57.674203 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:57.686868 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d88308-e732-4e2d-b8bc-91dbab4c4031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:57.687679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d88308-e732-4e2d-b8bc-91dbab4c4031 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:57.688064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d88308-e732-4e2d-b8bc-91dbab4c4031 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:57.688354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d88308-e732-4e2d-b8bc-91dbab4c4031 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:57.695300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d88308-e732-4e2d-b8bc-91dbab4c4031 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:57.696849 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d88308-e732-4e2d-b8bc-91dbab4c4031 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:57.712150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-f5d88308-e732-4e2d-b8bc-91dbab4c4031 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:57.712150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:57.712150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:57.712150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:57.712150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:57.712150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:57.712150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:57.712150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:57.712150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:57.712150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:57.712150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:57.712150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:57.712150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:20:57.712150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:20:57.712150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:57.713273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:57.714597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:20:57.714597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:20:57.714597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:20:57.714597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:20:57.714597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:20:57.714597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:20:57.714597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:20:57.714597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:20:57.718216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 525/1075] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:20:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:57.719288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a59aa1-e73f-492c-b28d-bbe079dc580d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:57.821666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a59aa1-e73f-492c-b28d-bbe079dc580d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:57.850631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:57.857114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7aa31-2837-429c-8a81-468de970404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:57.859603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7aa31-2837-429c-8a81-468de970404a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:57.859603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7aa31-2837-429c-8a81-468de970404a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:57.859603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7aa31-2837-429c-8a81-468de970404a None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:57.859603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7aa31-2837-429c-8a81-468de970404a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:57.859603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7aa31-2837-429c-8a81-468de970404a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:57.860987 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7aa31-2837-429c-8a81-468de970404a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:57.878172 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 551/1076] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:20:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:57.879604 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d88308-e732-4e2d-b8bc-91dbab4c4031 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:57.982281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d88308-e732-4e2d-b8bc-91dbab4c4031 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:58.018097 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0b279-c9c6-4d69-bbb5-305a954fadc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:58.019004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0b279-c9c6-4d69-bbb5-305a954fadc5 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:58.019287 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0b279-c9c6-4d69-bbb5-305a954fadc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:58.019560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0b279-c9c6-4d69-bbb5-305a954fadc5 None admin] PATH_INFO: `/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/f7abf6b71ac3454ca547a750cef9220a/roles/bcef1c0f49bf4bd5a5946b34ab8ba902` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:58.021713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0b279-c9c6-4d69-bbb5-305a954fadc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=40e0b5ee15df481cbc01333131f3def0, user_id=f7abf6b71ac3454ca547a750cef9220a, role_id=bcef1c0f49bf4bd5a5946b34ab8ba902)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:58.023255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0b279-c9c6-4d69-bbb5-305a954fadc5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:58.122401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 526/1077] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:20:57 2022] PUT /identity/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/f7abf6b71ac3454ca547a750cef9220a/roles/bcef1c0f49bf4bd5a5946b34ab8ba902 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:20:59.181554 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0118f3-c421-49cc-bd00-67467e273c1f None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:59.182152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0118f3-c421-49cc-bd00-67467e273c1f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:59.182152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0118f3-c421-49cc-bd00-67467e273c1f None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:59.184571 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 552/1078] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:20:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:20:59.190168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bc5a1-51b1-47ca-8804-82225d53bf34 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:59.190648 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bc5a1-51b1-47ca-8804-82225d53bf34 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:59.190889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bc5a1-51b1-47ca-8804-82225d53bf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:59.208802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a51bc5a1-51b1-47ca-8804-82225d53bf34 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:20:59.209919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a51bc5a1-51b1-47ca-8804-82225d53bf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:20:59.248048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:59.283570 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 527/1079] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:20:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:20:59.306088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0118f3-c421-49cc-bd00-67467e273c1f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:59.412558 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0118f3-c421-49cc-bd00-67467e273c1f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:59.448276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd6da7-6124-488f-a5bb-bbea6c4a796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:59.450271 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd6da7-6124-488f-a5bb-bbea6c4a796a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:59.450580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd6da7-6124-488f-a5bb-bbea6c4a796a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:59.450853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd6da7-6124-488f-a5bb-bbea6c4a796a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:59.461383 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd6da7-6124-488f-a5bb-bbea6c4a796a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-26fd6da7-6124-488f-a5bb-bbea6c4a796a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:20:59.469611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:20:59.476743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:20:59.478747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:20:59.478747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:20:59.478747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:20:59.478747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:20:59.478747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:20:59.478747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:20:59.478747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:20:59.478747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:20:59.478747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:20:59.478747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:20:59.478747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:20:59.478747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:20:59.478747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 553/1080] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:20:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:20:59.481030 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bc5a1-51b1-47ca-8804-82225d53bf34 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:59.582292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bc5a1-51b1-47ca-8804-82225d53bf34 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:59.619180 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c659f73-5ced-483f-88bc-f5825baba12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:59.619854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c659f73-5ced-483f-88bc-f5825baba12b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:59.620139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c659f73-5ced-483f-88bc-f5825baba12b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:59.620570 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c659f73-5ced-483f-88bc-f5825baba12b None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:59.621338 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c659f73-5ced-483f-88bc-f5825baba12b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:20:59.621637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c659f73-5ced-483f-88bc-f5825baba12b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:59.623047 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c659f73-5ced-483f-88bc-f5825baba12b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:59.631636 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 528/1081] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:20:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:20:59.638538 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd6da7-6124-488f-a5bb-bbea6c4a796a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:59.692917 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:59.784817 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd6da7-6124-488f-a5bb-bbea6c4a796a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:20:59.795785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6587fd-5dc7-41a7-9d5c-929df5f77920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:20:59.796677 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6587fd-5dc7-41a7-9d5c-929df5f77920 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:20:59.796951 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6587fd-5dc7-41a7-9d5c-929df5f77920 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:20:59.797237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6587fd-5dc7-41a7-9d5c-929df5f77920 None admin] PATH_INFO: `/v3/users/710428ab24224b6991c5080fdbbe6a8e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:20:59.799365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6587fd-5dc7-41a7-9d5c-929df5f77920 None admin] RBAC: Authorizing `identity:get_user(user_id=710428ab24224b6991c5080fdbbe6a8e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:20:59.800144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6587fd-5dc7-41a7-9d5c-929df5f77920 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:20:59.807575 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 554/1082] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:20:59 2022] GET /identity/v3/users/710428ab24224b6991c5080fdbbe6a8e => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:20:59.810236 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c659f73-5ced-483f-88bc-f5825baba12b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:20:59.869502 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:20:59.972594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c659f73-5ced-483f-88bc-f5825baba12b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:00.014547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16d08d-2e58-457e-aa27-e77787ae3fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:00.015408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16d08d-2e58-457e-aa27-e77787ae3fcb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:00.015748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16d08d-2e58-457e-aa27-e77787ae3fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:00.016081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16d08d-2e58-457e-aa27-e77787ae3fcb None admin] PATH_INFO: `/v3/projects/0f08796900fd45d99c86e9e8ff2778e6` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:00.017330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16d08d-2e58-457e-aa27-e77787ae3fcb None admin] RBAC: Authorizing `identity:get_project(project_id=0f08796900fd45d99c86e9e8ff2778e6)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:00.018891 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16d08d-2e58-457e-aa27-e77787ae3fcb None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:00.020694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 529/1083] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:20:59 2022] GET /identity/v3/projects/0f08796900fd45d99c86e9e8ff2778e6 => generated 311 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:00.028417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6587fd-5dc7-41a7-9d5c-929df5f77920 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:00.147652 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6587fd-5dc7-41a7-9d5c-929df5f77920 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:00.166904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:00.185686 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98172f-3dd4-4d29-a7e4-1c26f432d241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:00.186734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98172f-3dd4-4d29-a7e4-1c26f432d241 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:00.186891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98172f-3dd4-4d29-a7e4-1c26f432d241 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:00.187107 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98172f-3dd4-4d29-a7e4-1c26f432d241 None admin] PATH_INFO: `/v3/projects/0f08796900fd45d99c86e9e8ff2778e6/users/710428ab24224b6991c5080fdbbe6a8e/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:00.189343 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98172f-3dd4-4d29-a7e4-1c26f432d241 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f08796900fd45d99c86e9e8ff2778e6, user_id=710428ab24224b6991c5080fdbbe6a8e, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:00.192734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98172f-3dd4-4d29-a7e4-1c26f432d241 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:00.210094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ef93d-8764-435e-bfaa-818de84c65b0 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:00.210692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ef93d-8764-435e-bfaa-818de84c65b0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:00.210840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ef93d-8764-435e-bfaa-818de84c65b0 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:00.212191 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 530/1084] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:00.217929 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbfc74-2aee-4dff-a398-8199e96b6f44 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:00.218206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbfc74-2aee-4dff-a398-8199e96b6f44 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:00.218503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbfc74-2aee-4dff-a398-8199e96b6f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:00.237008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2bfbfc74-2aee-4dff-a398-8199e96b6f44 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:00.238229 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2bfbfc74-2aee-4dff-a398-8199e96b6f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:00.271068 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 555/1085] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:21:00 2022] PUT /identity/v3/projects/0f08796900fd45d99c86e9e8ff2778e6/users/710428ab24224b6991c5080fdbbe6a8e/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:21:00.317625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 531/1086] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:21:00.342612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98172f-3dd4-4d29-a7e4-1c26f432d241 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:00.461970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98172f-3dd4-4d29-a7e4-1c26f432d241 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:00.499634 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b1a06-07fc-470b-844c-a62bad8ed2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:00.500450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b1a06-07fc-470b-844c-a62bad8ed2fb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:00.500734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b1a06-07fc-470b-844c-a62bad8ed2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:00.501012 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b1a06-07fc-470b-844c-a62bad8ed2fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:00.512671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b1a06-07fc-470b-844c-a62bad8ed2fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-2d4b1a06-07fc-470b-844c-a62bad8ed2fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:21:00.521140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:21:00.523063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:21:00.524898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:21:00.524898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:21:00.524898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:21:00.524898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:21:00.524898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:21:00.524898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:21:00.524898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:21:00.524898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:21:00.524898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:21:00.524898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:21:00.524898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:21:00.524898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:21:00.527169 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 556/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 18 10:21:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:21:00.529146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbfc74-2aee-4dff-a398-8199e96b6f44 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:00.561699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:00.635213 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbfc74-2aee-4dff-a398-8199e96b6f44 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:00.672165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d6241-4642-4530-89d3-d99b44a2be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:00.672844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d6241-4642-4530-89d3-d99b44a2be2e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:00.673129 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d6241-4642-4530-89d3-d99b44a2be2e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:00.673493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d6241-4642-4530-89d3-d99b44a2be2e None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:00.674191 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d6241-4642-4530-89d3-d99b44a2be2e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:00.674552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d6241-4642-4530-89d3-d99b44a2be2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:00.675937 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d6241-4642-4530-89d3-d99b44a2be2e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:00.685721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 532/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 18 10:21:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:00.691635 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b1a06-07fc-470b-844c-a62bad8ed2fb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:00.735533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:00.801870 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b1a06-07fc-470b-844c-a62bad8ed2fb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:00.837734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27dadb-dd27-4152-b0b1-43392343a571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:00.838551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27dadb-dd27-4152-b0b1-43392343a571 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:00.838835 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27dadb-dd27-4152-b0b1-43392343a571 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:00.839676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27dadb-dd27-4152-b0b1-43392343a571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:00.850858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27dadb-dd27-4152-b0b1-43392343a571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:00.852419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27dadb-dd27-4152-b0b1-43392343a571 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:00.872669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-8d27dadb-dd27-4152-b0b1-43392343a571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:21:00.872669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:21:00.872669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:21:00.872669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:21:00.872669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:21:00.872669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:21:00.872669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:21:00.872669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:21:00.872669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:21:00.872669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:21:00.872669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:21:00.872669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:21:00.872669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:21:00.872669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:21:00.872669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:21:00.873735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:21:00.874695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:21:00.874695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:21:00.874695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:21:00.874695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:21:00.874695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 557/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:21:00.880295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d6241-4642-4530-89d3-d99b44a2be2e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:00.984870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:00.991695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d6241-4642-4530-89d3-d99b44a2be2e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:01.030540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb9950-fbf8-4a6f-8bfb-885f1efb4c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:01.031316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb9950-fbf8-4a6f-8bfb-885f1efb4c57 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:01.031499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb9950-fbf8-4a6f-8bfb-885f1efb4c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:01.031775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb9950-fbf8-4a6f-8bfb-885f1efb4c57 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:01.032504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb9950-fbf8-4a6f-8bfb-885f1efb4c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:01.032812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb9950-fbf8-4a6f-8bfb-885f1efb4c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:01.034200 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb9950-fbf8-4a6f-8bfb-885f1efb4c57 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:01.047222 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 533/1090] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:01.053101 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27dadb-dd27-4152-b0b1-43392343a571 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:01.151073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:01.163491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27dadb-dd27-4152-b0b1-43392343a571 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:01.199962 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1da321-4a2c-469e-a7ef-5b63c54f93b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:01.200803 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1da321-4a2c-469e-a7ef-5b63c54f93b6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:01.201087 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1da321-4a2c-469e-a7ef-5b63c54f93b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:01.201364 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1da321-4a2c-469e-a7ef-5b63c54f93b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:01.209417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1da321-4a2c-469e-a7ef-5b63c54f93b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:01.210914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1da321-4a2c-469e-a7ef-5b63c54f93b6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-af1da321-4a2c-469e-a7ef-5b63c54f93b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:21:01.226788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:21:01.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:21:01.231321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:21:01.231321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:21:01.231321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:21:01.231321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:21:01.231321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:21:01.231321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:21:01.231321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:21:01.231321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:21:01.231321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:21:01.231321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:21:01.231321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 558/1091] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 18 10:21:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:21:01.235848 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb9950-fbf8-4a6f-8bfb-885f1efb4c57 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:01.345227 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb9950-fbf8-4a6f-8bfb-885f1efb4c57 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:01.382618 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88c763-abc8-43d9-bc02-e22f2cc94eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:01.383556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88c763-abc8-43d9-bc02-e22f2cc94eef None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:01.383832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88c763-abc8-43d9-bc02-e22f2cc94eef None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:01.384630 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88c763-abc8-43d9-bc02-e22f2cc94eef None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:01.387337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88c763-abc8-43d9-bc02-e22f2cc94eef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:01.387600 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88c763-abc8-43d9-bc02-e22f2cc94eef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:01.389393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88c763-abc8-43d9-bc02-e22f2cc94eef None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:01.414725 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 534/1092] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 18 10:21:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:21:01.422267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1da321-4a2c-469e-a7ef-5b63c54f93b6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:01.575003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1da321-4a2c-469e-a7ef-5b63c54f93b6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:01.625606 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb56de-b1b6-4ac6-ac86-06082a11fe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:01.626495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb56de-b1b6-4ac6-ac86-06082a11fe58 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:01.626942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb56de-b1b6-4ac6-ac86-06082a11fe58 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:01.627356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb56de-b1b6-4ac6-ac86-06082a11fe58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:01.655260 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:01.717419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb56de-b1b6-4ac6-ac86-06082a11fe58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:01.718943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb56de-b1b6-4ac6-ac86-06082a11fe58 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:01.822533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 559/1093] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:21:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:21:01.829461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88c763-abc8-43d9-bc02-e22f2cc94eef None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:01.846585 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:01.939460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88c763-abc8-43d9-bc02-e22f2cc94eef None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:01.982070 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac0f4a-4979-42df-a0d6-4e26e3e5628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:01.983001 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac0f4a-4979-42df-a0d6-4e26e3e5628d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:01.983352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac0f4a-4979-42df-a0d6-4e26e3e5628d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:01.983692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac0f4a-4979-42df-a0d6-4e26e3e5628d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:01.994905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac0f4a-4979-42df-a0d6-4e26e3e5628d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:01.996928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac0f4a-4979-42df-a0d6-4e26e3e5628d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:02.015551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-1bac0f4a-4979-42df-a0d6-4e26e3e5628d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:21:02.015551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:21:02.015551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:21:02.015551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:21:02.015551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:21:02.015551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:21:02.015551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:21:02.015551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:21:02.015551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:21:02.015551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:21:02.015551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:21:02.015551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:21:02.015551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:21:02.015551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:21:02.015551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:21:02.017281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:21:02.018441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:21:02.018441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:21:02.018441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:21:02.018441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:21:02.018441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 535/1094] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:21:02.022629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb56de-b1b6-4ac6-ac86-06082a11fe58 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:02.076319 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:02.130123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb56de-b1b6-4ac6-ac86-06082a11fe58 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:02.165799 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4755d-559c-4ea0-a74b-c3eac50e4288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:02.166503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4755d-559c-4ea0-a74b-c3eac50e4288 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:02.166789 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4755d-559c-4ea0-a74b-c3eac50e4288 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:02.167063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4755d-559c-4ea0-a74b-c3eac50e4288 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:02.168431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4755d-559c-4ea0-a74b-c3eac50e4288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:02.168737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4755d-559c-4ea0-a74b-c3eac50e4288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:02.170121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4755d-559c-4ea0-a74b-c3eac50e4288 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:02.182705 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 560/1095] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:02.188740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac0f4a-4979-42df-a0d6-4e26e3e5628d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:02.255180 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:02.297531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac0f4a-4979-42df-a0d6-4e26e3e5628d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:02.333883 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d031cd7-7382-4009-baa0-8a57de28291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:02.334739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d031cd7-7382-4009-baa0-8a57de28291e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:02.335025 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d031cd7-7382-4009-baa0-8a57de28291e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:02.335304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d031cd7-7382-4009-baa0-8a57de28291e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:02.342774 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d031cd7-7382-4009-baa0-8a57de28291e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:02.344245 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d031cd7-7382-4009-baa0-8a57de28291e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:02.359355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-0d031cd7-7382-4009-baa0-8a57de28291e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:21:02.359355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:21:02.359355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:21:02.359355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:21:02.359355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:21:02.359355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:21:02.359355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:21:02.359355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:21:02.359355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:21:02.359355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:21:02.359355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:21:02.359355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:21:02.359355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:21:02.359355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:21:02.359355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:21:02.361215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:21:02.363042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:21:02.363042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:21:02.363042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:21:02.363042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:21:02.363042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:21:02.363042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:21:02.363042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:21:02.363042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:21:02.366127 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 536/1096] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:21:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:21:02.367216 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4755d-559c-4ea0-a74b-c3eac50e4288 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:02.375131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8904f1e-43e5-45f7-8921-37e987268e82 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:02.375423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8904f1e-43e5-45f7-8921-37e987268e82 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:02.375699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8904f1e-43e5-45f7-8921-37e987268e82 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:02.377103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 537/1097] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:21:02.383233 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dae62a-8056-4a7e-ac53-f0afa3c24c68 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:02.383505 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dae62a-8056-4a7e-ac53-f0afa3c24c68 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:02.383782 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dae62a-8056-4a7e-ac53-f0afa3c24c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:02.402100 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-27dae62a-8056-4a7e-ac53-f0afa3c24c68 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:02.403379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-27dae62a-8056-4a7e-ac53-f0afa3c24c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:02.479124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4755d-559c-4ea0-a74b-c3eac50e4288 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:02.481482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 538/1098] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:21:02.491217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:02.505493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dae62a-8056-4a7e-ac53-f0afa3c24c68 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:02.517135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3c2b5-6d23-4e5b-b88d-79efca3c7542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:02.517789 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3c2b5-6d23-4e5b-b88d-79efca3c7542 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:02.518063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3c2b5-6d23-4e5b-b88d-79efca3c7542 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:02.518351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3c2b5-6d23-4e5b-b88d-79efca3c7542 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:02.519142 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3c2b5-6d23-4e5b-b88d-79efca3c7542 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:02.519445 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3c2b5-6d23-4e5b-b88d-79efca3c7542 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:02.520886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3c2b5-6d23-4e5b-b88d-79efca3c7542 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:02.533604 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 561/1099] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:21:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:02.540041 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3c2b5-6d23-4e5b-b88d-79efca3c7542 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:02.569510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:02.617892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dae62a-8056-4a7e-ac53-f0afa3c24c68 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:02.657043 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b17075-22f4-40b7-ba8c-738d2bdc1f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:02.657921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b17075-22f4-40b7-ba8c-738d2bdc1f5d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:02.658353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b17075-22f4-40b7-ba8c-738d2bdc1f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:02.658757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b17075-22f4-40b7-ba8c-738d2bdc1f5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:02.668553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3c2b5-6d23-4e5b-b88d-79efca3c7542 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:02.670686 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b17075-22f4-40b7-ba8c-738d2bdc1f5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-13b17075-22f4-40b7-ba8c-738d2bdc1f5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:21:02.678468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:21:02.680372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:21:02.682029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:21:02.682029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:21:02.682029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:21:02.682029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:21:02.682029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:21:02.682029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:21:02.682029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:21:02.682029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:21:02.682029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:21:02.682029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:21:02.682029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:21:02.682029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:21:02.682029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 539/1100] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:21:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:21:02.688174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b17075-22f4-40b7-ba8c-738d2bdc1f5d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:02.719020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19620c7b-0d59-4664-a85b-454c73ff3c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:02.719664 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19620c7b-0d59-4664-a85b-454c73ff3c4a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:02.719940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19620c7b-0d59-4664-a85b-454c73ff3c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:02.720209 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19620c7b-0d59-4664-a85b-454c73ff3c4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:02.721040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19620c7b-0d59-4664-a85b-454c73ff3c4a None admin] RBAC: Adding query filter params (role.id=bcef1c0f49bf4bd5a5946b34ab8ba902, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=f7abf6b71ac3454ca547a750cef9220a) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:02.721353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19620c7b-0d59-4664-a85b-454c73ff3c4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:02.722825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19620c7b-0d59-4664-a85b-454c73ff3c4a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:02.729153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 562/1101] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:21:02 2022] GET /identity/v3/role_assignments?user.id=f7abf6b71ac3454ca547a750cef9220a&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=bcef1c0f49bf4bd5a5946b34ab8ba902 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:21:02.810119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b17075-22f4-40b7-ba8c-738d2bdc1f5d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:02.826162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:02.849386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8f3da-83ae-4506-b30c-430bcc5a6ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:02.850075 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8f3da-83ae-4506-b30c-430bcc5a6ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:02.850398 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8f3da-83ae-4506-b30c-430bcc5a6ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:02.850680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8f3da-83ae-4506-b30c-430bcc5a6ca6 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:02.851450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8f3da-83ae-4506-b30c-430bcc5a6ca6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:02.851759 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8f3da-83ae-4506-b30c-430bcc5a6ca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:02.853184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8f3da-83ae-4506-b30c-430bcc5a6ca6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:02.863821 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 540/1102] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:21:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:21:02.869757 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19620c7b-0d59-4664-a85b-454c73ff3c4a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:02.910759 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:02.989259 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19620c7b-0d59-4664-a85b-454c73ff3c4a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:03.026316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4e407-3c10-4430-be9c-50ff3c27aad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:03.028002 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4e407-3c10-4430-be9c-50ff3c27aad2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:03.028410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4e407-3c10-4430-be9c-50ff3c27aad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:03.028686 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4e407-3c10-4430-be9c-50ff3c27aad2 None admin] PATH_INFO: `/v3/users/710428ab24224b6991c5080fdbbe6a8e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:03.029930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4e407-3c10-4430-be9c-50ff3c27aad2 None admin] RBAC: Authorizing `identity:get_user(user_id=710428ab24224b6991c5080fdbbe6a8e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:03.031421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4e407-3c10-4430-be9c-50ff3c27aad2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:03.033071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 563/1103] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:21:02 2022] GET /identity/v3/users/710428ab24224b6991c5080fdbbe6a8e => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:03.039121 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8f3da-83ae-4506-b30c-430bcc5a6ca6 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:03.160047 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8f3da-83ae-4506-b30c-430bcc5a6ca6 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:03.219393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8152a15-ce28-45bb-b5b9-b801ae7ddee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:03.220517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8152a15-ce28-45bb-b5b9-b801ae7ddee1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:03.221024 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8152a15-ce28-45bb-b5b9-b801ae7ddee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:03.221507 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8152a15-ce28-45bb-b5b9-b801ae7ddee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:03.286954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:03.320258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8152a15-ce28-45bb-b5b9-b801ae7ddee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:03.321846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8152a15-ce28-45bb-b5b9-b801ae7ddee1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:03.442831 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 541/1104] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:21:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 10:21:03.449749 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4e407-3c10-4430-be9c-50ff3c27aad2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:03.570644 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4e407-3c10-4430-be9c-50ff3c27aad2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:03.572349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:03.614153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f71f7-8a5d-4fe0-af0e-5e339ed18fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:03.615168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f71f7-8a5d-4fe0-af0e-5e339ed18fad None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:03.615504 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f71f7-8a5d-4fe0-af0e-5e339ed18fad None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:03.615833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f71f7-8a5d-4fe0-af0e-5e339ed18fad None admin] PATH_INFO: `/v3/projects/0f08796900fd45d99c86e9e8ff2778e6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:03.617482 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f71f7-8a5d-4fe0-af0e-5e339ed18fad None admin] RBAC: Authorizing `identity:get_project(project_id=0f08796900fd45d99c86e9e8ff2778e6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:03.619295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f71f7-8a5d-4fe0-af0e-5e339ed18fad None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:03.623531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 564/1105] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:21:03 2022] GET /identity/v3/projects/0f08796900fd45d99c86e9e8ff2778e6 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:03.633250 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8152a15-ce28-45bb-b5b9-b801ae7ddee1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:03.740540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:03.768054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8152a15-ce28-45bb-b5b9-b801ae7ddee1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:03.806187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776cccd-0004-4856-be9e-d97f1392a627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:03.806861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776cccd-0004-4856-be9e-d97f1392a627 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:03.807139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776cccd-0004-4856-be9e-d97f1392a627 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:03.807411 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776cccd-0004-4856-be9e-d97f1392a627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:03.808421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776cccd-0004-4856-be9e-d97f1392a627 None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=0f08796900fd45d99c86e9e8ff2778e6, user.id=710428ab24224b6991c5080fdbbe6a8e) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:03.808738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776cccd-0004-4856-be9e-d97f1392a627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:03.810168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776cccd-0004-4856-be9e-d97f1392a627 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:03.816224 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 542/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:21:03 2022] GET /identity/v3/role_assignments?user.id=710428ab24224b6991c5080fdbbe6a8e&scope.project.id=0f08796900fd45d99c86e9e8ff2778e6&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:05.989516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d8b2d-0bf3-4773-acaa-727953d75151 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:05.990029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d8b2d-0bf3-4773-acaa-727953d75151 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:05.990220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d8b2d-0bf3-4773-acaa-727953d75151 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:05.991479 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 565/1107] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:05.997023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e347c9-25c9-4dd5-a90a-dbba4d9fe733 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:05.997469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e347c9-25c9-4dd5-a90a-dbba4d9fe733 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:05.997570 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e347c9-25c9-4dd5-a90a-dbba4d9fe733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:06.014181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b6e347c9-25c9-4dd5-a90a-dbba4d9fe733 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:06.015389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b6e347c9-25c9-4dd5-a90a-dbba4d9fe733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:06.081738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 543/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:21:06.107138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d8b2d-0bf3-4773-acaa-727953d75151 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:06.216357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d8b2d-0bf3-4773-acaa-727953d75151 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:06.250588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b5415-c847-4791-a8f4-9436ec40f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:06.251379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5415-c847-4791-a8f4-9436ec40f5ed None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:06.251663 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5415-c847-4791-a8f4-9436ec40f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:06.251943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5415-c847-4791-a8f4-9436ec40f5ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:06.253118 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b5415-c847-4791-a8f4-9436ec40f5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:06.254583 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b5415-c847-4791-a8f4-9436ec40f5ed None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:06.256211 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 566/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:21:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:06.262987 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e347c9-25c9-4dd5-a90a-dbba4d9fe733 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:06.335750 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:06.369841 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e347c9-25c9-4dd5-a90a-dbba4d9fe733 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:06.408107 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24393ff0-1e20-4d89-b8c5-6eae2bca9fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:06.408788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24393ff0-1e20-4d89-b8c5-6eae2bca9fce None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:06.409073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24393ff0-1e20-4d89-b8c5-6eae2bca9fce None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:06.409347 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24393ff0-1e20-4d89-b8c5-6eae2bca9fce None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:06.410070 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24393ff0-1e20-4d89-b8c5-6eae2bca9fce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:06.411559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24393ff0-1e20-4d89-b8c5-6eae2bca9fce None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:06.534389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 544/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:21:06 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:21:08.651579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb337fc-b6ee-4587-bf42-2f068a98848f None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:08.652311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb337fc-b6ee-4587-bf42-2f068a98848f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:08.652311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb337fc-b6ee-4587-bf42-2f068a98848f None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:08.654263 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 567/1111] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:08.662918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad01a9-be43-4409-9c66-dfeebaf1920e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:08.663442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad01a9-be43-4409-9c66-dfeebaf1920e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:08.663556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad01a9-be43-4409-9c66-dfeebaf1920e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:08.682134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b0ad01a9-be43-4409-9c66-dfeebaf1920e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:08.684397 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b0ad01a9-be43-4409-9c66-dfeebaf1920e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:08.762104 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 545/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:21:08.786624 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb337fc-b6ee-4587-bf42-2f068a98848f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:08.837596 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:08.920062 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb337fc-b6ee-4587-bf42-2f068a98848f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:08.965526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5bf7a-84bb-4813-ad30-dc65e87f83d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:08.966461 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5bf7a-84bb-4813-ad30-dc65e87f83d5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:08.966743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5bf7a-84bb-4813-ad30-dc65e87f83d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:08.967071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5bf7a-84bb-4813-ad30-dc65e87f83d5 None admin] PATH_INFO: `/v3/roles/575c54955d4a474e9c687a0100991d1d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:08.968863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5bf7a-84bb-4813-ad30-dc65e87f83d5 None admin] RBAC: Authorizing `identity:get_role(role_id=575c54955d4a474e9c687a0100991d1d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:08.970261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5bf7a-84bb-4813-ad30-dc65e87f83d5 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:08.971924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 568/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:21:08 2022] GET /identity/v3/roles/575c54955d4a474e9c687a0100991d1d => generated 223 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:08.978799 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad01a9-be43-4409-9c66-dfeebaf1920e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:09.047197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:09.101078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad01a9-be43-4409-9c66-dfeebaf1920e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:09.143076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e493f-9ef9-441c-a013-9fcf71da41fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:09.143946 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e493f-9ef9-441c-a013-9fcf71da41fb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:09.144220 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e493f-9ef9-441c-a013-9fcf71da41fb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:09.144489 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e493f-9ef9-441c-a013-9fcf71da41fb None admin] PATH_INFO: `/v3/users/6d7fbdaed08a4bb48948acd8d0b52cfb` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:09.163534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e493f-9ef9-441c-a013-9fcf71da41fb None admin] RBAC: Authorizing `identity:get_user(user_id=6d7fbdaed08a4bb48948acd8d0b52cfb)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:09.164990 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e493f-9ef9-441c-a013-9fcf71da41fb None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:09.167132 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 546/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:21:08 2022] GET /identity/v3/users/6d7fbdaed08a4bb48948acd8d0b52cfb => generated 286 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:09.173391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5bf7a-84bb-4813-ad30-dc65e87f83d5 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:09.316307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5bf7a-84bb-4813-ad30-dc65e87f83d5 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:09.331270 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:09.361599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c0846-4b6d-4722-8d25-957d3fc84185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:09.362230 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c0846-4b6d-4722-8d25-957d3fc84185 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:09.362536 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c0846-4b6d-4722-8d25-957d3fc84185 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:09.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c0846-4b6d-4722-8d25-957d3fc84185 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:09.460495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c0846-4b6d-4722-8d25-957d3fc84185 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:09.462834 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c0846-4b6d-4722-8d25-957d3fc84185 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:09.602686 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 569/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:21:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 10:21:09.609982 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e493f-9ef9-441c-a013-9fcf71da41fb None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:09.724323 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e493f-9ef9-441c-a013-9fcf71da41fb None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:09.740296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:09.763426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1c02b-f938-4f44-8dab-c7adef3c59e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:09.764504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1c02b-f938-4f44-8dab-c7adef3c59e7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:09.764781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1c02b-f938-4f44-8dab-c7adef3c59e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:09.765056 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1c02b-f938-4f44-8dab-c7adef3c59e7 None admin] PATH_INFO: `/v3/projects/0f08796900fd45d99c86e9e8ff2778e6` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:09.766440 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1c02b-f938-4f44-8dab-c7adef3c59e7 None admin] RBAC: Authorizing `identity:get_project(project_id=0f08796900fd45d99c86e9e8ff2778e6)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:09.767988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1c02b-f938-4f44-8dab-c7adef3c59e7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:09.770582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 547/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:21:09 2022] GET /identity/v3/projects/0f08796900fd45d99c86e9e8ff2778e6 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:09.778544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c0846-4b6d-4722-8d25-957d3fc84185 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:09.786936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:09.902278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c0846-4b6d-4722-8d25-957d3fc84185 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:09.938344 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a2a6c-ca66-44f2-b7af-38c981c5d707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:09.939017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a2a6c-ca66-44f2-b7af-38c981c5d707 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:09.939296 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a2a6c-ca66-44f2-b7af-38c981c5d707 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:09.939565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a2a6c-ca66-44f2-b7af-38c981c5d707 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:09.940387 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a2a6c-ca66-44f2-b7af-38c981c5d707 None admin] RBAC: Adding query filter params (role.id=575c54955d4a474e9c687a0100991d1d, scope.project.id=0f08796900fd45d99c86e9e8ff2778e6, user.id=6d7fbdaed08a4bb48948acd8d0b52cfb) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:09.940690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a2a6c-ca66-44f2-b7af-38c981c5d707 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:09.942130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a2a6c-ca66-44f2-b7af-38c981c5d707 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:09.947889 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 570/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:21:09 2022] GET /identity/v3/role_assignments?user.id=6d7fbdaed08a4bb48948acd8d0b52cfb&scope.project.id=0f08796900fd45d99c86e9e8ff2778e6&role.id=575c54955d4a474e9c687a0100991d1d => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:21:12.084216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d3ac9-5b0d-4999-8cfa-a9e4069760ed None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:12.084774 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d3ac9-5b0d-4999-8cfa-a9e4069760ed None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:12.084774 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d3ac9-5b0d-4999-8cfa-a9e4069760ed None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:12.086173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 548/1118] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:12.092088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6434e5-b1fe-4fa6-af63-446bbd38cb95 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:12.092525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6434e5-b1fe-4fa6-af63-446bbd38cb95 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:12.092624 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6434e5-b1fe-4fa6-af63-446bbd38cb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:12.110535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2a6434e5-b1fe-4fa6-af63-446bbd38cb95 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:12.111724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2a6434e5-b1fe-4fa6-af63-446bbd38cb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:12.174689 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:12.179329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 571/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:21:12.202688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d3ac9-5b0d-4999-8cfa-a9e4069760ed None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:12.306812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d3ac9-5b0d-4999-8cfa-a9e4069760ed None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:12.344539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b28fa-3064-423a-bb3b-5d460921e827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:12.346138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b28fa-3064-423a-bb3b-5d460921e827 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:12.347458 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b28fa-3064-423a-bb3b-5d460921e827 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:12.347735 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b28fa-3064-423a-bb3b-5d460921e827 None admin] PATH_INFO: `/v3/roles/575c54955d4a474e9c687a0100991d1d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:12.349199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b28fa-3064-423a-bb3b-5d460921e827 None admin] RBAC: Authorizing `identity:get_role(role_id=575c54955d4a474e9c687a0100991d1d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:12.350590 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b28fa-3064-423a-bb3b-5d460921e827 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:12.351969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 549/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:21:12 2022] GET /identity/v3/roles/575c54955d4a474e9c687a0100991d1d => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:12.358078 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6434e5-b1fe-4fa6-af63-446bbd38cb95 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:12.459597 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6434e5-b1fe-4fa6-af63-446bbd38cb95 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:12.494032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872adc1b-ec96-4d0d-af90-ef449b66ec0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:12.494916 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872adc1b-ec96-4d0d-af90-ef449b66ec0a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:12.495739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872adc1b-ec96-4d0d-af90-ef449b66ec0a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:12.496022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872adc1b-ec96-4d0d-af90-ef449b66ec0a None admin] PATH_INFO: `/v3/users/6d7fbdaed08a4bb48948acd8d0b52cfb` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:12.497373 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872adc1b-ec96-4d0d-af90-ef449b66ec0a None admin] RBAC: Authorizing `identity:get_user(user_id=6d7fbdaed08a4bb48948acd8d0b52cfb)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:12.498849 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872adc1b-ec96-4d0d-af90-ef449b66ec0a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:12.500480 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 572/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:21:12 2022] GET /identity/v3/users/6d7fbdaed08a4bb48948acd8d0b52cfb => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:12.506541 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b28fa-3064-423a-bb3b-5d460921e827 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:12.559499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:12.610313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b28fa-3064-423a-bb3b-5d460921e827 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:12.651589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa77f1-afe2-4de0-bbb9-e902fa3c24cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:12.652452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa77f1-afe2-4de0-bbb9-e902fa3c24cf None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:12.652728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa77f1-afe2-4de0-bbb9-e902fa3c24cf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:12.652998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa77f1-afe2-4de0-bbb9-e902fa3c24cf None admin] PATH_INFO: `/v3/projects/0f08796900fd45d99c86e9e8ff2778e6` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:12.654198 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa77f1-afe2-4de0-bbb9-e902fa3c24cf None admin] RBAC: Authorizing `identity:get_project(project_id=0f08796900fd45d99c86e9e8ff2778e6)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:12.655704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa77f1-afe2-4de0-bbb9-e902fa3c24cf None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:12.657422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 550/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:21:12 2022] GET /identity/v3/projects/0f08796900fd45d99c86e9e8ff2778e6 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:12.663507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872adc1b-ec96-4d0d-af90-ef449b66ec0a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:12.736891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:12.774240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872adc1b-ec96-4d0d-af90-ef449b66ec0a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:12.810362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774d06e-5cc1-4e39-a27b-b7e5a9812d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:12.811168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774d06e-5cc1-4e39-a27b-b7e5a9812d70 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:12.811445 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774d06e-5cc1-4e39-a27b-b7e5a9812d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:12.811718 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774d06e-5cc1-4e39-a27b-b7e5a9812d70 None admin] PATH_INFO: `/v3/projects/0f08796900fd45d99c86e9e8ff2778e6/users/6d7fbdaed08a4bb48948acd8d0b52cfb/roles/575c54955d4a474e9c687a0100991d1d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:12.813953 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774d06e-5cc1-4e39-a27b-b7e5a9812d70 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f08796900fd45d99c86e9e8ff2778e6, user_id=6d7fbdaed08a4bb48948acd8d0b52cfb, role_id=575c54955d4a474e9c687a0100991d1d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:12.815415 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774d06e-5cc1-4e39-a27b-b7e5a9812d70 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:12.922681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 573/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:21:12 2022] PUT /identity/v3/projects/0f08796900fd45d99c86e9e8ff2778e6/users/6d7fbdaed08a4bb48948acd8d0b52cfb/roles/575c54955d4a474e9c687a0100991d1d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:21:14.983686 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107c2f-65fe-4682-9f1b-4df547686ee4 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:14.984215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107c2f-65fe-4682-9f1b-4df547686ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:14.984215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107c2f-65fe-4682-9f1b-4df547686ee4 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:14.985611 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 551/1124] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:14.991719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce06b-003d-400e-8b07-817ec2a99fc0 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:14.992135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce06b-003d-400e-8b07-817ec2a99fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:14.992281 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce06b-003d-400e-8b07-817ec2a99fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:15.009940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-dabce06b-003d-400e-8b07-817ec2a99fc0 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:15.011785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dabce06b-003d-400e-8b07-817ec2a99fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:15.083724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 574/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:21:15.107924 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc107c2f-65fe-4682-9f1b-4df547686ee4 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:15.213911 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc107c2f-65fe-4682-9f1b-4df547686ee4 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:15.235152 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:15.252707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c9410-e0c9-47c1-8f03-b819ad3c37d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:15.253650 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c9410-e0c9-47c1-8f03-b819ad3c37d2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:15.253963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c9410-e0c9-47c1-8f03-b819ad3c37d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:15.254240 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c9410-e0c9-47c1-8f03-b819ad3c37d2 None admin] PATH_INFO: `/v3/roles/575c54955d4a474e9c687a0100991d1d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:15.255736 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c9410-e0c9-47c1-8f03-b819ad3c37d2 None admin] RBAC: Authorizing `identity:get_role(role_id=575c54955d4a474e9c687a0100991d1d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:15.257105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c9410-e0c9-47c1-8f03-b819ad3c37d2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:15.258791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 552/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:21:15 2022] GET /identity/v3/roles/575c54955d4a474e9c687a0100991d1d => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:15.265109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabce06b-003d-400e-8b07-817ec2a99fc0 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:15.323770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:15.367025 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabce06b-003d-400e-8b07-817ec2a99fc0 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:15.403347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1050f8-f606-43b0-9fbc-a634d9484bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:15.404217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1050f8-f606-43b0-9fbc-a634d9484bcf None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:15.404500 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1050f8-f606-43b0-9fbc-a634d9484bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:15.404777 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1050f8-f606-43b0-9fbc-a634d9484bcf None admin] PATH_INFO: `/v3/users/6d7fbdaed08a4bb48948acd8d0b52cfb` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:15.405974 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1050f8-f606-43b0-9fbc-a634d9484bcf None admin] RBAC: Authorizing `identity:get_user(user_id=6d7fbdaed08a4bb48948acd8d0b52cfb)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:15.407501 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1050f8-f606-43b0-9fbc-a634d9484bcf None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:15.409202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 575/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:21:15 2022] GET /identity/v3/users/6d7fbdaed08a4bb48948acd8d0b52cfb => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:15.415510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c9410-e0c9-47c1-8f03-b819ad3c37d2 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:15.524184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c9410-e0c9-47c1-8f03-b819ad3c37d2 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:15.558949 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80143aa7-e3f2-4ca0-a3f1-f13a1fad47b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:15.559615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80143aa7-e3f2-4ca0-a3f1-f13a1fad47b4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:15.559897 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80143aa7-e3f2-4ca0-a3f1-f13a1fad47b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:15.560172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80143aa7-e3f2-4ca0-a3f1-f13a1fad47b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:15.623252 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:15.637665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80143aa7-e3f2-4ca0-a3f1-f13a1fad47b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:15.639167 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80143aa7-e3f2-4ca0-a3f1-f13a1fad47b4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:15.745460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 553/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:21:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:21:15.751469 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1050f8-f606-43b0-9fbc-a634d9484bcf None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:15.854162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1050f8-f606-43b0-9fbc-a634d9484bcf None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:15.879522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:15.888216 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b805a6a-b6c1-4730-a230-2965374426bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:15.889065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b805a6a-b6c1-4730-a230-2965374426bd None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:15.889340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b805a6a-b6c1-4730-a230-2965374426bd None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:15.889610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b805a6a-b6c1-4730-a230-2965374426bd None admin] PATH_INFO: `/v3/projects/0f08796900fd45d99c86e9e8ff2778e6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:15.890796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b805a6a-b6c1-4730-a230-2965374426bd None admin] RBAC: Authorizing `identity:get_project(project_id=0f08796900fd45d99c86e9e8ff2778e6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:15.892221 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b805a6a-b6c1-4730-a230-2965374426bd None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:15.893896 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 576/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:21:15 2022] GET /identity/v3/projects/0f08796900fd45d99c86e9e8ff2778e6 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:15.900340 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80143aa7-e3f2-4ca0-a3f1-f13a1fad47b4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:15.984142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:15.999211 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80143aa7-e3f2-4ca0-a3f1-f13a1fad47b4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:16.033275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00bd4f-e042-4281-a0bd-84bb62bcd095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:16.033913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00bd4f-e042-4281-a0bd-84bb62bcd095 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:16.034193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00bd4f-e042-4281-a0bd-84bb62bcd095 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:16.034498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00bd4f-e042-4281-a0bd-84bb62bcd095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:16.035314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00bd4f-e042-4281-a0bd-84bb62bcd095 None admin] RBAC: Adding query filter params (role.id=575c54955d4a474e9c687a0100991d1d, scope.project.id=0f08796900fd45d99c86e9e8ff2778e6, user.id=6d7fbdaed08a4bb48948acd8d0b52cfb) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:16.035622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00bd4f-e042-4281-a0bd-84bb62bcd095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:16.037041 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00bd4f-e042-4281-a0bd-84bb62bcd095 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:16.043512 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 554/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:21:15 2022] GET /identity/v3/role_assignments?user.id=6d7fbdaed08a4bb48948acd8d0b52cfb&scope.project.id=0f08796900fd45d99c86e9e8ff2778e6&role.id=575c54955d4a474e9c687a0100991d1d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:18.082362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71e3ac-8e25-40c3-a86b-7dd19e185624 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:18.082908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71e3ac-8e25-40c3-a86b-7dd19e185624 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:18.082908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71e3ac-8e25-40c3-a86b-7dd19e185624 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:18.084289 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 577/1131] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:18.089836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fadad5-f6d3-4c70-b820-761a3c33832f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:18.090219 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fadad5-f6d3-4c70-b820-761a3c33832f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:18.090424 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fadad5-f6d3-4c70-b820-761a3c33832f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:18.108035 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f3fadad5-f6d3-4c70-b820-761a3c33832f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:18.109239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f3fadad5-f6d3-4c70-b820-761a3c33832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:18.178465 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 555/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:21:18.202131 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71e3ac-8e25-40c3-a86b-7dd19e185624 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:18.318924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71e3ac-8e25-40c3-a86b-7dd19e185624 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:18.355886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e38e4-3e0e-4fd8-a65e-fa0d9b8a3875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:18.356708 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e38e4-3e0e-4fd8-a65e-fa0d9b8a3875 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:18.356990 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e38e4-3e0e-4fd8-a65e-fa0d9b8a3875 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:18.357270 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e38e4-3e0e-4fd8-a65e-fa0d9b8a3875 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:18.358483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e38e4-3e0e-4fd8-a65e-fa0d9b8a3875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:18.359915 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e38e4-3e0e-4fd8-a65e-fa0d9b8a3875 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:18.361644 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 578/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:21:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:21:18.367561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fadad5-f6d3-4c70-b820-761a3c33832f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:18.449622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:18.469385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fadad5-f6d3-4c70-b820-761a3c33832f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:18.504003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92639ca7-a449-4163-94df-37d528b25946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:18.504658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92639ca7-a449-4163-94df-37d528b25946 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:18.504938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92639ca7-a449-4163-94df-37d528b25946 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:18.505217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92639ca7-a449-4163-94df-37d528b25946 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:18.505921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92639ca7-a449-4163-94df-37d528b25946 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:18.507381 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92639ca7-a449-4163-94df-37d528b25946 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:18.621299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 556/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 18 10:21:18 2022] POST /identity/v3/projects => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:21:20.834306 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df6200-ac37-458f-8d6e-5b2e9a4081e0 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:20.834888 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df6200-ac37-458f-8d6e-5b2e9a4081e0 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:20.834888 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df6200-ac37-458f-8d6e-5b2e9a4081e0 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:20.836246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 579/1135] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:20.842486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dc607-79f6-4b48-8b94-28c8e0d9c11b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:20.842967 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dc607-79f6-4b48-8b94-28c8e0d9c11b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:20.843059 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dc607-79f6-4b48-8b94-28c8e0d9c11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:20.860147 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-504dc607-79f6-4b48-8b94-28c8e0d9c11b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:20.861342 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-504dc607-79f6-4b48-8b94-28c8e0d9c11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:20.928322 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 557/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:21:20.953043 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df6200-ac37-458f-8d6e-5b2e9a4081e0 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:21.016373 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:21.056086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df6200-ac37-458f-8d6e-5b2e9a4081e0 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:21.088739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf0bd0-a409-45fb-a02e-3a1c0142af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:21.089995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf0bd0-a409-45fb-a02e-3a1c0142af1d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:21.090270 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf0bd0-a409-45fb-a02e-3a1c0142af1d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:21.090570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf0bd0-a409-45fb-a02e-3a1c0142af1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:21.091735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf0bd0-a409-45fb-a02e-3a1c0142af1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:21.093153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf0bd0-a409-45fb-a02e-3a1c0142af1d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:21.094868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 580/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:21:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:21.100728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dc607-79f6-4b48-8b94-28c8e0d9c11b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:21.162225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:21.201000 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dc607-79f6-4b48-8b94-28c8e0d9c11b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:21.235538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1945f4f-caf8-4c74-a34e-148dc997d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:21.236207 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1945f4f-caf8-4c74-a34e-148dc997d77e None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:21.236492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1945f4f-caf8-4c74-a34e-148dc997d77e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:21.236769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1945f4f-caf8-4c74-a34e-148dc997d77e None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:21.237485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1945f4f-caf8-4c74-a34e-148dc997d77e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:21.238953 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1945f4f-caf8-4c74-a34e-148dc997d77e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:21.316951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 558/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:21:21 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:21:23.390289 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b735c7-0a29-49b8-bf1f-dd4476d60231 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:23.390851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b735c7-0a29-49b8-bf1f-dd4476d60231 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:23.390851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b735c7-0a29-49b8-bf1f-dd4476d60231 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:23.392222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 581/1139] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:23.397574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab49a8-838d-430a-a8d9-9e073bf6f5ff None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:23.397995 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab49a8-838d-430a-a8d9-9e073bf6f5ff None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:23.398127 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab49a8-838d-430a-a8d9-9e073bf6f5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:23.415552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-faab49a8-838d-430a-a8d9-9e073bf6f5ff None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:23.416746 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-faab49a8-838d-430a-a8d9-9e073bf6f5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:23.495139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 559/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:21:23.522120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b735c7-0a29-49b8-bf1f-dd4476d60231 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:23.625251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b735c7-0a29-49b8-bf1f-dd4476d60231 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:23.659289 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:23.665016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187fdaf-7360-4d21-be81-0a74fb2c114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:23.665806 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187fdaf-7360-4d21-be81-0a74fb2c114f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:23.666087 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187fdaf-7360-4d21-be81-0a74fb2c114f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:23.666386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187fdaf-7360-4d21-be81-0a74fb2c114f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:23.677813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187fdaf-7360-4d21-be81-0a74fb2c114f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-0187fdaf-7360-4d21-be81-0a74fb2c114f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:21:23.687417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:21:23.688572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:21:23.689627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:21:23.689627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:21:23.689627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:21:23.689627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:21:23.689627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:21:23.689627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:21:23.689627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:21:23.689627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:21:23.689627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:21:23.689627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:21:23.689627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:21:23.689627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:21:23.689627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 582/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:21:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:21:23.696139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab49a8-838d-430a-a8d9-9e073bf6f5ff None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:23.752217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:23.803386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab49a8-838d-430a-a8d9-9e073bf6f5ff None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:23.837989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edd79a-d58d-4202-b041-1acc067ffec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:23.838683 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edd79a-d58d-4202-b041-1acc067ffec1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:23.839600 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edd79a-d58d-4202-b041-1acc067ffec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:23.839757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edd79a-d58d-4202-b041-1acc067ffec1 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:23.840463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edd79a-d58d-4202-b041-1acc067ffec1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:23.840765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edd79a-d58d-4202-b041-1acc067ffec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:23.842136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edd79a-d58d-4202-b041-1acc067ffec1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:23.850679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 560/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:21:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:23.857391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187fdaf-7360-4d21-be81-0a74fb2c114f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:23.961646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187fdaf-7360-4d21-be81-0a74fb2c114f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:23.996229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87b138-9319-4b01-84ab-9993f8db7915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:23.997093 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87b138-9319-4b01-84ab-9993f8db7915 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:23.997377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87b138-9319-4b01-84ab-9993f8db7915 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:23.997652 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87b138-9319-4b01-84ab-9993f8db7915 None admin] PATH_INFO: `/v3/users/9edf57eaa24f41e28d50d6ebf9c0c139` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:24.011623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87b138-9319-4b01-84ab-9993f8db7915 None admin] RBAC: Authorizing `identity:get_user(user_id=9edf57eaa24f41e28d50d6ebf9c0c139)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:24.013105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87b138-9319-4b01-84ab-9993f8db7915 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:24.014981 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 583/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:21:23 2022] GET /identity/v3/users/9edf57eaa24f41e28d50d6ebf9c0c139 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:24.020853 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edd79a-d58d-4202-b041-1acc067ffec1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:24.124904 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edd79a-d58d-4202-b041-1acc067ffec1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:24.135845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:24.162225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68abd6b-ccbc-4bba-bd9a-d1a62eaf2baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:24.162915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68abd6b-ccbc-4bba-bd9a-d1a62eaf2baa None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:24.163200 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68abd6b-ccbc-4bba-bd9a-d1a62eaf2baa None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:24.163478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68abd6b-ccbc-4bba-bd9a-d1a62eaf2baa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:24.231531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68abd6b-ccbc-4bba-bd9a-d1a62eaf2baa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:24.233013 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68abd6b-ccbc-4bba-bd9a-d1a62eaf2baa None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:24.331458 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 561/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:21:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:21:24.337931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87b138-9319-4b01-84ab-9993f8db7915 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:24.394471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:24.446095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87b138-9319-4b01-84ab-9993f8db7915 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:24.481744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58c9a7-4d57-465a-9e97-30a5f6c3782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:24.482533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58c9a7-4d57-465a-9e97-30a5f6c3782c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:24.482813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58c9a7-4d57-465a-9e97-30a5f6c3782c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:24.483088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58c9a7-4d57-465a-9e97-30a5f6c3782c None admin] PATH_INFO: `/v3/projects/c2febaf395a94720bcd9135dafa54fee` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:24.484269 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58c9a7-4d57-465a-9e97-30a5f6c3782c None admin] RBAC: Authorizing `identity:get_project(project_id=c2febaf395a94720bcd9135dafa54fee)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:24.485709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58c9a7-4d57-465a-9e97-30a5f6c3782c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:24.487444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 584/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:21:24 2022] GET /identity/v3/projects/c2febaf395a94720bcd9135dafa54fee => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:24.494627 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68abd6b-ccbc-4bba-bd9a-d1a62eaf2baa None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:24.507293 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:24.601236 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68abd6b-ccbc-4bba-bd9a-d1a62eaf2baa None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:24.636280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aee150-7397-4981-a1b7-7252d7b86d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:24.636941 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aee150-7397-4981-a1b7-7252d7b86d73 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:24.637222 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aee150-7397-4981-a1b7-7252d7b86d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:24.637495 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aee150-7397-4981-a1b7-7252d7b86d73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:24.638348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aee150-7397-4981-a1b7-7252d7b86d73 None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=c2febaf395a94720bcd9135dafa54fee, user.id=9edf57eaa24f41e28d50d6ebf9c0c139) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:24.638663 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aee150-7397-4981-a1b7-7252d7b86d73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:24.640097 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aee150-7397-4981-a1b7-7252d7b86d73 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:24.645698 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 562/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:21:24 2022] GET /identity/v3/role_assignments?user.id=9edf57eaa24f41e28d50d6ebf9c0c139&scope.project.id=c2febaf395a94720bcd9135dafa54fee&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:26.712980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9648677-6158-49aa-9c40-bd678f925ba2 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:26.713542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9648677-6158-49aa-9c40-bd678f925ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:26.713542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9648677-6158-49aa-9c40-bd678f925ba2 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:26.715455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 585/1147] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:26.720885 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04615b63-2450-4bfb-aac2-4c37b8f32780 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:26.721287 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04615b63-2450-4bfb-aac2-4c37b8f32780 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:26.721438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04615b63-2450-4bfb-aac2-4c37b8f32780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:26.738867 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-04615b63-2450-4bfb-aac2-4c37b8f32780 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:26.740064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-04615b63-2450-4bfb-aac2-4c37b8f32780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:26.807156 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 563/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:21:26.831199 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9648677-6158-49aa-9c40-bd678f925ba2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:26.936892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9648677-6158-49aa-9c40-bd678f925ba2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:26.955622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:26.975272 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fb5c9-6d10-4560-8e98-b32e95d3cb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:26.976080 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fb5c9-6d10-4560-8e98-b32e95d3cb8a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:26.976367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fb5c9-6d10-4560-8e98-b32e95d3cb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:26.976647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fb5c9-6d10-4560-8e98-b32e95d3cb8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:26.988456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fb5c9-6d10-4560-8e98-b32e95d3cb8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-cd0fb5c9-6d10-4560-8e98-b32e95d3cb8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:21:26.996261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:21:26.997361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:21:26.998444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:21:26.998444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:21:26.998444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:21:26.998444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:21:26.998444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:21:26.998444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:21:26.998444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:21:26.998444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:21:26.998444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:21:26.998444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:21:26.998444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:21:26.998444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:21:26.998444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 586/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:21:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:21:27.003846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04615b63-2450-4bfb-aac2-4c37b8f32780 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:27.007196 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:27.105395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04615b63-2450-4bfb-aac2-4c37b8f32780 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:27.140904 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428a949-910f-4150-9022-8ae7d010c020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:27.141573 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428a949-910f-4150-9022-8ae7d010c020 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:27.141855 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428a949-910f-4150-9022-8ae7d010c020 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:27.142132 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428a949-910f-4150-9022-8ae7d010c020 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:27.142914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428a949-910f-4150-9022-8ae7d010c020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:27.143219 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428a949-910f-4150-9022-8ae7d010c020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:27.144605 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428a949-910f-4150-9022-8ae7d010c020 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:27.154067 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 564/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:21:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:27.160370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fb5c9-6d10-4560-8e98-b32e95d3cb8a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:27.266464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fb5c9-6d10-4560-8e98-b32e95d3cb8a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:27.307407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347a2e7-090c-47d2-813d-ff0f20ac656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:27.308920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347a2e7-090c-47d2-813d-ff0f20ac656f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:27.309199 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347a2e7-090c-47d2-813d-ff0f20ac656f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:27.309471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347a2e7-090c-47d2-813d-ff0f20ac656f None admin] PATH_INFO: `/v3/users/9edf57eaa24f41e28d50d6ebf9c0c139` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:27.310673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347a2e7-090c-47d2-813d-ff0f20ac656f None admin] RBAC: Authorizing `identity:get_user(user_id=9edf57eaa24f41e28d50d6ebf9c0c139)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:27.312110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347a2e7-090c-47d2-813d-ff0f20ac656f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:27.313736 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 587/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:21:27 2022] GET /identity/v3/users/9edf57eaa24f41e28d50d6ebf9c0c139 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:27.320001 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428a949-910f-4150-9022-8ae7d010c020 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:27.390526 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:27.426693 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428a949-910f-4150-9022-8ae7d010c020 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:27.461385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d3d30-2540-4108-b556-2eb168610a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:27.462232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d3d30-2540-4108-b556-2eb168610a38 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:27.462537 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d3d30-2540-4108-b556-2eb168610a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:27.462807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d3d30-2540-4108-b556-2eb168610a38 None admin] PATH_INFO: `/v3/projects/c2febaf395a94720bcd9135dafa54fee` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:27.463983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d3d30-2540-4108-b556-2eb168610a38 None admin] RBAC: Authorizing `identity:get_project(project_id=c2febaf395a94720bcd9135dafa54fee)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:27.465918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d3d30-2540-4108-b556-2eb168610a38 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:27.467667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 565/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:21:27 2022] GET /identity/v3/projects/c2febaf395a94720bcd9135dafa54fee => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:27.473908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347a2e7-090c-47d2-813d-ff0f20ac656f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:27.520797 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:27.576307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347a2e7-090c-47d2-813d-ff0f20ac656f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:27.609754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6f6b6-4307-410a-ad30-e174ace83105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:27.610661 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6f6b6-4307-410a-ad30-e174ace83105 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:27.610941 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6f6b6-4307-410a-ad30-e174ace83105 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:27.611213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6f6b6-4307-410a-ad30-e174ace83105 None admin] PATH_INFO: `/v3/projects/c2febaf395a94720bcd9135dafa54fee/users/9edf57eaa24f41e28d50d6ebf9c0c139/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:27.613135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6f6b6-4307-410a-ad30-e174ace83105 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2febaf395a94720bcd9135dafa54fee, user_id=9edf57eaa24f41e28d50d6ebf9c0c139, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:27.614586 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6f6b6-4307-410a-ad30-e174ace83105 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:27.693241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 588/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:21:27 2022] PUT /identity/v3/projects/c2febaf395a94720bcd9135dafa54fee/users/9edf57eaa24f41e28d50d6ebf9c0c139/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:21:29.701170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45537ba1-1875-45e0-8af6-61d6b155cb24 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:29.701736 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45537ba1-1875-45e0-8af6-61d6b155cb24 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:29.701736 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45537ba1-1875-45e0-8af6-61d6b155cb24 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:29.703242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 566/1154] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:29.708535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240b6e7-3386-41dd-8d18-24f2baf7ece9 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:29.708981 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240b6e7-3386-41dd-8d18-24f2baf7ece9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:29.709082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240b6e7-3386-41dd-8d18-24f2baf7ece9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:29.726054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6240b6e7-3386-41dd-8d18-24f2baf7ece9 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:29.727267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6240b6e7-3386-41dd-8d18-24f2baf7ece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:29.793393 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 589/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:21:29.817612 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45537ba1-1875-45e0-8af6-61d6b155cb24 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:29.918743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45537ba1-1875-45e0-8af6-61d6b155cb24 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:29.953701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b800ed-5391-41f1-863f-5bbe1db62801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:29.954447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b800ed-5391-41f1-863f-5bbe1db62801 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:29.954731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b800ed-5391-41f1-863f-5bbe1db62801 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:29.955355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b800ed-5391-41f1-863f-5bbe1db62801 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:29.956937 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:29.966144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b800ed-5391-41f1-863f-5bbe1db62801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-30b800ed-5391-41f1-863f-5bbe1db62801 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:21:29.974088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:21:29.975212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:21:29.976258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:21:29.976258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:21:29.976258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:21:29.976258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:21:29.976258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:21:29.976258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:21:29.976258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:21:29.976258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:21:29.976258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:21:29.976258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:21:29.976258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:21:29.976258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:21:29.976258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 567/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:21:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:21:29.981853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240b6e7-3386-41dd-8d18-24f2baf7ece9 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:30.015478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:30.084472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240b6e7-3386-41dd-8d18-24f2baf7ece9 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:30.118129 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e5fd3-9862-40af-a1c4-5c976128b2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:30.118815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e5fd3-9862-40af-a1c4-5c976128b2cd None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:30.119097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e5fd3-9862-40af-a1c4-5c976128b2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:30.119372 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e5fd3-9862-40af-a1c4-5c976128b2cd None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:30.120100 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e5fd3-9862-40af-a1c4-5c976128b2cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:30.120399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e5fd3-9862-40af-a1c4-5c976128b2cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:30.121979 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e5fd3-9862-40af-a1c4-5c976128b2cd None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:30.129992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 590/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:21:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:21:30.136639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b800ed-5391-41f1-863f-5bbe1db62801 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:30.237051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b800ed-5391-41f1-863f-5bbe1db62801 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:30.273104 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd257c5-b758-49d0-871a-d036512789d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:30.274134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd257c5-b758-49d0-871a-d036512789d7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:30.274463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd257c5-b758-49d0-871a-d036512789d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:30.274735 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd257c5-b758-49d0-871a-d036512789d7 None admin] PATH_INFO: `/v3/users/9edf57eaa24f41e28d50d6ebf9c0c139` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:30.275977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd257c5-b758-49d0-871a-d036512789d7 None admin] RBAC: Authorizing `identity:get_user(user_id=9edf57eaa24f41e28d50d6ebf9c0c139)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:30.277462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd257c5-b758-49d0-871a-d036512789d7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:30.279943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 568/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:21:30 2022] GET /identity/v3/users/9edf57eaa24f41e28d50d6ebf9c0c139 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:30.286205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e5fd3-9862-40af-a1c4-5c976128b2cd None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:30.381721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:30.388273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e5fd3-9862-40af-a1c4-5c976128b2cd None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:30.422905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97f929-071a-43e5-a1c4-9b880c85488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:30.423560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97f929-071a-43e5-a1c4-9b880c85488e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:30.423836 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97f929-071a-43e5-a1c4-9b880c85488e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:30.424105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97f929-071a-43e5-a1c4-9b880c85488e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:30.494248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97f929-071a-43e5-a1c4-9b880c85488e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:30.495653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97f929-071a-43e5-a1c4-9b880c85488e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:30.587838 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:30.595067 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 591/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:21:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 10:21:30.601255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd257c5-b758-49d0-871a-d036512789d7 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:30.664297 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:30.704937 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd257c5-b758-49d0-871a-d036512789d7 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:30.740765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e269c4-bb92-4745-a796-fe60401e8597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:30.741618 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e269c4-bb92-4745-a796-fe60401e8597 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:30.741900 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e269c4-bb92-4745-a796-fe60401e8597 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:30.742173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e269c4-bb92-4745-a796-fe60401e8597 None admin] PATH_INFO: `/v3/projects/c2febaf395a94720bcd9135dafa54fee` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:30.743360 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e269c4-bb92-4745-a796-fe60401e8597 None admin] RBAC: Authorizing `identity:get_project(project_id=c2febaf395a94720bcd9135dafa54fee)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:30.744838 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e269c4-bb92-4745-a796-fe60401e8597 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:30.746552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 569/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:21:30 2022] GET /identity/v3/projects/c2febaf395a94720bcd9135dafa54fee => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:30.752649 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97f929-071a-43e5-a1c4-9b880c85488e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:30.851024 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97f929-071a-43e5-a1c4-9b880c85488e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:30.884496 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c17bd-c660-4444-9c2e-76493408f8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:30.885130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c17bd-c660-4444-9c2e-76493408f8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:30.885458 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c17bd-c660-4444-9c2e-76493408f8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:30.885677 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c17bd-c660-4444-9c2e-76493408f8c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:30.886524 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c17bd-c660-4444-9c2e-76493408f8c5 None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=c2febaf395a94720bcd9135dafa54fee, user.id=9edf57eaa24f41e28d50d6ebf9c0c139) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:30.886828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c17bd-c660-4444-9c2e-76493408f8c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:30.889026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c17bd-c660-4444-9c2e-76493408f8c5 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:30.894798 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 592/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:21:30 2022] GET /identity/v3/role_assignments?user.id=9edf57eaa24f41e28d50d6ebf9c0c139&scope.project.id=c2febaf395a94720bcd9135dafa54fee&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:32.952273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba737c33-1ee8-4357-a7eb-d89fad1de0a7 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:32.952907 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba737c33-1ee8-4357-a7eb-d89fad1de0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:32.952907 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba737c33-1ee8-4357-a7eb-d89fad1de0a7 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:32.954254 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 570/1162] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:32.961463 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f85da-3a6c-4dec-bc96-f0a2b66b5e35 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:32.961872 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f85da-3a6c-4dec-bc96-f0a2b66b5e35 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:32.962010 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f85da-3a6c-4dec-bc96-f0a2b66b5e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:32.979017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-737f85da-3a6c-4dec-bc96-f0a2b66b5e35 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:32.980234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-737f85da-3a6c-4dec-bc96-f0a2b66b5e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:33.037787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:33.050044 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 593/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:21:33.072137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba737c33-1ee8-4357-a7eb-d89fad1de0a7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:33.174735 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba737c33-1ee8-4357-a7eb-d89fad1de0a7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:33.203693 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:33.209388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44cb44-db9c-40e9-895b-ff461eb60ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:33.210038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44cb44-db9c-40e9-895b-ff461eb60ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:33.210347 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44cb44-db9c-40e9-895b-ff461eb60ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:33.210629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44cb44-db9c-40e9-895b-ff461eb60ee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:33.279393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44cb44-db9c-40e9-895b-ff461eb60ee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:33.280875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44cb44-db9c-40e9-895b-ff461eb60ee1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:33.386607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 571/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:21:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:21:33.392763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f85da-3a6c-4dec-bc96-f0a2b66b5e35 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:33.498247 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f85da-3a6c-4dec-bc96-f0a2b66b5e35 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:33.536054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3273ea-0500-4e10-9f81-f152ac556ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:33.536854 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3273ea-0500-4e10-9f81-f152ac556ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:33.537136 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3273ea-0500-4e10-9f81-f152ac556ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:33.537408 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3273ea-0500-4e10-9f81-f152ac556ff4 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:33.545922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3273ea-0500-4e10-9f81-f152ac556ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:33.547391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3273ea-0500-4e10-9f81-f152ac556ff4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-fe3273ea-0500-4e10-9f81-f152ac556ff4 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:21:33.562085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:21:33.563433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:21:33.564406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:21:33.564406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:21:33.564406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:21:33.564406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:21:33.564406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:21:33.564406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:21:33.564406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:21:33.564406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:21:33.564406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:21:33.564406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:21:33.564406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 18 10:21:33.564406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:21:33.564406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 10:21:33.564406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:21:33.564406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 594/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 18 10:21:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:21:33.569456 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44cb44-db9c-40e9-895b-ff461eb60ee1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:33.599814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:33.668625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44cb44-db9c-40e9-895b-ff461eb60ee1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:33.703106 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e2940-441c-4a54-9718-b006442f10dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:33.703754 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e2940-441c-4a54-9718-b006442f10dc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:33.704035 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e2940-441c-4a54-9718-b006442f10dc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:33.704310 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e2940-441c-4a54-9718-b006442f10dc None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:33.705017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e2940-441c-4a54-9718-b006442f10dc None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:33.705319 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e2940-441c-4a54-9718-b006442f10dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:33.706716 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e2940-441c-4a54-9718-b006442f10dc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:33.714639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 572/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 18 10:21:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:35.735495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f4f3d-1889-46df-a006-f2d0cbb321a1 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:35.736055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f4f3d-1889-46df-a006-f2d0cbb321a1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:35.736055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f4f3d-1889-46df-a006-f2d0cbb321a1 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:35.737416 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 595/1167] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:35.742605 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1433f-4b3e-4819-9f7c-eb1cef085e0a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:35.743024 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1433f-4b3e-4819-9f7c-eb1cef085e0a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:35.743157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1433f-4b3e-4819-9f7c-eb1cef085e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:35.761007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-82b1433f-4b3e-4819-9f7c-eb1cef085e0a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:35.763538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-82b1433f-4b3e-4819-9f7c-eb1cef085e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:35.847525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 573/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:21:35.873765 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f4f3d-1889-46df-a006-f2d0cbb321a1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:35.925404 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:35.983580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f4f3d-1889-46df-a006-f2d0cbb321a1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:36.037401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b328255-eb0c-41e1-8b39-9f4847aeaf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:36.038416 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b328255-eb0c-41e1-8b39-9f4847aeaf3f None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:36.038870 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b328255-eb0c-41e1-8b39-9f4847aeaf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:36.039334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b328255-eb0c-41e1-8b39-9f4847aeaf3f None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:36.040610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b328255-eb0c-41e1-8b39-9f4847aeaf3f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:36.043022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b328255-eb0c-41e1-8b39-9f4847aeaf3f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:36.129501 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 596/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Mon Jul 18 10:21:35 2022] POST /identity/v3/domains => generated 267 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:21:38.192642 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159d7a5-22c8-4aef-b53b-debdf8fe3bf7 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:38.193189 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159d7a5-22c8-4aef-b53b-debdf8fe3bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:38.193189 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159d7a5-22c8-4aef-b53b-debdf8fe3bf7 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:38.194628 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 574/1170] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:38.200491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeb7ac-8ec6-4a5b-bfda-f7ff4da01c18 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:38.200905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeb7ac-8ec6-4a5b-bfda-f7ff4da01c18 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:38.201038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeb7ac-8ec6-4a5b-bfda-f7ff4da01c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:38.218724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-9adeb7ac-8ec6-4a5b-bfda-f7ff4da01c18 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:38.219828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9adeb7ac-8ec6-4a5b-bfda-f7ff4da01c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:38.288055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 597/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:21:38.312051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159d7a5-22c8-4aef-b53b-debdf8fe3bf7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:38.338823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:38.420033 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159d7a5-22c8-4aef-b53b-debdf8fe3bf7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:38.454959 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79a3bf-41cf-4394-8152-1bf8a7526c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:38.455820 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79a3bf-41cf-4394-8152-1bf8a7526c09 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:38.456102 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79a3bf-41cf-4394-8152-1bf8a7526c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:38.456374 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79a3bf-41cf-4394-8152-1bf8a7526c09 None admin] PATH_INFO: `/v3/domains/63dd9cb6ac024affa4df59baf32de79b` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:38.467300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79a3bf-41cf-4394-8152-1bf8a7526c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=63dd9cb6ac024affa4df59baf32de79b)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:38.468793 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79a3bf-41cf-4394-8152-1bf8a7526c09 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:38.470423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 575/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Mon Jul 18 10:21:38 2022] GET /identity/v3/domains/63dd9cb6ac024affa4df59baf32de79b => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:38.476426 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeb7ac-8ec6-4a5b-bfda-f7ff4da01c18 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:38.517850 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:38.588397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeb7ac-8ec6-4a5b-bfda-f7ff4da01c18 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:38.625673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52618c4d-670f-4124-83e9-fd43f1f03eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:38.626413 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52618c4d-670f-4124-83e9-fd43f1f03eef None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:38.626847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52618c4d-670f-4124-83e9-fd43f1f03eef None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:38.627165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52618c4d-670f-4124-83e9-fd43f1f03eef None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:38.627875 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52618c4d-670f-4124-83e9-fd43f1f03eef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:38.629300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52618c4d-670f-4124-83e9-fd43f1f03eef None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:38.718215 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 598/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 18 10:21:38 2022] POST /identity/v3/projects => generated 361 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:21:40.869752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ef3d3-b856-4aab-9ab1-9e7d6cf9d1f4 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:40.870356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ef3d3-b856-4aab-9ab1-9e7d6cf9d1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:40.870356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ef3d3-b856-4aab-9ab1-9e7d6cf9d1f4 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:40.872572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 576/1174] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:40.878220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d0586-c8e4-44c7-acc2-10879723a8ac None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:40.878709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d0586-c8e4-44c7-acc2-10879723a8ac None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:40.878820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d0586-c8e4-44c7-acc2-10879723a8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:40.895778 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-423d0586-c8e4-44c7-acc2-10879723a8ac None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:40.896960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-423d0586-c8e4-44c7-acc2-10879723a8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:40.966200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 599/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:21:40.991422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ef3d3-b856-4aab-9ab1-9e7d6cf9d1f4 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:41.079615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:41.095933 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ef3d3-b856-4aab-9ab1-9e7d6cf9d1f4 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:41.130379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7428c-9983-4f4a-bb2d-7bd4ca0a422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:41.131173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7428c-9983-4f4a-bb2d-7bd4ca0a422f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:41.131454 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7428c-9983-4f4a-bb2d-7bd4ca0a422f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:41.131729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7428c-9983-4f4a-bb2d-7bd4ca0a422f None admin] PATH_INFO: `/v3/domains/63dd9cb6ac024affa4df59baf32de79b` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:41.133183 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7428c-9983-4f4a-bb2d-7bd4ca0a422f None admin] RBAC: Authorizing `identity:get_domain(domain_id=63dd9cb6ac024affa4df59baf32de79b)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:41.134643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7428c-9983-4f4a-bb2d-7bd4ca0a422f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:41.136295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 577/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Mon Jul 18 10:21:40 2022] GET /identity/v3/domains/63dd9cb6ac024affa4df59baf32de79b => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:41.143127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d0586-c8e4-44c7-acc2-10879723a8ac None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:41.166171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:41.240084 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d0586-c8e4-44c7-acc2-10879723a8ac None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:41.277362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700139b-f74b-4feb-baed-12f661b039f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:41.278149 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700139b-f74b-4feb-baed-12f661b039f5 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:41.278655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700139b-f74b-4feb-baed-12f661b039f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:41.279066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700139b-f74b-4feb-baed-12f661b039f5 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:41.279779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700139b-f74b-4feb-baed-12f661b039f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:41.281211 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700139b-f74b-4feb-baed-12f661b039f5 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:41.374115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 600/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:21:41 2022] POST /identity/v3/users => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:21:43.490871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e362dde-ea8b-4e47-b84c-7c2f3e15f225 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:43.491446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e362dde-ea8b-4e47-b84c-7c2f3e15f225 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:43.491446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e362dde-ea8b-4e47-b84c-7c2f3e15f225 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:43.492813 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 578/1178] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:43.499961 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738998b-82be-476e-a9c2-e28bad09b71a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:43.500543 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738998b-82be-476e-a9c2-e28bad09b71a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:43.500543 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738998b-82be-476e-a9c2-e28bad09b71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:43.521084 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-9738998b-82be-476e-a9c2-e28bad09b71a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:43.522287 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9738998b-82be-476e-a9c2-e28bad09b71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:43.597233 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 601/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:21:43.621068 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e362dde-ea8b-4e47-b84c-7c2f3e15f225 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:43.726072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e362dde-ea8b-4e47-b84c-7c2f3e15f225 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:43.761334 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81ca35-1dc5-4095-8f62-5d4579f99080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:43.762070 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81ca35-1dc5-4095-8f62-5d4579f99080 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:43.762508 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81ca35-1dc5-4095-8f62-5d4579f99080 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:43.762996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81ca35-1dc5-4095-8f62-5d4579f99080 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:43.773428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81ca35-1dc5-4095-8f62-5d4579f99080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-0c81ca35-1dc5-4095-8f62-5d4579f99080 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:21:43.781535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:21:43.782770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:21:43.783903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:21:43.783903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:21:43.783903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:21:43.783903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:21:43.783903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:21:43.783903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:21:43.783903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:21:43.783903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:21:43.783903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:21:43.783903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:21:43.783903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:21:43.783903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:21:43.786523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 579/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:21:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:21:43.788903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738998b-82be-476e-a9c2-e28bad09b71a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:43.800719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:43.893922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738998b-82be-476e-a9c2-e28bad09b71a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:43.930881 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b1f5b-aa65-464e-9f99-f7a0a5575780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:43.931561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b1f5b-aa65-464e-9f99-f7a0a5575780 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:43.931845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b1f5b-aa65-464e-9f99-f7a0a5575780 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:43.932123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b1f5b-aa65-464e-9f99-f7a0a5575780 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:43.932881 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b1f5b-aa65-464e-9f99-f7a0a5575780 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:43.933187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b1f5b-aa65-464e-9f99-f7a0a5575780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:43.935730 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b1f5b-aa65-464e-9f99-f7a0a5575780 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:43.944666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 602/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:21:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:43.950788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81ca35-1dc5-4095-8f62-5d4579f99080 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:43.966993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:44.051536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81ca35-1dc5-4095-8f62-5d4579f99080 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:44.084359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22421-626e-4928-90e1-909c7f315231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:44.085219 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22421-626e-4928-90e1-909c7f315231 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:44.085502 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22421-626e-4928-90e1-909c7f315231 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:44.085777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22421-626e-4928-90e1-909c7f315231 None admin] PATH_INFO: `/v3/users/f6839e58b5c545f9bf641f8f0fa03bc6` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:44.099178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a22421-626e-4928-90e1-909c7f315231 None admin] RBAC: Authorizing `identity:get_user(user_id=f6839e58b5c545f9bf641f8f0fa03bc6)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:44.100621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a22421-626e-4928-90e1-909c7f315231 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:44.102276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 580/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:21:43 2022] GET /identity/v3/users/f6839e58b5c545f9bf641f8f0fa03bc6 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:44.108900 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b1f5b-aa65-464e-9f99-f7a0a5575780 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:44.182391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:44.212479 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b1f5b-aa65-464e-9f99-f7a0a5575780 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:44.246069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71397db-5581-4764-9d28-9706facbedec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:44.246735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71397db-5581-4764-9d28-9706facbedec None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:44.247015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71397db-5581-4764-9d28-9706facbedec None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:44.247286 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71397db-5581-4764-9d28-9706facbedec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:44.312669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71397db-5581-4764-9d28-9706facbedec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:44.314040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71397db-5581-4764-9d28-9706facbedec None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:44.377939 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:44.409424 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 603/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:21:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:21:44.415385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22421-626e-4928-90e1-909c7f315231 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:44.486827 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:44.517602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22421-626e-4928-90e1-909c7f315231 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:44.551384 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dacad-e4ab-4501-871f-f100cf740165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:44.552235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dacad-e4ab-4501-871f-f100cf740165 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:44.552516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dacad-e4ab-4501-871f-f100cf740165 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:44.552789 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dacad-e4ab-4501-871f-f100cf740165 None admin] PATH_INFO: `/v3/projects/6ea6a3c26c984e2cbfb97c73ed5286b4` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:44.553961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dacad-e4ab-4501-871f-f100cf740165 None admin] RBAC: Authorizing `identity:get_project(project_id=6ea6a3c26c984e2cbfb97c73ed5286b4)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:44.555428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dacad-e4ab-4501-871f-f100cf740165 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:44.557124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 581/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:21:44 2022] GET /identity/v3/projects/6ea6a3c26c984e2cbfb97c73ed5286b4 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:44.563334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71397db-5581-4764-9d28-9706facbedec None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:44.662952 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71397db-5581-4764-9d28-9706facbedec None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:44.697414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db6e72-6ac6-4d95-bce4-d9d0efeb55f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:44.698097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db6e72-6ac6-4d95-bce4-d9d0efeb55f1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:44.698407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db6e72-6ac6-4d95-bce4-d9d0efeb55f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:44.698689 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db6e72-6ac6-4d95-bce4-d9d0efeb55f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:44.700224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db6e72-6ac6-4d95-bce4-d9d0efeb55f1 None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=6ea6a3c26c984e2cbfb97c73ed5286b4, user.id=f6839e58b5c545f9bf641f8f0fa03bc6) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:44.700536 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db6e72-6ac6-4d95-bce4-d9d0efeb55f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:44.701986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db6e72-6ac6-4d95-bce4-d9d0efeb55f1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:44.707816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 604/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:21:44 2022] GET /identity/v3/role_assignments?user.id=f6839e58b5c545f9bf641f8f0fa03bc6&scope.project.id=6ea6a3c26c984e2cbfb97c73ed5286b4&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:46.721981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fa7d1-169e-4928-a280-0d7ff29d7dbd None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:46.722579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fa7d1-169e-4928-a280-0d7ff29d7dbd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:46.722579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fa7d1-169e-4928-a280-0d7ff29d7dbd None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:46.723932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 582/1186] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:46.729317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e4e33-de60-4ad2-a4de-951da1172aae None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:46.729727 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e4e33-de60-4ad2-a4de-951da1172aae None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:46.729868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e4e33-de60-4ad2-a4de-951da1172aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:46.747526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-217e4e33-de60-4ad2-a4de-951da1172aae None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:46.748701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-217e4e33-de60-4ad2-a4de-951da1172aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:46.774883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:46.815194 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 605/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:21:46.837290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fa7d1-169e-4928-a280-0d7ff29d7dbd None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:46.938806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fa7d1-169e-4928-a280-0d7ff29d7dbd None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:46.972565 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb2ba6-8dca-4e89-a670-17376a0eee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:46.973296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb2ba6-8dca-4e89-a670-17376a0eee86 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:46.973567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb2ba6-8dca-4e89-a670-17376a0eee86 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:46.973839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb2ba6-8dca-4e89-a670-17376a0eee86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:46.980488 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:46.984685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb2ba6-8dca-4e89-a670-17376a0eee86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-45cb2ba6-8dca-4e89-a670-17376a0eee86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:21:46.992312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:21:46.999479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:21:47.000358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:21:47.000358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:21:47.000358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:21:47.000358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:21:47.000358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:21:47.000358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:21:47.000358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:21:47.000358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:21:47.000358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:21:47.000358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:21:47.000358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:21:47.000358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:21:47.000358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 583/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:21:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:21:47.001078 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e4e33-de60-4ad2-a4de-951da1172aae None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:47.097220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e4e33-de60-4ad2-a4de-951da1172aae None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:47.130173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cbc50-6a7f-4c93-b946-29ef972ea1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:47.130851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cbc50-6a7f-4c93-b946-29ef972ea1ec None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:47.131132 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cbc50-6a7f-4c93-b946-29ef972ea1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:47.131406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cbc50-6a7f-4c93-b946-29ef972ea1ec None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:47.132138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cbc50-6a7f-4c93-b946-29ef972ea1ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:47.132441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cbc50-6a7f-4c93-b946-29ef972ea1ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:47.134076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cbc50-6a7f-4c93-b946-29ef972ea1ec None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:47.141946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 606/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:21:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:21:47.147812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb2ba6-8dca-4e89-a670-17376a0eee86 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:47.249626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb2ba6-8dca-4e89-a670-17376a0eee86 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:47.282993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898ba72-99a1-4db4-b97c-013df9ae7988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:47.283857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898ba72-99a1-4db4-b97c-013df9ae7988 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:47.284139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898ba72-99a1-4db4-b97c-013df9ae7988 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:47.284413 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898ba72-99a1-4db4-b97c-013df9ae7988 None admin] PATH_INFO: `/v3/users/f6839e58b5c545f9bf641f8f0fa03bc6` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:47.285584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898ba72-99a1-4db4-b97c-013df9ae7988 None admin] RBAC: Authorizing `identity:get_user(user_id=f6839e58b5c545f9bf641f8f0fa03bc6)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:47.287068 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898ba72-99a1-4db4-b97c-013df9ae7988 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:47.288703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 584/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:21:47 2022] GET /identity/v3/users/f6839e58b5c545f9bf641f8f0fa03bc6 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:47.295287 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cbc50-6a7f-4c93-b946-29ef972ea1ec None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:47.323397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:47.395456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cbc50-6a7f-4c93-b946-29ef972ea1ec None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:47.428841 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee7c13-8273-4699-a47b-fe18b2e5620a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:47.429684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee7c13-8273-4699-a47b-fe18b2e5620a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:47.429967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee7c13-8273-4699-a47b-fe18b2e5620a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:47.430240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee7c13-8273-4699-a47b-fe18b2e5620a None admin] PATH_INFO: `/v3/projects/6ea6a3c26c984e2cbfb97c73ed5286b4` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:47.431448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee7c13-8273-4699-a47b-fe18b2e5620a None admin] RBAC: Authorizing `identity:get_project(project_id=6ea6a3c26c984e2cbfb97c73ed5286b4)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:47.432922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee7c13-8273-4699-a47b-fe18b2e5620a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:47.435126 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 607/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:21:47 2022] GET /identity/v3/projects/6ea6a3c26c984e2cbfb97c73ed5286b4 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:47.441124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898ba72-99a1-4db4-b97c-013df9ae7988 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:47.505858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:47.542054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898ba72-99a1-4db4-b97c-013df9ae7988 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:47.575227 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990a34f-c9f2-4eae-86d0-70d2523f3099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:47.576094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990a34f-c9f2-4eae-86d0-70d2523f3099 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:47.576369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990a34f-c9f2-4eae-86d0-70d2523f3099 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:47.576636 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990a34f-c9f2-4eae-86d0-70d2523f3099 None admin] PATH_INFO: `/v3/projects/6ea6a3c26c984e2cbfb97c73ed5286b4/users/f6839e58b5c545f9bf641f8f0fa03bc6/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:47.578572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990a34f-c9f2-4eae-86d0-70d2523f3099 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ea6a3c26c984e2cbfb97c73ed5286b4, user_id=f6839e58b5c545f9bf641f8f0fa03bc6, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:47.579990 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990a34f-c9f2-4eae-86d0-70d2523f3099 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:47.658174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 585/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:21:47 2022] PUT /identity/v3/projects/6ea6a3c26c984e2cbfb97c73ed5286b4/users/f6839e58b5c545f9bf641f8f0fa03bc6/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:21:49.700049 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32610176-93cb-44aa-8551-40829a606cb9 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:49.700639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32610176-93cb-44aa-8551-40829a606cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:49.700782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32610176-93cb-44aa-8551-40829a606cb9 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:49.702157 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 608/1193] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:49.708361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af762a-1885-486e-a0f1-383d81481b66 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:49.708794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af762a-1885-486e-a0f1-383d81481b66 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:49.709201 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af762a-1885-486e-a0f1-383d81481b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:49.732031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-84af762a-1885-486e-a0f1-383d81481b66 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:49.733645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-84af762a-1885-486e-a0f1-383d81481b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:49.803753 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 586/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:21:49.828139 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32610176-93cb-44aa-8551-40829a606cb9 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:49.935423 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:49.945176 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32610176-93cb-44aa-8551-40829a606cb9 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:49.987382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d74fc-f038-4f49-a5e3-9aff247833ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:49.988171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d74fc-f038-4f49-a5e3-9aff247833ca None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:49.988453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d74fc-f038-4f49-a5e3-9aff247833ca None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:49.988764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d74fc-f038-4f49-a5e3-9aff247833ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:49.999551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d74fc-f038-4f49-a5e3-9aff247833ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-311d74fc-f038-4f49-a5e3-9aff247833ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:21:50.007183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:21:50.008570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:21:50.009628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:21:50.009628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:21:50.009628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:21:50.009628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:21:50.009628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:21:50.009628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:21:50.009628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:21:50.009628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:21:50.009628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:21:50.009628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:21:50.009628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:21:50.009628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:21:50.009628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 609/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:21:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:21:50.015310 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af762a-1885-486e-a0f1-383d81481b66 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:50.074192 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:50.122237 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af762a-1885-486e-a0f1-383d81481b66 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:50.157571 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8cc18-705b-4bf6-81c2-6acf219cbebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:50.158235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8cc18-705b-4bf6-81c2-6acf219cbebc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:50.158546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8cc18-705b-4bf6-81c2-6acf219cbebc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:50.158821 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8cc18-705b-4bf6-81c2-6acf219cbebc None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:50.159560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8cc18-705b-4bf6-81c2-6acf219cbebc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:50.159864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8cc18-705b-4bf6-81c2-6acf219cbebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:50.161230 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8cc18-705b-4bf6-81c2-6acf219cbebc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:50.169921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 587/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:21:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:50.175831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d74fc-f038-4f49-a5e3-9aff247833ca None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:50.281751 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d74fc-f038-4f49-a5e3-9aff247833ca None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:50.319323 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c6e7a-fd1f-4e27-bb78-d361e16566a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:50.320239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c6e7a-fd1f-4e27-bb78-d361e16566a9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:50.320536 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c6e7a-fd1f-4e27-bb78-d361e16566a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:50.320833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c6e7a-fd1f-4e27-bb78-d361e16566a9 None admin] PATH_INFO: `/v3/users/f6839e58b5c545f9bf641f8f0fa03bc6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:50.322142 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c6e7a-fd1f-4e27-bb78-d361e16566a9 None admin] RBAC: Authorizing `identity:get_user(user_id=f6839e58b5c545f9bf641f8f0fa03bc6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:50.323769 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c6e7a-fd1f-4e27-bb78-d361e16566a9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:50.326105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 610/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 18 10:21:50 2022] GET /identity/v3/users/f6839e58b5c545f9bf641f8f0fa03bc6 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:21:50.333075 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8cc18-705b-4bf6-81c2-6acf219cbebc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:50.440037 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8cc18-705b-4bf6-81c2-6acf219cbebc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:50.458189 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:50.476552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7465427-d5d3-4575-8c6f-7dddfbd38bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:50.477377 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7465427-d5d3-4575-8c6f-7dddfbd38bfe None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:50.477708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7465427-d5d3-4575-8c6f-7dddfbd38bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:50.477991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7465427-d5d3-4575-8c6f-7dddfbd38bfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:50.553926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7465427-d5d3-4575-8c6f-7dddfbd38bfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:50.555378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7465427-d5d3-4575-8c6f-7dddfbd38bfe None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:50.660563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 588/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:21:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:21:50.666666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c6e7a-fd1f-4e27-bb78-d361e16566a9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:50.697869 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:50.779956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c6e7a-fd1f-4e27-bb78-d361e16566a9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:50.815203 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feec9ec-451d-4b66-a99f-0fb49ee04993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:50.815974 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec9ec-451d-4b66-a99f-0fb49ee04993 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:50.816258 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec9ec-451d-4b66-a99f-0fb49ee04993 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:50.816529 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feec9ec-451d-4b66-a99f-0fb49ee04993 None admin] PATH_INFO: `/v3/projects/6ea6a3c26c984e2cbfb97c73ed5286b4` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:50.817794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feec9ec-451d-4b66-a99f-0fb49ee04993 None admin] RBAC: Authorizing `identity:get_project(project_id=6ea6a3c26c984e2cbfb97c73ed5286b4)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:50.819260 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feec9ec-451d-4b66-a99f-0fb49ee04993 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:50.820980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 611/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 18 10:21:50 2022] GET /identity/v3/projects/6ea6a3c26c984e2cbfb97c73ed5286b4 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:50.828042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7465427-d5d3-4575-8c6f-7dddfbd38bfe None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:50.847050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:50.941164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7465427-d5d3-4575-8c6f-7dddfbd38bfe None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:50.979536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8031fe5-f6bc-4ba7-af2f-ffbddbcce237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:50.980182 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8031fe5-f6bc-4ba7-af2f-ffbddbcce237 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:50.980460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8031fe5-f6bc-4ba7-af2f-ffbddbcce237 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:50.980861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8031fe5-f6bc-4ba7-af2f-ffbddbcce237 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:50.981868 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8031fe5-f6bc-4ba7-af2f-ffbddbcce237 None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=6ea6a3c26c984e2cbfb97c73ed5286b4, user.id=f6839e58b5c545f9bf641f8f0fa03bc6) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:21:50.982172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8031fe5-f6bc-4ba7-af2f-ffbddbcce237 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:50.983652 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8031fe5-f6bc-4ba7-af2f-ffbddbcce237 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:50.989784 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 589/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:21:50 2022] GET /identity/v3/role_assignments?user.id=f6839e58b5c545f9bf641f8f0fa03bc6&scope.project.id=6ea6a3c26c984e2cbfb97c73ed5286b4&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:00.810635 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=55 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:00.987000 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=59 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:09.525373 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73446045-e781-4f01-9e3d-d728c59fe75c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:09.525972 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73446045-e781-4f01-9e3d-d728c59fe75c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:09.525972 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73446045-e781-4f01-9e3d-d728c59fe75c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:09.527496 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 612/1201] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:09.533173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012383e-1d98-4c5f-bece-03f2c443e975 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:09.533682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012383e-1d98-4c5f-bece-03f2c443e975 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:09.533805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012383e-1d98-4c5f-bece-03f2c443e975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:09.550200 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a012383e-1d98-4c5f-bece-03f2c443e975 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:09.551403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a012383e-1d98-4c5f-bece-03f2c443e975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:09.621484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 590/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:09.646914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73446045-e781-4f01-9e3d-d728c59fe75c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:09.752494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73446045-e781-4f01-9e3d-d728c59fe75c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:09.788045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41226d-93cb-40c5-b442-4b0117abd456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:09.788752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41226d-93cb-40c5-b442-4b0117abd456 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:09.789035 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41226d-93cb-40c5-b442-4b0117abd456 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:09.789514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41226d-93cb-40c5-b442-4b0117abd456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:09.800032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41226d-93cb-40c5-b442-4b0117abd456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:09.801489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41226d-93cb-40c5-b442-4b0117abd456 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:09.821389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-8d41226d-93cb-40c5-b442-4b0117abd456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:09.821389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:09.821389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:09.821389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:09.821389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:09.821389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:09.821389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:09.821389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:09.821389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:09.821389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:09.821389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:09.821389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:09.821389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:09.821389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:09.821389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:09.823298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:09.825384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:09.825384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:09.825384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:09.825384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:09.825384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 613/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:09.830098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012383e-1d98-4c5f-bece-03f2c443e975 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:09.929979 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012383e-1d98-4c5f-bece-03f2c443e975 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:09.960080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:09.966662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b67ed-1727-4812-8572-14fac6761cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:09.967324 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b67ed-1727-4812-8572-14fac6761cbd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:09.967604 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b67ed-1727-4812-8572-14fac6761cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:09.967881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b67ed-1727-4812-8572-14fac6761cbd None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:09.968610 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b67ed-1727-4812-8572-14fac6761cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:09.968910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b67ed-1727-4812-8572-14fac6761cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:09.970273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b67ed-1727-4812-8572-14fac6761cbd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:09.982140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 591/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:09.988095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41226d-93cb-40c5-b442-4b0117abd456 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:10.042700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:10.090080 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41226d-93cb-40c5-b442-4b0117abd456 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:10.124450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24938fb-a597-446b-872c-fd159307fa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:10.125112 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24938fb-a597-446b-872c-fd159307fa4f None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.125392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24938fb-a597-446b-872c-fd159307fa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.125665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24938fb-a597-446b-872c-fd159307fa4f None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.126390 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24938fb-a597-446b-872c-fd159307fa4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:10.127886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24938fb-a597-446b-872c-fd159307fa4f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:10.249966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 614/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 18 10:23:09 2022] POST /identity/v3/users => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:23:12.304880 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea632be-d457-4acd-bb63-0e021b2048d2 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:12.305428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea632be-d457-4acd-bb63-0e021b2048d2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:12.305428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea632be-d457-4acd-bb63-0e021b2048d2 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.306845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 592/1206] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:12.312630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f335c4-1c45-4e0d-946d-dc99b1051205 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:12.313043 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f335c4-1c45-4e0d-946d-dc99b1051205 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:12.313236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f335c4-1c45-4e0d-946d-dc99b1051205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.330022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a8f335c4-1c45-4e0d-946d-dc99b1051205 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:12.331253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a8f335c4-1c45-4e0d-946d-dc99b1051205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:12.398200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 615/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:12.421845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea632be-d457-4acd-bb63-0e021b2048d2 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:12.528345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea632be-d457-4acd-bb63-0e021b2048d2 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:12.563624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21e646-de3d-4adf-81bd-6b1edbfbdccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:12.564319 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21e646-de3d-4adf-81bd-6b1edbfbdccb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:12.564598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21e646-de3d-4adf-81bd-6b1edbfbdccb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:12.564870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21e646-de3d-4adf-81bd-6b1edbfbdccb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.575660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21e646-de3d-4adf-81bd-6b1edbfbdccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-8e21e646-de3d-4adf-81bd-6b1edbfbdccb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:12.583438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:12.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:12.589422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:12.589422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:12.589422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:12.589422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:12.589422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:12.589422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:12.589422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:12.589422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:12.589422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:12.589422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:12.589422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:12.589422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:12.589422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 593/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:12.591061 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f335c4-1c45-4e0d-946d-dc99b1051205 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:12.631135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:12.697535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f335c4-1c45-4e0d-946d-dc99b1051205 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:12.732016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87099c3c-0df5-4357-ad83-d97b5b1c5794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:12.732726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87099c3c-0df5-4357-ad83-d97b5b1c5794 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:12.733021 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87099c3c-0df5-4357-ad83-d97b5b1c5794 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:12.733293 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87099c3c-0df5-4357-ad83-d97b5b1c5794 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.734031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87099c3c-0df5-4357-ad83-d97b5b1c5794 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:12.734357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87099c3c-0df5-4357-ad83-d97b5b1c5794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:12.735729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87099c3c-0df5-4357-ad83-d97b5b1c5794 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:12.743882 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 616/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:12.750749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21e646-de3d-4adf-81bd-6b1edbfbdccb None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:12.802341 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:12.853553 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21e646-de3d-4adf-81bd-6b1edbfbdccb None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:12.887620 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9b406-f836-4ae5-86f1-7b4d2a25f072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:12.888405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9b406-f836-4ae5-86f1-7b4d2a25f072 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:12.888685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9b406-f836-4ae5-86f1-7b4d2a25f072 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:12.888956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9b406-f836-4ae5-86f1-7b4d2a25f072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.899761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9b406-f836-4ae5-86f1-7b4d2a25f072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:12.904224 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9b406-f836-4ae5-86f1-7b4d2a25f072 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:12.919173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-a3b9b406-f836-4ae5-86f1-7b4d2a25f072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:12.919173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:12.919173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:12.919173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:12.919173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:12.919173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:12.919173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:12.919173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:12.919173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:12.919173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:12.919173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:12.919173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:12.919173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:12.919173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:12.919173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:12.920328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:12.921369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:12.921369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:12.921369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:12.921369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:12.921369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 594/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:12.926560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87099c3c-0df5-4357-ad83-d97b5b1c5794 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:13.030150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:13.033322 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87099c3c-0df5-4357-ad83-d97b5b1c5794 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:13.067526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455d24f-8d90-46d9-b6f6-ba96a11cd10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:13.068184 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455d24f-8d90-46d9-b6f6-ba96a11cd10e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:13.068466 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455d24f-8d90-46d9-b6f6-ba96a11cd10e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:13.068739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455d24f-8d90-46d9-b6f6-ba96a11cd10e None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:13.069453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455d24f-8d90-46d9-b6f6-ba96a11cd10e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:13.069759 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455d24f-8d90-46d9-b6f6-ba96a11cd10e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:13.071159 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455d24f-8d90-46d9-b6f6-ba96a11cd10e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:13.082617 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 617/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:13.088479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9b406-f836-4ae5-86f1-7b4d2a25f072 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:13.198119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9b406-f836-4ae5-86f1-7b4d2a25f072 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:13.199994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:13.234174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7595d-f9d5-4f53-a6c2-e63d0ca5af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:13.294836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7595d-f9d5-4f53-a6c2-e63d0ca5af1d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:13.294836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7595d-f9d5-4f53-a6c2-e63d0ca5af1d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:13.294836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7595d-f9d5-4f53-a6c2-e63d0ca5af1d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:13.294836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7595d-f9d5-4f53-a6c2-e63d0ca5af1d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:13.294836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7595d-f9d5-4f53-a6c2-e63d0ca5af1d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:13.294836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-c0e7595d-f9d5-4f53-a6c2-e63d0ca5af1d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:23:13.294836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:13.295425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:13.296539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:13.297645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:13.297645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:13.297645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:13.297645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:13.297645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:13.297645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:13.297645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:23:13.297645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:13.297645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 595/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:13.298316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455d24f-8d90-46d9-b6f6-ba96a11cd10e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:13.366832 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455d24f-8d90-46d9-b6f6-ba96a11cd10e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:13.400261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03c9df-e0d8-4b47-88a5-a37ab5fd6ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:13.400927 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03c9df-e0d8-4b47-88a5-a37ab5fd6ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:13.401201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03c9df-e0d8-4b47-88a5-a37ab5fd6ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:13.401470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03c9df-e0d8-4b47-88a5-a37ab5fd6ea3 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:13.402842 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03c9df-e0d8-4b47-88a5-a37ab5fd6ea3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:13.403143 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03c9df-e0d8-4b47-88a5-a37ab5fd6ea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:13.404612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03c9df-e0d8-4b47-88a5-a37ab5fd6ea3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:13.422961 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 618/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 18 10:23:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:13.428896 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7595d-f9d5-4f53-a6c2-e63d0ca5af1d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:13.531886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7595d-f9d5-4f53-a6c2-e63d0ca5af1d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:13.565532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb7586-643b-4ce6-b9a6-7162b60c2c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:13.566185 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7586-643b-4ce6-b9a6-7162b60c2c21 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:13.566500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7586-643b-4ce6-b9a6-7162b60c2c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:13.566800 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7586-643b-4ce6-b9a6-7162b60c2c21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:13.597037 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:13.637053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb7586-643b-4ce6-b9a6-7162b60c2c21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:13.638526 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb7586-643b-4ce6-b9a6-7162b60c2c21 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:13.742633 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 596/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:23:13.749427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03c9df-e0d8-4b47-88a5-a37ab5fd6ea3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:13.769153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:13.852979 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03c9df-e0d8-4b47-88a5-a37ab5fd6ea3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:13.888613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1ce61-5a6b-4063-a30c-751c8db4fbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:13.889400 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1ce61-5a6b-4063-a30c-751c8db4fbfa None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:13.889674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1ce61-5a6b-4063-a30c-751c8db4fbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:13.889941 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1ce61-5a6b-4063-a30c-751c8db4fbfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:13.900366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1ce61-5a6b-4063-a30c-751c8db4fbfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:13.903024 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1ce61-5a6b-4063-a30c-751c8db4fbfa None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:13.920402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-21b1ce61-5a6b-4063-a30c-751c8db4fbfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:13.920402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:13.920402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:13.920402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:13.920402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:13.920402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:13.920402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:13.920402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:13.920402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:13.920402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:13.920402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:13.920402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:13.920402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:13.920402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:13.920402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:13.921487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:13.926311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:13.926311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:13.926311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:13.926311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:13.926311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 619/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:13.927966 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb7586-643b-4ce6-b9a6-7162b60c2c21 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:13.992240 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:14.030869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb7586-643b-4ce6-b9a6-7162b60c2c21 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:14.064719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffeebe-2bf0-4304-8798-9ad1d0abfd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:14.065377 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffeebe-2bf0-4304-8798-9ad1d0abfd1a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:14.065659 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffeebe-2bf0-4304-8798-9ad1d0abfd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:14.065933 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffeebe-2bf0-4304-8798-9ad1d0abfd1a None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:14.066685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffeebe-2bf0-4304-8798-9ad1d0abfd1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:14.066986 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffeebe-2bf0-4304-8798-9ad1d0abfd1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:14.068347 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffeebe-2bf0-4304-8798-9ad1d0abfd1a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:14.080896 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 597/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:14.086987 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1ce61-5a6b-4063-a30c-751c8db4fbfa None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:14.161291 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:14.192670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1ce61-5a6b-4063-a30c-751c8db4fbfa None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:14.229661 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7d06b-423d-4487-97bb-e81dd7a25f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:14.231104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7d06b-423d-4487-97bb-e81dd7a25f60 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:14.231385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7d06b-423d-4487-97bb-e81dd7a25f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:14.231655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7d06b-423d-4487-97bb-e81dd7a25f60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:14.238950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7d06b-423d-4487-97bb-e81dd7a25f60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:14.240404 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7d06b-423d-4487-97bb-e81dd7a25f60 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:14.255698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e3f7d06b-423d-4487-97bb-e81dd7a25f60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:14.255698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:14.255698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:14.255698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:14.255698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:14.255698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:14.255698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:14.255698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:14.255698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:14.255698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:14.255698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:14.255698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:14.255698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:14.255698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:14.255698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:14.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:14.257873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:14.257873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:14.257873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:14.257873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:14.257873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:14.257873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:14.257873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:14.257873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:14.257873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 620/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:14.265449 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffeebe-2bf0-4304-8798-9ad1d0abfd1a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:14.368441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffeebe-2bf0-4304-8798-9ad1d0abfd1a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:14.393746 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:14.405730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cb623-e616-48d4-8bf9-bf0d64e4d4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:14.406504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cb623-e616-48d4-8bf9-bf0d64e4d4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:14.406863 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cb623-e616-48d4-8bf9-bf0d64e4d4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:14.407142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cb623-e616-48d4-8bf9-bf0d64e4d4e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:14.408537 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cb623-e616-48d4-8bf9-bf0d64e4d4e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:14.408537 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cb623-e616-48d4-8bf9-bf0d64e4d4e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:14.409681 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cb623-e616-48d4-8bf9-bf0d64e4d4e6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:14.422170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 598/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:14.428332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7d06b-423d-4487-97bb-e81dd7a25f60 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:14.535434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7d06b-423d-4487-97bb-e81dd7a25f60 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:14.565680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:14.571642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b5a93-7f54-46d5-9b2b-57219ad4716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:14.572292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5a93-7f54-46d5-9b2b-57219ad4716f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:14.572574 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5a93-7f54-46d5-9b2b-57219ad4716f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:14.572943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5a93-7f54-46d5-9b2b-57219ad4716f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:14.573778 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b5a93-7f54-46d5-9b2b-57219ad4716f None admin] RBAC: Adding query filter params (role.id=509fcb6f06144cdd9803fb3910eb80bf, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=b8fd088faaba4d5c9745638c14f1a7f5) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:14.574101 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b5a93-7f54-46d5-9b2b-57219ad4716f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:14.575600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b5a93-7f54-46d5-9b2b-57219ad4716f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:14.581052 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 621/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:14 2022] GET /identity/v3/role_assignments?user.id=b8fd088faaba4d5c9745638c14f1a7f5&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=509fcb6f06144cdd9803fb3910eb80bf => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:16.596708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab549a6-ca6c-433c-a469-8b3a69c06894 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:16.597343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab549a6-ca6c-433c-a469-8b3a69c06894 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:16.597343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab549a6-ca6c-433c-a469-8b3a69c06894 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:16.598729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 599/1220] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:16.604187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c5de8-1839-4408-acda-be36bfb54ee8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:16.605130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c5de8-1839-4408-acda-be36bfb54ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:16.605318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c5de8-1839-4408-acda-be36bfb54ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:16.622705 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2e7c5de8-1839-4408-acda-be36bfb54ee8 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:16.623883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2e7c5de8-1839-4408-acda-be36bfb54ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:16.691820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 622/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:16.713703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab549a6-ca6c-433c-a469-8b3a69c06894 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:16.818424 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab549a6-ca6c-433c-a469-8b3a69c06894 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:16.852621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21124cd0-a272-46a9-a6d2-52d8bd98940d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:16.853343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21124cd0-a272-46a9-a6d2-52d8bd98940d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:16.853625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21124cd0-a272-46a9-a6d2-52d8bd98940d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:16.853903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21124cd0-a272-46a9-a6d2-52d8bd98940d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:16.865403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21124cd0-a272-46a9-a6d2-52d8bd98940d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-21124cd0-a272-46a9-a6d2-52d8bd98940d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:16.874021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:16.875193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:16.876348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:16.876348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:16.876348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:16.876348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:16.876348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:16.876348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:16.876348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:16.876348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:16.876348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:16.876348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:16.876348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:16.876348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:16.876348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 600/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:16.881596 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c5de8-1839-4408-acda-be36bfb54ee8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:16.990592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c5de8-1839-4408-acda-be36bfb54ee8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:17.014911 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:17.025284 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac24b40-0714-42f7-bfbe-efb5dd483b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:17.025946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac24b40-0714-42f7-bfbe-efb5dd483b42 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.026231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac24b40-0714-42f7-bfbe-efb5dd483b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.027111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac24b40-0714-42f7-bfbe-efb5dd483b42 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.027852 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac24b40-0714-42f7-bfbe-efb5dd483b42 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:17.028158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac24b40-0714-42f7-bfbe-efb5dd483b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:17.029625 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac24b40-0714-42f7-bfbe-efb5dd483b42 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:17.037674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 623/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:17.044403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21124cd0-a272-46a9-a6d2-52d8bd98940d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:17.089680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:17.147856 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21124cd0-a272-46a9-a6d2-52d8bd98940d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:17.181504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf906a7e-6538-493a-8cc2-dffa4ab85dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:17.182282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf906a7e-6538-493a-8cc2-dffa4ab85dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.182596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf906a7e-6538-493a-8cc2-dffa4ab85dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.183483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf906a7e-6538-493a-8cc2-dffa4ab85dc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.193879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf906a7e-6538-493a-8cc2-dffa4ab85dc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:17.195350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf906a7e-6538-493a-8cc2-dffa4ab85dc1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:17.213556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-bf906a7e-6538-493a-8cc2-dffa4ab85dc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:17.213556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:17.213556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:17.213556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:17.213556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:17.213556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:17.213556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:17.213556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:17.213556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:17.213556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:17.213556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:17.213556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:17.213556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:17.213556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:17.213556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:17.214788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:17.215814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:17.215814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:17.215814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:17.215814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:17.215814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 601/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:17.220843 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac24b40-0714-42f7-bfbe-efb5dd483b42 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:17.323277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac24b40-0714-42f7-bfbe-efb5dd483b42 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:17.359452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58940b91-d518-469b-83cc-824bc4da3aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:17.360139 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58940b91-d518-469b-83cc-824bc4da3aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.360400 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58940b91-d518-469b-83cc-824bc4da3aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.360672 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58940b91-d518-469b-83cc-824bc4da3aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.361392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58940b91-d518-469b-83cc-824bc4da3aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:17.361694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58940b91-d518-469b-83cc-824bc4da3aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:17.363096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58940b91-d518-469b-83cc-824bc4da3aa1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:17.375515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 624/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:17.381396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf906a7e-6538-493a-8cc2-dffa4ab85dc1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:17.478737 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:17.485489 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf906a7e-6538-493a-8cc2-dffa4ab85dc1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:17.519661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7bee6-eaf0-4efc-a3f4-293c3132f8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:17.520455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7bee6-eaf0-4efc-a3f4-293c3132f8ec None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.520737 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7bee6-eaf0-4efc-a3f4-293c3132f8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.521014 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7bee6-eaf0-4efc-a3f4-293c3132f8ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.528994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7bee6-eaf0-4efc-a3f4-293c3132f8ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:17.530474 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7bee6-eaf0-4efc-a3f4-293c3132f8ec None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-8ce7bee6-eaf0-4efc-a3f4-293c3132f8ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:17.545721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:17.546927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:17.548304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:17.548304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:17.548304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:17.548304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:17.548304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:17.548304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:17.548304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:17.548304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:17.548304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:23:17.548304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:17.548304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 602/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:17.552924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58940b91-d518-469b-83cc-824bc4da3aa1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:17.599986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:17.656369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58940b91-d518-469b-83cc-824bc4da3aa1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:17.700134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164925c-3157-4ede-a180-9ec222a3cdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:17.700868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164925c-3157-4ede-a180-9ec222a3cdc5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.701155 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164925c-3157-4ede-a180-9ec222a3cdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.701431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164925c-3157-4ede-a180-9ec222a3cdc5 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.702356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164925c-3157-4ede-a180-9ec222a3cdc5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:17.702709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164925c-3157-4ede-a180-9ec222a3cdc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:17.704206 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164925c-3157-4ede-a180-9ec222a3cdc5 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:17.721758 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 625/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 18 10:23:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:17.727775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7bee6-eaf0-4efc-a3f4-293c3132f8ec None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:17.834561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7bee6-eaf0-4efc-a3f4-293c3132f8ec None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:17.871533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679107f-849c-43bf-a0f5-fba581fd8bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:17.872620 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679107f-849c-43bf-a0f5-fba581fd8bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.872907 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679107f-849c-43bf-a0f5-fba581fd8bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.873184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679107f-849c-43bf-a0f5-fba581fd8bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.887288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679107f-849c-43bf-a0f5-fba581fd8bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:17.888755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679107f-849c-43bf-a0f5-fba581fd8bb3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:17.909452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-b679107f-849c-43bf-a0f5-fba581fd8bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:17.909452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:17.909452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:17.909452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:17.909452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:17.909452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:17.909452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:17.909452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:17.909452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:17.909452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:17.909452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:17.909452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:17.909452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:17.909452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:17.909452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:17.910667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:17.911943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:17.911943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:17.911943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:17.911943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:17.911943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 603/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:17.916806 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164925c-3157-4ede-a180-9ec222a3cdc5 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:18.026153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164925c-3157-4ede-a180-9ec222a3cdc5 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:18.029198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:18.061574 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712cd63-f997-455a-a902-42584fcb2c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:18.062242 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712cd63-f997-455a-a902-42584fcb2c24 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:18.062556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712cd63-f997-455a-a902-42584fcb2c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:18.062834 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712cd63-f997-455a-a902-42584fcb2c24 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:18.063553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712cd63-f997-455a-a902-42584fcb2c24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:18.063935 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712cd63-f997-455a-a902-42584fcb2c24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:18.065307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712cd63-f997-455a-a902-42584fcb2c24 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:18.077303 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 626/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:18.083386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679107f-849c-43bf-a0f5-fba581fd8bb3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:18.093891 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:18.186136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679107f-849c-43bf-a0f5-fba581fd8bb3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:18.220694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc42d3-924b-4354-bf04-08fe70ce77ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:18.221482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc42d3-924b-4354-bf04-08fe70ce77ba None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:18.221769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc42d3-924b-4354-bf04-08fe70ce77ba None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:18.222042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc42d3-924b-4354-bf04-08fe70ce77ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:18.228792 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc42d3-924b-4354-bf04-08fe70ce77ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:18.230276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc42d3-924b-4354-bf04-08fe70ce77ba None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:18.246825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-b8cc42d3-924b-4354-bf04-08fe70ce77ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:18.246825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:18.246825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:18.246825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:18.246825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:18.246825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:18.246825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:18.246825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:18.246825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:18.246825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:18.246825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:18.246825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:18.246825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:18.246825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:18.246825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:18.247973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:18.249081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:18.249081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:18.249081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:18.249081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:18.249081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:18.249081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:18.249081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:18.249081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:18.249081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 604/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:18.252260 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712cd63-f997-455a-a902-42584fcb2c24 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:18.359937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712cd63-f997-455a-a902-42584fcb2c24 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:18.396510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadfdb7-a5ce-4919-9058-487139315259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:18.397215 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadfdb7-a5ce-4919-9058-487139315259 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:18.397494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadfdb7-a5ce-4919-9058-487139315259 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:18.400460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadfdb7-a5ce-4919-9058-487139315259 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:18.400460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadfdb7-a5ce-4919-9058-487139315259 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:18.400460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadfdb7-a5ce-4919-9058-487139315259 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:18.400460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadfdb7-a5ce-4919-9058-487139315259 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:18.414135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 627/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:18.420592 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc42d3-924b-4354-bf04-08fe70ce77ba None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:18.487951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:18.524765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc42d3-924b-4354-bf04-08fe70ce77ba None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:18.560696 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de359c5e-9706-4128-ae0c-cee1bdf0c1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:18.561691 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de359c5e-9706-4128-ae0c-cee1bdf0c1bd None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:18.561972 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de359c5e-9706-4128-ae0c-cee1bdf0c1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:18.562249 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de359c5e-9706-4128-ae0c-cee1bdf0c1bd None admin] PATH_INFO: `/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/b8fd088faaba4d5c9745638c14f1a7f5/roles/509fcb6f06144cdd9803fb3910eb80bf` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:18.580415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de359c5e-9706-4128-ae0c-cee1bdf0c1bd None admin] RBAC: Authorizing `identity:create_grant(project_id=40e0b5ee15df481cbc01333131f3def0, user_id=b8fd088faaba4d5c9745638c14f1a7f5, role_id=509fcb6f06144cdd9803fb3910eb80bf)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:18.581870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de359c5e-9706-4128-ae0c-cee1bdf0c1bd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:18.724008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 605/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:23:18 2022] PUT /identity/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/b8fd088faaba4d5c9745638c14f1a7f5/roles/509fcb6f06144cdd9803fb3910eb80bf => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:23:20.741767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060044dd-8940-465c-af09-227766bcc7c4 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:20.742419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060044dd-8940-465c-af09-227766bcc7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:20.742419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060044dd-8940-465c-af09-227766bcc7c4 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:20.743813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 628/1233] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:20.749125 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da706a0-5417-4c9b-932b-9da6bd538f8b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:20.749533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da706a0-5417-4c9b-932b-9da6bd538f8b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:20.749689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da706a0-5417-4c9b-932b-9da6bd538f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:20.766898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6da706a0-5417-4c9b-932b-9da6bd538f8b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:20.768081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6da706a0-5417-4c9b-932b-9da6bd538f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:20.836031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 606/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:20.860237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060044dd-8940-465c-af09-227766bcc7c4 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:20.886187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:20.963611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060044dd-8940-465c-af09-227766bcc7c4 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:20.998018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50074ef4-ff12-452a-99a9-a3ac15b3a0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:20.998753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50074ef4-ff12-452a-99a9-a3ac15b3a0ee None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:20.999037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50074ef4-ff12-452a-99a9-a3ac15b3a0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:20.999312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50074ef4-ff12-452a-99a9-a3ac15b3a0ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:21.009817 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50074ef4-ff12-452a-99a9-a3ac15b3a0ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-50074ef4-ff12-452a-99a9-a3ac15b3a0ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:21.017744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:21.022614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:21.023731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:21.023731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:21.023731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:21.023731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:21.023731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:21.023731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:21.023731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:21.023731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:21.023731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:21.023731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:21.023731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:21.023731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:21.023731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 629/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:21.025064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da706a0-5417-4c9b-932b-9da6bd538f8b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:21.072822 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:21.126686 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da706a0-5417-4c9b-932b-9da6bd538f8b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:21.162867 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577d04c-8e3e-4e21-92db-302500532625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:21.163544 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577d04c-8e3e-4e21-92db-302500532625 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:21.163831 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577d04c-8e3e-4e21-92db-302500532625 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:21.164112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577d04c-8e3e-4e21-92db-302500532625 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:21.164858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577d04c-8e3e-4e21-92db-302500532625 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:21.165166 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577d04c-8e3e-4e21-92db-302500532625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:21.166574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577d04c-8e3e-4e21-92db-302500532625 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:21.175885 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 607/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:21.181661 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50074ef4-ff12-452a-99a9-a3ac15b3a0ee None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:21.271636 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:21.288243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50074ef4-ff12-452a-99a9-a3ac15b3a0ee None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:21.323495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f2b19-671f-48c6-8870-2d446b6f8434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:21.324291 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2b19-671f-48c6-8870-2d446b6f8434 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:21.324571 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2b19-671f-48c6-8870-2d446b6f8434 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:21.324839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2b19-671f-48c6-8870-2d446b6f8434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:21.336200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f2b19-671f-48c6-8870-2d446b6f8434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:21.337676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f2b19-671f-48c6-8870-2d446b6f8434 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:21.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-037f2b19-671f-48c6-8870-2d446b6f8434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:21.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:21.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:21.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:21.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:21.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:21.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:21.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:21.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:21.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:21.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:21.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:21.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:21.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:21.362808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:21.364657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:21.366579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:21.366579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:21.366579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:21.366579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:21.366579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 630/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:21.370300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577d04c-8e3e-4e21-92db-302500532625 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:21.474162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577d04c-8e3e-4e21-92db-302500532625 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:21.484782 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:21.510150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40ce65-f734-48dc-86cb-8824eb67c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:21.511079 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40ce65-f734-48dc-86cb-8824eb67c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:21.511207 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40ce65-f734-48dc-86cb-8824eb67c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:21.511417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40ce65-f734-48dc-86cb-8824eb67c1f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:21.512159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40ce65-f734-48dc-86cb-8824eb67c1f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:21.512449 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40ce65-f734-48dc-86cb-8824eb67c1f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:21.513835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40ce65-f734-48dc-86cb-8824eb67c1f4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:21.527202 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 608/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:21.533031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f2b19-671f-48c6-8870-2d446b6f8434 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:21.649055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f2b19-671f-48c6-8870-2d446b6f8434 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:21.687238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6c83c-58de-44b5-b6f6-4f78104f80d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:21.688033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6c83c-58de-44b5-b6f6-4f78104f80d2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:21.688312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6c83c-58de-44b5-b6f6-4f78104f80d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:21.688584 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6c83c-58de-44b5-b6f6-4f78104f80d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:21.691360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:21.696186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6c83c-58de-44b5-b6f6-4f78104f80d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:21.697776 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6c83c-58de-44b5-b6f6-4f78104f80d2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-7fd6c83c-58de-44b5-b6f6-4f78104f80d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:21.716487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:21.717761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:21.718948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:21.718948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:21.718948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:21.718948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:21.718948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:21.718948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:21.718948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:21.718948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:21.718948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:23:21.718948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:21.718948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 631/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:21.724791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40ce65-f734-48dc-86cb-8824eb67c1f4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:21.844305 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40ce65-f734-48dc-86cb-8824eb67c1f4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:21.881073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4a488-09f4-4c50-9b3d-54f49e6fc1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:21.881854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4a488-09f4-4c50-9b3d-54f49e6fc1ec None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:21.882063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4a488-09f4-4c50-9b3d-54f49e6fc1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:21.882399 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4a488-09f4-4c50-9b3d-54f49e6fc1ec None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:21.883195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4a488-09f4-4c50-9b3d-54f49e6fc1ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:21.883754 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4a488-09f4-4c50-9b3d-54f49e6fc1ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:21.885176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4a488-09f4-4c50-9b3d-54f49e6fc1ec None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:21.910125 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 609/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 18 10:23:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:21.916997 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6c83c-58de-44b5-b6f6-4f78104f80d2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:22.040890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6c83c-58de-44b5-b6f6-4f78104f80d2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:22.084493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db208ab8-3db9-4bc5-9e71-f2d748f63395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:22.085164 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db208ab8-3db9-4bc5-9e71-f2d748f63395 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:22.088553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db208ab8-3db9-4bc5-9e71-f2d748f63395 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:22.093023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db208ab8-3db9-4bc5-9e71-f2d748f63395 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.169176 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:22.176015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db208ab8-3db9-4bc5-9e71-f2d748f63395 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:22.177511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db208ab8-3db9-4bc5-9e71-f2d748f63395 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:22.286404 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 632/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:23:22.293493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4a488-09f4-4c50-9b3d-54f49e6fc1ec None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:22.330931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:22.416474 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4a488-09f4-4c50-9b3d-54f49e6fc1ec None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:22.457769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a78637-1da9-4f43-b488-e4fdc1d56e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:22.458518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a78637-1da9-4f43-b488-e4fdc1d56e9d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:22.458794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a78637-1da9-4f43-b488-e4fdc1d56e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:22.459064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a78637-1da9-4f43-b488-e4fdc1d56e9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.469889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a78637-1da9-4f43-b488-e4fdc1d56e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:22.471361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a78637-1da9-4f43-b488-e4fdc1d56e9d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:22.490515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-05a78637-1da9-4f43-b488-e4fdc1d56e9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:22.490515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:22.490515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:22.490515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:22.490515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:22.490515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:22.490515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:22.490515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:22.490515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:22.490515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:22.490515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:22.490515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:22.490515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:22.490515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:22.490515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:22.494241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:22.496314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:22.496314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:22.496314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:22.496314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:22.496314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 610/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:22.499227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db208ab8-3db9-4bc5-9e71-f2d748f63395 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:22.606296 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:22.612225 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db208ab8-3db9-4bc5-9e71-f2d748f63395 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:22.646302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717a95-a78f-4e50-a3ea-2bdca7a6118e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:22.647010 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717a95-a78f-4e50-a3ea-2bdca7a6118e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:22.647294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717a95-a78f-4e50-a3ea-2bdca7a6118e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:22.647573 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717a95-a78f-4e50-a3ea-2bdca7a6118e None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.648282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0717a95-a78f-4e50-a3ea-2bdca7a6118e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:22.648588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0717a95-a78f-4e50-a3ea-2bdca7a6118e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:22.649959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0717a95-a78f-4e50-a3ea-2bdca7a6118e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:22.661546 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 633/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:22.667811 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a78637-1da9-4f43-b488-e4fdc1d56e9d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:22.748956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:22.771263 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a78637-1da9-4f43-b488-e4fdc1d56e9d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:22.805501 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e492d8d-db9f-4803-a1f7-b85d7eaeb349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:22.806506 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e492d8d-db9f-4803-a1f7-b85d7eaeb349 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:22.806901 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e492d8d-db9f-4803-a1f7-b85d7eaeb349 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:22.807290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e492d8d-db9f-4803-a1f7-b85d7eaeb349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.815434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e492d8d-db9f-4803-a1f7-b85d7eaeb349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:22.816877 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e492d8d-db9f-4803-a1f7-b85d7eaeb349 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:22.830727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-8e492d8d-db9f-4803-a1f7-b85d7eaeb349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:22.830727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:22.830727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:22.830727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:22.830727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:22.830727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:22.830727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:22.830727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:22.830727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:22.830727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:22.830727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:22.830727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:22.830727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:22.830727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:22.830727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:22.831805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:22.833049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:22.833049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:22.833049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:22.833049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:22.833049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:22.833049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:22.833049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:22.833049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:22.833049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 611/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:22.837861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717a95-a78f-4e50-a3ea-2bdca7a6118e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:22.948679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717a95-a78f-4e50-a3ea-2bdca7a6118e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:22.983602 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3798ab-f2e1-4cd4-bfb5-6aef55565687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:22.984376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3798ab-f2e1-4cd4-bfb5-6aef55565687 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:22.984740 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3798ab-f2e1-4cd4-bfb5-6aef55565687 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:22.985124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3798ab-f2e1-4cd4-bfb5-6aef55565687 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.985996 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3798ab-f2e1-4cd4-bfb5-6aef55565687 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:22.986435 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3798ab-f2e1-4cd4-bfb5-6aef55565687 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:22.987953 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3798ab-f2e1-4cd4-bfb5-6aef55565687 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:23.001113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 634/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:23.007337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e492d8d-db9f-4803-a1f7-b85d7eaeb349 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:23.121165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e492d8d-db9f-4803-a1f7-b85d7eaeb349 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:23.157120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6a0e8-719e-41cb-af18-787372559dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:23.157764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6a0e8-719e-41cb-af18-787372559dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:23.158046 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6a0e8-719e-41cb-af18-787372559dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:23.158348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6a0e8-719e-41cb-af18-787372559dc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:23.159188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6a0e8-719e-41cb-af18-787372559dc1 None admin] RBAC: Adding query filter params (role.id=509fcb6f06144cdd9803fb3910eb80bf, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=b8fd088faaba4d5c9745638c14f1a7f5) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:23.159495 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6a0e8-719e-41cb-af18-787372559dc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:23.161131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6a0e8-719e-41cb-af18-787372559dc1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:23.169124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 612/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:23 2022] GET /identity/v3/role_assignments?user.id=b8fd088faaba4d5c9745638c14f1a7f5&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=509fcb6f06144cdd9803fb3910eb80bf => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:25.265721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80bda4-cb62-474b-9198-da73c9848299 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:25.266252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80bda4-cb62-474b-9198-da73c9848299 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:25.266252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80bda4-cb62-474b-9198-da73c9848299 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:25.267710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 635/1247] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:25.273173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066bf0f-56bf-4858-8c1f-a6d5cbfd94ef None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:25.274686 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066bf0f-56bf-4858-8c1f-a6d5cbfd94ef None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:25.274686 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066bf0f-56bf-4858-8c1f-a6d5cbfd94ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:25.278903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:25.290933 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8066bf0f-56bf-4858-8c1f-a6d5cbfd94ef None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:25.292120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8066bf0f-56bf-4858-8c1f-a6d5cbfd94ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:25.359889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 613/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:25.384204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80bda4-cb62-474b-9198-da73c9848299 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:25.403344 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:25.485598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80bda4-cb62-474b-9198-da73c9848299 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:25.519280 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20316c1-e65d-493f-8a9c-29d462817ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:25.519987 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20316c1-e65d-493f-8a9c-29d462817ebb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:25.520267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20316c1-e65d-493f-8a9c-29d462817ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:25.520540 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20316c1-e65d-493f-8a9c-29d462817ebb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:25.530549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20316c1-e65d-493f-8a9c-29d462817ebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-b20316c1-e65d-493f-8a9c-29d462817ebb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:25.538162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:25.543317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:25.544177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:25.544177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:25.544177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:25.544177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:25.544177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:25.544177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:25.544177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:25.544177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:25.544177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:25.544177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:25.544177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:25.544177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:25.544177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 636/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:25.545848 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066bf0f-56bf-4858-8c1f-a6d5cbfd94ef None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:25.650581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066bf0f-56bf-4858-8c1f-a6d5cbfd94ef None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:25.680494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:25.686256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd5cc6-6bc8-457e-ac87-1da7d7e106c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:25.686994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd5cc6-6bc8-457e-ac87-1da7d7e106c6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:25.687361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd5cc6-6bc8-457e-ac87-1da7d7e106c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:25.687641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd5cc6-6bc8-457e-ac87-1da7d7e106c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:25.688485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd5cc6-6bc8-457e-ac87-1da7d7e106c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:25.688807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd5cc6-6bc8-457e-ac87-1da7d7e106c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:25.690179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd5cc6-6bc8-457e-ac87-1da7d7e106c6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:25.698945 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 614/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:25.704891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20316c1-e65d-493f-8a9c-29d462817ebb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:25.797077 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:25.823414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20316c1-e65d-493f-8a9c-29d462817ebb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:25.860316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3bfde-ac42-4c6e-a10b-3581d7349954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:25.861128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3bfde-ac42-4c6e-a10b-3581d7349954 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:25.861409 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3bfde-ac42-4c6e-a10b-3581d7349954 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:25.861684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3bfde-ac42-4c6e-a10b-3581d7349954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:25.873999 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3bfde-ac42-4c6e-a10b-3581d7349954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:25.875594 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3bfde-ac42-4c6e-a10b-3581d7349954 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:25.895186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e4b3bfde-ac42-4c6e-a10b-3581d7349954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:25.895186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:25.895186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:25.895186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:25.895186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:25.895186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:25.895186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:25.895186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:25.895186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:25.895186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:25.895186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:25.895186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:25.895186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:25.895186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:25.895186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:25.900113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:25.901427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:25.901427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:25.901427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:25.901427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:25.901427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 637/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:25.903635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd5cc6-6bc8-457e-ac87-1da7d7e106c6 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:26.017841 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd5cc6-6bc8-457e-ac87-1da7d7e106c6 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:26.053642 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c8e10-86fe-40d3-a681-af23cc294165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:26.054229 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c8e10-86fe-40d3-a681-af23cc294165 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:26.054568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c8e10-86fe-40d3-a681-af23cc294165 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:26.054888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c8e10-86fe-40d3-a681-af23cc294165 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:26.055617 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c8e10-86fe-40d3-a681-af23cc294165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:26.055918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c8e10-86fe-40d3-a681-af23cc294165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:26.057309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c8e10-86fe-40d3-a681-af23cc294165 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:26.071414 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 615/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:26.077880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3bfde-ac42-4c6e-a10b-3581d7349954 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:26.181990 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3bfde-ac42-4c6e-a10b-3581d7349954 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:26.210609 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:26.218606 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d649e6-650a-46bd-af55-4f919fa36a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:26.219405 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d649e6-650a-46bd-af55-4f919fa36a49 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:26.219687 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d649e6-650a-46bd-af55-4f919fa36a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:26.219965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d649e6-650a-46bd-af55-4f919fa36a49 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:26.227647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d649e6-650a-46bd-af55-4f919fa36a49 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:26.229102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d649e6-650a-46bd-af55-4f919fa36a49 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-86d649e6-650a-46bd-af55-4f919fa36a49 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:26.244034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:26.245829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:26.246956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:26.246956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:26.246956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:26.246956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:26.246956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:26.246956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:26.246956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:26.246956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:26.246956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:23:26.246956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:26.246956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 638/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:26.252200 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c8e10-86fe-40d3-a681-af23cc294165 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:26.308992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:26.355662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c8e10-86fe-40d3-a681-af23cc294165 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:26.390833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae94fc4-d2b4-4a7d-b3e0-d8d3d25df653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:26.391604 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae94fc4-d2b4-4a7d-b3e0-d8d3d25df653 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:26.391940 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae94fc4-d2b4-4a7d-b3e0-d8d3d25df653 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:26.392275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae94fc4-d2b4-4a7d-b3e0-d8d3d25df653 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:26.393165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae94fc4-d2b4-4a7d-b3e0-d8d3d25df653 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:26.393522 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae94fc4-d2b4-4a7d-b3e0-d8d3d25df653 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:26.395139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae94fc4-d2b4-4a7d-b3e0-d8d3d25df653 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:26.414291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 616/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 18 10:23:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:26.420179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d649e6-650a-46bd-af55-4f919fa36a49 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:26.524270 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d649e6-650a-46bd-af55-4f919fa36a49 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:26.560700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c580a-faec-4456-84f7-1648dacbaeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:26.561309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c580a-faec-4456-84f7-1648dacbaeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:26.561622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c580a-faec-4456-84f7-1648dacbaeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:26.561898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c580a-faec-4456-84f7-1648dacbaeb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:26.621598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:26.633937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c580a-faec-4456-84f7-1648dacbaeb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:26.635439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c580a-faec-4456-84f7-1648dacbaeb2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:26.736236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 639/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:23:26.742158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae94fc4-d2b4-4a7d-b3e0-d8d3d25df653 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:26.850435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae94fc4-d2b4-4a7d-b3e0-d8d3d25df653 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:26.864442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:26.887598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfc564-2ead-4881-9328-3c15644c72c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:26.888451 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfc564-2ead-4881-9328-3c15644c72c1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:26.888776 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfc564-2ead-4881-9328-3c15644c72c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:26.889095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfc564-2ead-4881-9328-3c15644c72c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:26.899405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfc564-2ead-4881-9328-3c15644c72c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:26.900859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfc564-2ead-4881-9328-3c15644c72c1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:26.919626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-80bfc564-2ead-4881-9328-3c15644c72c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:26.919626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:26.919626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:26.919626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:26.919626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:26.919626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:26.919626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:26.919626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:26.919626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:26.919626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:26.919626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:26.919626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:26.919626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:26.919626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:26.919626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:26.920858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:26.922053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:26.922053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:26.922053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:26.922053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:26.922053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 617/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:26.926601 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c580a-faec-4456-84f7-1648dacbaeb2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:27.015809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:27.028516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c580a-faec-4456-84f7-1648dacbaeb2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:27.062990 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c966894-6011-4973-83c0-71cbaa47503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:27.063647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c966894-6011-4973-83c0-71cbaa47503d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.063933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c966894-6011-4973-83c0-71cbaa47503d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.064212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c966894-6011-4973-83c0-71cbaa47503d None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.064928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c966894-6011-4973-83c0-71cbaa47503d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:27.065232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c966894-6011-4973-83c0-71cbaa47503d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:27.066632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c966894-6011-4973-83c0-71cbaa47503d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:27.078529 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 640/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:27.084281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfc564-2ead-4881-9328-3c15644c72c1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:27.188525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfc564-2ead-4881-9328-3c15644c72c1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:27.224206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83ffce-8fdf-46c3-9a32-d0cc1d53176a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:27.225003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83ffce-8fdf-46c3-9a32-d0cc1d53176a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.225260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83ffce-8fdf-46c3-9a32-d0cc1d53176a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.225533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83ffce-8fdf-46c3-9a32-d0cc1d53176a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.232530 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83ffce-8fdf-46c3-9a32-d0cc1d53176a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:27.233996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83ffce-8fdf-46c3-9a32-d0cc1d53176a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:27.248060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-5f83ffce-8fdf-46c3-9a32-d0cc1d53176a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:27.248060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:27.248060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:27.248060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:27.248060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:27.248060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:27.248060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:27.248060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:27.248060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:27.248060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:27.248060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:27.248060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:27.248060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:27.248060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:27.248060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:27.249217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:27.250264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:27.250264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:27.250264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:27.250264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:27.250264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:27.250264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:27.250264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:27.250264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:27.250264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 618/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:27.255305 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c966894-6011-4973-83c0-71cbaa47503d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:27.358629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c966894-6011-4973-83c0-71cbaa47503d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:27.395702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3d77f-3149-42db-bc67-aebec4c3c94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:27.396355 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3d77f-3149-42db-bc67-aebec4c3c94c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.396632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3d77f-3149-42db-bc67-aebec4c3c94c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.396905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3d77f-3149-42db-bc67-aebec4c3c94c None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.397676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3d77f-3149-42db-bc67-aebec4c3c94c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:27.397987 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3d77f-3149-42db-bc67-aebec4c3c94c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:27.399481 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3d77f-3149-42db-bc67-aebec4c3c94c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:27.412526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 641/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:27.419302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83ffce-8fdf-46c3-9a32-d0cc1d53176a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:27.454814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:27.521563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83ffce-8fdf-46c3-9a32-d0cc1d53176a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:27.558900 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd8497-7e4a-48a4-af91-2e0e2fa30706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:27.559556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd8497-7e4a-48a4-af91-2e0e2fa30706 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.559842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd8497-7e4a-48a4-af91-2e0e2fa30706 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.560121 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd8497-7e4a-48a4-af91-2e0e2fa30706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.560956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd8497-7e4a-48a4-af91-2e0e2fa30706 None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=b8fd088faaba4d5c9745638c14f1a7f5) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:27.561272 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd8497-7e4a-48a4-af91-2e0e2fa30706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:27.562815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd8497-7e4a-48a4-af91-2e0e2fa30706 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:27.568885 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 619/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:27 2022] GET /identity/v3/role_assignments?user.id=b8fd088faaba4d5c9745638c14f1a7f5&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:29.614037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38c2ec-39fb-4fd3-a77a-44415ac9a6a9 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:29.614632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38c2ec-39fb-4fd3-a77a-44415ac9a6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:29.614632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38c2ec-39fb-4fd3-a77a-44415ac9a6a9 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:29.616120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 642/1261] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:29.622261 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b3a6b-5116-4397-81bb-980a1c9beea3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:29.622732 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b3a6b-5116-4397-81bb-980a1c9beea3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:29.622881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b3a6b-5116-4397-81bb-980a1c9beea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:29.640527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e15b3a6b-5116-4397-81bb-980a1c9beea3 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:29.647770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e15b3a6b-5116-4397-81bb-980a1c9beea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:29.710622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 620/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:23:29.735251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38c2ec-39fb-4fd3-a77a-44415ac9a6a9 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:29.746480 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:29.842131 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38c2ec-39fb-4fd3-a77a-44415ac9a6a9 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:29.878859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d53784-87e9-4d18-be42-b21f82df103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:29.879579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d53784-87e9-4d18-be42-b21f82df103c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:29.879861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d53784-87e9-4d18-be42-b21f82df103c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:29.880132 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d53784-87e9-4d18-be42-b21f82df103c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:29.893078 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d53784-87e9-4d18-be42-b21f82df103c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-02d53784-87e9-4d18-be42-b21f82df103c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:29.901124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:29.906443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:29.907651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:29.907651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:29.907651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:29.907651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:29.907651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:29.907651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:29.907651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:29.907651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:29.907651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:29.907651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:29.907651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:29.907651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:29.907651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 643/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:29.909304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b3a6b-5116-4397-81bb-980a1c9beea3 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:29.929531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:30.011314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b3a6b-5116-4397-81bb-980a1c9beea3 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:30.049721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34810d1d-dca8-4082-a12f-e9bb92e828e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:30.050417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34810d1d-dca8-4082-a12f-e9bb92e828e6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:30.050732 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34810d1d-dca8-4082-a12f-e9bb92e828e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:30.050973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34810d1d-dca8-4082-a12f-e9bb92e828e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:30.051721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34810d1d-dca8-4082-a12f-e9bb92e828e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:30.052020 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34810d1d-dca8-4082-a12f-e9bb92e828e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:30.053490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34810d1d-dca8-4082-a12f-e9bb92e828e6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:30.061936 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 621/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:30.067880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d53784-87e9-4d18-be42-b21f82df103c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:30.139695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:30.174109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d53784-87e9-4d18-be42-b21f82df103c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:30.210762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d69c08-2eca-4619-86c4-b69744449f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:30.210762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d69c08-2eca-4619-86c4-b69744449f4f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:30.210762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d69c08-2eca-4619-86c4-b69744449f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:30.210762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d69c08-2eca-4619-86c4-b69744449f4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:30.221936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d69c08-2eca-4619-86c4-b69744449f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:30.223440 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d69c08-2eca-4619-86c4-b69744449f4f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:30.241697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-67d69c08-2eca-4619-86c4-b69744449f4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:30.241697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:30.241697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:30.241697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:30.241697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:30.241697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:30.241697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:30.241697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:30.241697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:30.241697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:30.241697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:30.241697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:30.241697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:30.241697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:30.241697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:30.242848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:30.243993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:30.243993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:30.243993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:30.243993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:30.243993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 644/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:30.248953 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34810d1d-dca8-4082-a12f-e9bb92e828e6 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:30.335205 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:30.355897 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34810d1d-dca8-4082-a12f-e9bb92e828e6 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:30.390629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43603f-65e2-4ce3-b0b9-97ca6ba84d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:30.391234 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43603f-65e2-4ce3-b0b9-97ca6ba84d2c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:30.391518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43603f-65e2-4ce3-b0b9-97ca6ba84d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:30.391802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43603f-65e2-4ce3-b0b9-97ca6ba84d2c None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:30.392534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43603f-65e2-4ce3-b0b9-97ca6ba84d2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:30.392843 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43603f-65e2-4ce3-b0b9-97ca6ba84d2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:30.394237 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43603f-65e2-4ce3-b0b9-97ca6ba84d2c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:30.407534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 622/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:30.413327 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d69c08-2eca-4619-86c4-b69744449f4f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:30.521347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d69c08-2eca-4619-86c4-b69744449f4f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:30.544456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:30.561448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea65c9f-dd08-43f5-a3f4-bbf776e150ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:30.562394 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea65c9f-dd08-43f5-a3f4-bbf776e150ea None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:30.562678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea65c9f-dd08-43f5-a3f4-bbf776e150ea None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:30.562952 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea65c9f-dd08-43f5-a3f4-bbf776e150ea None admin] PATH_INFO: `/v3/users/placement` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:30.571984 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea65c9f-dd08-43f5-a3f4-bbf776e150ea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:30.574693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea65c9f-dd08-43f5-a3f4-bbf776e150ea None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-eea65c9f-dd08-43f5-a3f4-bbf776e150ea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:30.590992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:30.599178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:30.600365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:30.600365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:30.600365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:30.600365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:30.600365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:30.600365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:30.600365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:30.600365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:30.600365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:23:30.600365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:30.600365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 645/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:30.601145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43603f-65e2-4ce3-b0b9-97ca6ba84d2c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:30.714801 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43603f-65e2-4ce3-b0b9-97ca6ba84d2c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:30.754088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462156f-6b20-46ba-bfde-de8738bb058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:30.754985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462156f-6b20-46ba-bfde-de8738bb058f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:30.755371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462156f-6b20-46ba-bfde-de8738bb058f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:30.755755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462156f-6b20-46ba-bfde-de8738bb058f None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:30.756878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462156f-6b20-46ba-bfde-de8738bb058f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:30.757283 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462156f-6b20-46ba-bfde-de8738bb058f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:30.759344 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462156f-6b20-46ba-bfde-de8738bb058f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:30.771047 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:30.781434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 623/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 18 10:23:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:30.787983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea65c9f-dd08-43f5-a3f4-bbf776e150ea None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:30.907329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea65c9f-dd08-43f5-a3f4-bbf776e150ea None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:30.944058 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b8d7d-2f21-40cb-8ea7-8ba48b43e79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:30.944854 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b8d7d-2f21-40cb-8ea7-8ba48b43e79a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:30.945136 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b8d7d-2f21-40cb-8ea7-8ba48b43e79a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:30.945416 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b8d7d-2f21-40cb-8ea7-8ba48b43e79a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:30.957470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b8d7d-2f21-40cb-8ea7-8ba48b43e79a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:30.959001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b8d7d-2f21-40cb-8ea7-8ba48b43e79a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:30.978053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e09b8d7d-2f21-40cb-8ea7-8ba48b43e79a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:30.978053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:30.978053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:30.978053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:30.978053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:30.978053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:30.978053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:30.978053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:30.978053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:30.978053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:30.978053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:30.978053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:30.978053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:30.978053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:30.978053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:30.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:30.981156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:30.981156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:30.981156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:30.981156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:30.981156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 646/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:30.985727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462156f-6b20-46ba-bfde-de8738bb058f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:31.090509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462156f-6b20-46ba-bfde-de8738bb058f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:31.126695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8c3eb-eb72-4285-b20b-45918bfa6452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:31.127362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8c3eb-eb72-4285-b20b-45918bfa6452 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.127645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8c3eb-eb72-4285-b20b-45918bfa6452 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.127912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8c3eb-eb72-4285-b20b-45918bfa6452 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.128633 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8c3eb-eb72-4285-b20b-45918bfa6452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:31.128936 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8c3eb-eb72-4285-b20b-45918bfa6452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:31.130312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8c3eb-eb72-4285-b20b-45918bfa6452 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:31.144267 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 624/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:31.148736 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b8d7d-2f21-40cb-8ea7-8ba48b43e79a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:31.184326 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:31.262274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b8d7d-2f21-40cb-8ea7-8ba48b43e79a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:31.302117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d579010-ac2f-49ea-bd01-046b9e7865af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:31.303213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d579010-ac2f-49ea-bd01-046b9e7865af None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.303497 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d579010-ac2f-49ea-bd01-046b9e7865af None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.303773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d579010-ac2f-49ea-bd01-046b9e7865af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.312334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d579010-ac2f-49ea-bd01-046b9e7865af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:31.313980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d579010-ac2f-49ea-bd01-046b9e7865af None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:31.329277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-0d579010-ac2f-49ea-bd01-046b9e7865af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:31.329277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:31.329277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:31.329277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:31.329277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:31.329277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:31.329277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:31.329277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:31.329277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:31.329277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:31.329277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:31.329277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:31.329277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:31.329277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:31.329277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:31.330371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:31.338752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:31.338752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:31.338752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:31.338752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:31.338752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:31.338752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:31.338752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:31.338752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:31.338752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 647/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:31.339953 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8c3eb-eb72-4285-b20b-45918bfa6452 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:31.399304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:31.442520 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8c3eb-eb72-4285-b20b-45918bfa6452 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:31.479064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035bedf-fd6a-489e-ad8c-462c2fa8daf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:31.480391 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035bedf-fd6a-489e-ad8c-462c2fa8daf8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.480683 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035bedf-fd6a-489e-ad8c-462c2fa8daf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.480957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035bedf-fd6a-489e-ad8c-462c2fa8daf8 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.481890 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035bedf-fd6a-489e-ad8c-462c2fa8daf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:31.482196 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035bedf-fd6a-489e-ad8c-462c2fa8daf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:31.483691 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035bedf-fd6a-489e-ad8c-462c2fa8daf8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:31.497053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 625/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:31.503341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d579010-ac2f-49ea-bd01-046b9e7865af None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:31.608424 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:31.617267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d579010-ac2f-49ea-bd01-046b9e7865af None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:31.657021 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe41ab-cae1-46db-ba3a-2fae7538cfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:31.657918 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe41ab-cae1-46db-ba3a-2fae7538cfca None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.658200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe41ab-cae1-46db-ba3a-2fae7538cfca None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.658543 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe41ab-cae1-46db-ba3a-2fae7538cfca None admin] PATH_INFO: `/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/b8fd088faaba4d5c9745638c14f1a7f5/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.660510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe41ab-cae1-46db-ba3a-2fae7538cfca None admin] RBAC: Authorizing `identity:create_grant(project_id=40e0b5ee15df481cbc01333131f3def0, user_id=b8fd088faaba4d5c9745638c14f1a7f5, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:31.662019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe41ab-cae1-46db-ba3a-2fae7538cfca None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:31.735906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 648/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 18 10:23:31 2022] PUT /identity/v3/projects/40e0b5ee15df481cbc01333131f3def0/users/b8fd088faaba4d5c9745638c14f1a7f5/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:23:33.789049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb3377-3eb7-40ca-8348-999f999a8a25 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:33.789613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb3377-3eb7-40ca-8348-999f999a8a25 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:33.789815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb3377-3eb7-40ca-8348-999f999a8a25 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:33.792312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 626/1274] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:23:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:33.798289 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff0cf9-b640-4bdd-bb39-628880f3ac24 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:33.798816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff0cf9-b640-4bdd-bb39-628880f3ac24 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:33.798926 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff0cf9-b640-4bdd-bb39-628880f3ac24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:33.820422 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7aff0cf9-b640-4bdd-bb39-628880f3ac24 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:33.821651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7aff0cf9-b640-4bdd-bb39-628880f3ac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:33.895481 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 649/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:33.920483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb3377-3eb7-40ca-8348-999f999a8a25 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:34.044217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb3377-3eb7-40ca-8348-999f999a8a25 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:34.066591 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:34.085444 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29a38e-58a8-4d48-a281-f9a758cbf77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:34.086241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29a38e-58a8-4d48-a281-f9a758cbf77a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.086548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29a38e-58a8-4d48-a281-f9a758cbf77a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.086819 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29a38e-58a8-4d48-a281-f9a758cbf77a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.105431 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29a38e-58a8-4d48-a281-f9a758cbf77a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-2e29a38e-58a8-4d48-a281-f9a758cbf77a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:34.106755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:34.124241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:34.126123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:34.126123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:34.126123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:34.126123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:34.126123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:34.126123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:34.126123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:34.126123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:34.126123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:34.126123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:34.126123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:34.126123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:34.126123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 627/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:34.127964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff0cf9-b640-4bdd-bb39-628880f3ac24 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:34.208975 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:34.228845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff0cf9-b640-4bdd-bb39-628880f3ac24 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:34.266747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae92db4-286d-4629-b458-b19567e557c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:34.267431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae92db4-286d-4629-b458-b19567e557c4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.267716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae92db4-286d-4629-b458-b19567e557c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.267992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae92db4-286d-4629-b458-b19567e557c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.268752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae92db4-286d-4629-b458-b19567e557c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:34.269058 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae92db4-286d-4629-b458-b19567e557c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:34.270473 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae92db4-286d-4629-b458-b19567e557c4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:34.280781 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 650/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:34.286714 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29a38e-58a8-4d48-a281-f9a758cbf77a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:34.406535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29a38e-58a8-4d48-a281-f9a758cbf77a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:34.441365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9b745-5a3d-42e7-8570-ba50e079b381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:34.443212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9b745-5a3d-42e7-8570-ba50e079b381 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.443212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9b745-5a3d-42e7-8570-ba50e079b381 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.443212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9b745-5a3d-42e7-8570-ba50e079b381 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.455889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9b745-5a3d-42e7-8570-ba50e079b381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:34.457337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9b745-5a3d-42e7-8570-ba50e079b381 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:34.474734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-ece9b745-5a3d-42e7-8570-ba50e079b381 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:34.474734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:34.474734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:34.474734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:34.474734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:34.474734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:34.474734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:34.474734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:34.474734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:34.474734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:34.474734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:34.474734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:34.474734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:34.474734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:34.474734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:34.475830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:34.476859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:34.476859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:34.476859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:34.476859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:34.476859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 628/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:34.482520 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae92db4-286d-4629-b458-b19567e557c4 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:34.590069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae92db4-286d-4629-b458-b19567e557c4 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:34.627828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d02e06-8ede-4acc-8899-684c5e86fd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:34.628493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d02e06-8ede-4acc-8899-684c5e86fd95 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.628776 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d02e06-8ede-4acc-8899-684c5e86fd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.629053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d02e06-8ede-4acc-8899-684c5e86fd95 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.629791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d02e06-8ede-4acc-8899-684c5e86fd95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:34.630106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d02e06-8ede-4acc-8899-684c5e86fd95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:34.631526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d02e06-8ede-4acc-8899-684c5e86fd95 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:34.646284 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 651/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:34.652710 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9b745-5a3d-42e7-8570-ba50e079b381 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:34.685839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:34.762298 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9b745-5a3d-42e7-8570-ba50e079b381 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:34.799938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea6da2-241f-4d64-9345-98655e2e82b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:34.800745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea6da2-241f-4d64-9345-98655e2e82b0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.801024 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea6da2-241f-4d64-9345-98655e2e82b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.801295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea6da2-241f-4d64-9345-98655e2e82b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.810209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea6da2-241f-4d64-9345-98655e2e82b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:34.811697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea6da2-241f-4d64-9345-98655e2e82b0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-6fea6da2-241f-4d64-9345-98655e2e82b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:34.826960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:34.828178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:34.829378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:34.829378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:34.829378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:34.829378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:34.829378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:34.829378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:34.829378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:34.829378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:34.829378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:23:34.829378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:34.829378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 629/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:34.835980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d02e06-8ede-4acc-8899-684c5e86fd95 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:34.840450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:34.962036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d02e06-8ede-4acc-8899-684c5e86fd95 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:35.004927 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522d15c-0b8b-403a-9ca4-bfd5bc7ecab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:35.005804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522d15c-0b8b-403a-9ca4-bfd5bc7ecab4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:35.006153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522d15c-0b8b-403a-9ca4-bfd5bc7ecab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:35.006599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522d15c-0b8b-403a-9ca4-bfd5bc7ecab4 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:35.011224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522d15c-0b8b-403a-9ca4-bfd5bc7ecab4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:35.011224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522d15c-0b8b-403a-9ca4-bfd5bc7ecab4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:35.011224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522d15c-0b8b-403a-9ca4-bfd5bc7ecab4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:35.032485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 652/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 18 10:23:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:35.038678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea6da2-241f-4d64-9345-98655e2e82b0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:35.144439 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:35.154987 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea6da2-241f-4d64-9345-98655e2e82b0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:35.190273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617306c-04e2-4509-affd-98183906fc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:35.190969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617306c-04e2-4509-affd-98183906fc73 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:35.191241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617306c-04e2-4509-affd-98183906fc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:35.191514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617306c-04e2-4509-affd-98183906fc73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:35.272752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617306c-04e2-4509-affd-98183906fc73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:35.274302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617306c-04e2-4509-affd-98183906fc73 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:35.384288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:35.395251 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 630/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 10:23:35.401074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522d15c-0b8b-403a-9ca4-bfd5bc7ecab4 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:35.487647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:35.537626 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522d15c-0b8b-403a-9ca4-bfd5bc7ecab4 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:35.574913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe32a7-6868-4394-8606-34225c18b527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:35.575716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe32a7-6868-4394-8606-34225c18b527 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:35.575996 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe32a7-6868-4394-8606-34225c18b527 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:35.576265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe32a7-6868-4394-8606-34225c18b527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:35.588511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe32a7-6868-4394-8606-34225c18b527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:35.590556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe32a7-6868-4394-8606-34225c18b527 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:35.608855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-5cfe32a7-6868-4394-8606-34225c18b527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:35.608855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:35.608855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:35.608855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:35.608855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:35.608855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:35.608855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:35.608855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:35.608855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:35.608855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:35.608855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:35.608855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:35.608855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:35.608855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:35.608855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:35.610020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:35.611220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:35.611220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:35.611220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:35.611220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:35.611220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 653/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:35.616328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617306c-04e2-4509-affd-98183906fc73 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:35.726533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617306c-04e2-4509-affd-98183906fc73 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:35.787144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c1ae6-0116-49e2-ad59-c0492b319d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:35.787875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c1ae6-0116-49e2-ad59-c0492b319d1d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:35.788105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c1ae6-0116-49e2-ad59-c0492b319d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:35.788375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c1ae6-0116-49e2-ad59-c0492b319d1d None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:35.789097 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c1ae6-0116-49e2-ad59-c0492b319d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:35.789400 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c1ae6-0116-49e2-ad59-c0492b319d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:35.790832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c1ae6-0116-49e2-ad59-c0492b319d1d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:35.814841 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 631/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:35.821190 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe32a7-6868-4394-8606-34225c18b527 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:35.952734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe32a7-6868-4394-8606-34225c18b527 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:35.972169 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:35.997047 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03de07-c0e3-4ead-a2b8-32cd2257dd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:35.997851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03de07-c0e3-4ead-a2b8-32cd2257dd70 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:35.998161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03de07-c0e3-4ead-a2b8-32cd2257dd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:35.998445 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03de07-c0e3-4ead-a2b8-32cd2257dd70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:36.013427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03de07-c0e3-4ead-a2b8-32cd2257dd70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:36.014995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03de07-c0e3-4ead-a2b8-32cd2257dd70 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:36.031232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-cd03de07-c0e3-4ead-a2b8-32cd2257dd70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:36.031232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:36.031232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:36.031232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:36.031232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:36.031232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:36.031232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:36.031232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:36.031232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:36.031232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:36.031232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:36.031232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:36.031232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:36.031232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:36.031232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:36.032991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:36.034600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:36.034600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:36.034600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:36.034600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:36.034600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:36.034600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:36.034600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:36.034600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: ERROR keystone.server.flask.application Jul 18 10:23:36.034600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 654/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:36.038545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c1ae6-0116-49e2-ad59-c0492b319d1d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:36.096534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:36.155518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c1ae6-0116-49e2-ad59-c0492b319d1d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:36.194463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54944690-553c-444c-a661-1d4ce22ffdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:36.198656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54944690-553c-444c-a661-1d4ce22ffdeb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:36.198656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54944690-553c-444c-a661-1d4ce22ffdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:36.198656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54944690-553c-444c-a661-1d4ce22ffdeb None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:36.198656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54944690-553c-444c-a661-1d4ce22ffdeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:36.198656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54944690-553c-444c-a661-1d4ce22ffdeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:36.198656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54944690-553c-444c-a661-1d4ce22ffdeb None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:36.219769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 632/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:36.227750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03de07-c0e3-4ead-a2b8-32cd2257dd70 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:36.346889 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03de07-c0e3-4ead-a2b8-32cd2257dd70 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:36.387218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4d975-2e16-4fff-96fc-6f97aa52cbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:36.387889 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4d975-2e16-4fff-96fc-6f97aa52cbec None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:36.388175 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4d975-2e16-4fff-96fc-6f97aa52cbec None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:36.388453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4d975-2e16-4fff-96fc-6f97aa52cbec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:36.389300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4d975-2e16-4fff-96fc-6f97aa52cbec None admin] RBAC: Adding query filter params (role.id=549e89b4a1e94091aa20ea1b8e767f3c, scope.project.id=40e0b5ee15df481cbc01333131f3def0, user.id=b8fd088faaba4d5c9745638c14f1a7f5) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:36.389608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4d975-2e16-4fff-96fc-6f97aa52cbec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:36.391146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4d975-2e16-4fff-96fc-6f97aa52cbec None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:36.398971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 655/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:36 2022] GET /identity/v3/role_assignments?user.id=b8fd088faaba4d5c9745638c14f1a7f5&scope.project.id=40e0b5ee15df481cbc01333131f3def0&role.id=549e89b4a1e94091aa20ea1b8e767f3c => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:38.497310 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576f0a2-b2ab-403c-aa49-64720548efe8 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:38.498068 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576f0a2-b2ab-403c-aa49-64720548efe8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:38.498068 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576f0a2-b2ab-403c-aa49-64720548efe8 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:38.499317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 633/1288] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:23:38.505608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5896c3-ff79-439f-bcc5-d28c6479f1c6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:38.506157 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5896c3-ff79-439f-bcc5-d28c6479f1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:38.506157 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5896c3-ff79-439f-bcc5-d28c6479f1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:38.526068 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1b5896c3-ff79-439f-bcc5-d28c6479f1c6 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:38.527548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1b5896c3-ff79-439f-bcc5-d28c6479f1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:38.568097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:38.615605 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 656/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:38.639709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576f0a2-b2ab-403c-aa49-64720548efe8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:38.767352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576f0a2-b2ab-403c-aa49-64720548efe8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:38.780132 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:38.809337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a563c99-2da6-4d48-b89d-704840937533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:38.810154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a563c99-2da6-4d48-b89d-704840937533 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:38.810484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a563c99-2da6-4d48-b89d-704840937533 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:38.810813 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a563c99-2da6-4d48-b89d-704840937533 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:38.811499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a563c99-2da6-4d48-b89d-704840937533 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:38.812886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a563c99-2da6-4d48-b89d-704840937533 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-6a563c99-2da6-4d48-b89d-704840937533 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:38.825931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:38.827621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:38.828664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:38.828664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:38.828664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:38.828664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:38.828664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:38.828664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:38.828664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:38.828664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:38.828664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:38.828664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:38.828664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:38.828664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:38.828664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:23:38.828664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:38.828664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 634/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 18 10:23:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:38.833551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5896c3-ff79-439f-bcc5-d28c6479f1c6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:38.942792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5896c3-ff79-439f-bcc5-d28c6479f1c6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:38.981933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8ca23-5993-422c-bbe6-c8e18e8dcba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:39.042580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8ca23-5993-422c-bbe6-c8e18e8dcba9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:39.042580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8ca23-5993-422c-bbe6-c8e18e8dcba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:39.042580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8ca23-5993-422c-bbe6-c8e18e8dcba9 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:39.042580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8ca23-5993-422c-bbe6-c8e18e8dcba9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:39.042580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8ca23-5993-422c-bbe6-c8e18e8dcba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:39.042580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8ca23-5993-422c-bbe6-c8e18e8dcba9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:39.043159 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 657/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jul 18 10:23:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:39.043252 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a563c99-2da6-4d48-b89d-704840937533 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:39.115638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a563c99-2da6-4d48-b89d-704840937533 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:39.160955 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ae8b7-dace-4812-a68f-bb0b537e8ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:39.161752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ae8b7-dace-4812-a68f-bb0b537e8ecd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:39.162039 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ae8b7-dace-4812-a68f-bb0b537e8ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:39.162352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ae8b7-dace-4812-a68f-bb0b537e8ecd None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:39.163111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ae8b7-dace-4812-a68f-bb0b537e8ecd None admin] RBAC: Adding query filter params (type=placement) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:39.163418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ae8b7-dace-4812-a68f-bb0b537e8ecd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:39.164885 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ae8b7-dace-4812-a68f-bb0b537e8ecd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:39.170828 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 635/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jul 18 10:23:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:41.326296 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a3a60-619d-4a5a-8d70-04374fa5587d None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:41.326948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a3a60-619d-4a5a-8d70-04374fa5587d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:41.326948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a3a60-619d-4a5a-8d70-04374fa5587d None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:41.328227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 658/1293] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:41.334088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f2330-ebc1-4554-92d9-bcb077a48421 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:41.334593 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f2330-ebc1-4554-92d9-bcb077a48421 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:41.334701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f2330-ebc1-4554-92d9-bcb077a48421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:41.353137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-755f2330-ebc1-4554-92d9-bcb077a48421 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:41.355487 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-755f2330-ebc1-4554-92d9-bcb077a48421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:41.389388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:41.436111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 636/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:41.459188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a3a60-619d-4a5a-8d70-04374fa5587d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:41.495874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:41.575891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a3a60-619d-4a5a-8d70-04374fa5587d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:41.616076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db5181-9222-4ec5-8618-92127a100154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:41.616658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db5181-9222-4ec5-8618-92127a100154 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:41.616941 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db5181-9222-4ec5-8618-92127a100154 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:41.617220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db5181-9222-4ec5-8618-92127a100154 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:41.617943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db5181-9222-4ec5-8618-92127a100154 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:41.619403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db5181-9222-4ec5-8618-92127a100154 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:41.720349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 659/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 18 10:23:41 2022] POST /identity/v3/services => generated 246 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:23:43.858540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7d9cc-b422-48b5-a74c-369275e6eecf None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:43.859146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7d9cc-b422-48b5-a74c-369275e6eecf None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:43.859146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7d9cc-b422-48b5-a74c-369275e6eecf None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:43.860462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 637/1296] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:43.866060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62559dee-f3b5-4962-9146-37406aeb1ea5 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:43.866632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62559dee-f3b5-4962-9146-37406aeb1ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:43.866632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62559dee-f3b5-4962-9146-37406aeb1ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:43.883930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-62559dee-f3b5-4962-9146-37406aeb1ea5 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:43.885134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-62559dee-f3b5-4962-9146-37406aeb1ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:43.998098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 660/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:43 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:44.023322 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7d9cc-b422-48b5-a74c-369275e6eecf None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:44.141920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7d9cc-b422-48b5-a74c-369275e6eecf None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:44.186035 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd266f2-01c1-413f-8e4f-2a6dd65017f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:44.186870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd266f2-01c1-413f-8e4f-2a6dd65017f8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:44.187150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd266f2-01c1-413f-8e4f-2a6dd65017f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:44.187418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd266f2-01c1-413f-8e4f-2a6dd65017f8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:44.188069 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd266f2-01c1-413f-8e4f-2a6dd65017f8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:44.189435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd266f2-01c1-413f-8e4f-2a6dd65017f8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-8fd266f2-01c1-413f-8e4f-2a6dd65017f8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:44.202356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:44.203708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:44.205096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:44.205096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:44.205096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:44.205096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:44.205096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:44.205096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:44.205096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:44.205096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:44.205096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:44.205096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:44.205096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:44.205096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:44.205096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:23:44.205096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:44.205096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 638/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 18 10:23:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:44.209917 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62559dee-f3b5-4962-9146-37406aeb1ea5 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:44.228821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:44.314434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62559dee-f3b5-4962-9146-37406aeb1ea5 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:44.352532 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1a8ce-d789-4e1e-bdb7-1e817aeedefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:44.353193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1a8ce-d789-4e1e-bdb7-1e817aeedefb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:44.353472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1a8ce-d789-4e1e-bdb7-1e817aeedefb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:44.353742 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1a8ce-d789-4e1e-bdb7-1e817aeedefb None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:44.355064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1a8ce-d789-4e1e-bdb7-1e817aeedefb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:44.355483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1a8ce-d789-4e1e-bdb7-1e817aeedefb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:44.356858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1a8ce-d789-4e1e-bdb7-1e817aeedefb None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:44.362470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 661/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jul 18 10:23:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:44.368676 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd266f2-01c1-413f-8e4f-2a6dd65017f8 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:44.401633 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:44.473435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd266f2-01c1-413f-8e4f-2a6dd65017f8 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:44.510744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423138b5-e557-48b0-b6f4-b4c7ae64fe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:44.511414 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423138b5-e557-48b0-b6f4-b4c7ae64fe11 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:44.511693 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423138b5-e557-48b0-b6f4-b4c7ae64fe11 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:44.511971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423138b5-e557-48b0-b6f4-b4c7ae64fe11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:44.512760 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423138b5-e557-48b0-b6f4-b4c7ae64fe11 None admin] RBAC: Adding query filter params (interface=public, service_id=27912093be154a8d9004a0b20678f5d5, region_id=RegionOne) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:44.513114 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423138b5-e557-48b0-b6f4-b4c7ae64fe11 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:44.514527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423138b5-e557-48b0-b6f4-b4c7ae64fe11 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:44.519869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 639/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 18 10:23:44 2022] GET /identity/v3/endpoints?service_id=27912093be154a8d9004a0b20678f5d5&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:44.525990 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1a8ce-d789-4e1e-bdb7-1e817aeedefb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:44.612818 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:44.631371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1a8ce-d789-4e1e-bdb7-1e817aeedefb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:44.669349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba823f-a0d6-4800-bdcd-bfd05fb10db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:44.669965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba823f-a0d6-4800-bdcd-bfd05fb10db0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:44.670350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba823f-a0d6-4800-bdcd-bfd05fb10db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:44.670633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba823f-a0d6-4800-bdcd-bfd05fb10db0 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:44.671307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba823f-a0d6-4800-bdcd-bfd05fb10db0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:44.672682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba823f-a0d6-4800-bdcd-bfd05fb10db0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:44.679730 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 662/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 18 10:23:44 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:23:46.731740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584476c-9e43-42bf-8f9c-88cd3d534a2a None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.732324 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584476c-9e43-42bf-8f9c-88cd3d534a2a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.732324 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584476c-9e43-42bf-8f9c-88cd3d534a2a None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.733644 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 640/1302] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:46.739185 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be00811-54f1-4e47-beac-4b165a50fb8c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.743357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be00811-54f1-4e47-beac-4b165a50fb8c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.743357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be00811-54f1-4e47-beac-4b165a50fb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.757756 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6be00811-54f1-4e47-beac-4b165a50fb8c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:46.759245 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6be00811-54f1-4e47-beac-4b165a50fb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:46.831495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 663/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:46.855630 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584476c-9e43-42bf-8f9c-88cd3d534a2a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:46.965806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:46.972752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584476c-9e43-42bf-8f9c-88cd3d534a2a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:47.007248 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b2a4e-2e0b-468b-aa13-0e6d487d85b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:47.007961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b2a4e-2e0b-468b-aa13-0e6d487d85b8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:47.008484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b2a4e-2e0b-468b-aa13-0e6d487d85b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:47.008762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b2a4e-2e0b-468b-aa13-0e6d487d85b8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:47.009400 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b2a4e-2e0b-468b-aa13-0e6d487d85b8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:47.011597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b2a4e-2e0b-468b-aa13-0e6d487d85b8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-d15b2a4e-2e0b-468b-aa13-0e6d487d85b8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:47.023316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:47.024548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:47.025641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:47.025641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:47.025641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:47.025641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:47.025641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:47.025641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:47.025641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:47.025641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:47.025641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:47.025641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:47.025641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:47.025641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:47.025641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:23:47.025641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 18 10:23:47.025641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 641/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 18 10:23:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:47.031359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be00811-54f1-4e47-beac-4b165a50fb8c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:47.106900 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:47.128612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be00811-54f1-4e47-beac-4b165a50fb8c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:47.169742 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f6504-5583-4b43-90c6-6919f9f90756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:47.170448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f6504-5583-4b43-90c6-6919f9f90756 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:47.170737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f6504-5583-4b43-90c6-6919f9f90756 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:47.171015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f6504-5583-4b43-90c6-6919f9f90756 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:47.171787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f6504-5583-4b43-90c6-6919f9f90756 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:47.172097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f6504-5583-4b43-90c6-6919f9f90756 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:47.173507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f6504-5583-4b43-90c6-6919f9f90756 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:47.180984 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 664/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jul 18 10:23:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:47.187823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b2a4e-2e0b-468b-aa13-0e6d487d85b8 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:47.289049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b2a4e-2e0b-468b-aa13-0e6d487d85b8 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:47.323844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72c53c-f040-4a61-b757-22ada708eae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:47.324493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72c53c-f040-4a61-b757-22ada708eae4 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:47.324777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72c53c-f040-4a61-b757-22ada708eae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:47.325053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72c53c-f040-4a61-b757-22ada708eae4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:47.325784 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72c53c-f040-4a61-b757-22ada708eae4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:47.327221 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72c53c-f040-4a61-b757-22ada708eae4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:47.374672 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 642/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 18 10:23:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:23:57.176978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=30 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:57.370014 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:25.499286 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aaf35-6b39-484f-88cf-2f844a082acd None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:25.500207 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aaf35-6b39-484f-88cf-2f844a082acd None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:25.500667 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aaf35-6b39-484f-88cf-2f844a082acd None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:25.502341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 665/1307] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:31:25.507997 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af37cc-d351-4d8b-b967-56abe089a5a5 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:25.508853 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af37cc-d351-4d8b-b967-56abe089a5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:25.509291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af37cc-d351-4d8b-b967-56abe089a5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:25.621086 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-82af37cc-d351-4d8b-b967-56abe089a5a5 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:31:25.622404 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-82af37cc-d351-4d8b-b967-56abe089a5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:25.770872 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 643/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:31:25.806414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658483a9-14db-4798-a60f-3634b02ac8ca None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:25.807303 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658483a9-14db-4798-a60f-3634b02ac8ca None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:25.808026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658483a9-14db-4798-a60f-3634b02ac8ca None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:25.810468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 666/1309] 10.222.0.16 () {54 vars in 965 bytes} [Mon Jul 18 10:31:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:31:25.816859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918571e4-81e5-4565-8ca4-3676c33809ec None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:25.817160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918571e4-81e5-4565-8ca4-3676c33809ec None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:25.817443 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918571e4-81e5-4565-8ca4-3676c33809ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:25.937265 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-918571e4-81e5-4565-8ca4-3676c33809ec None None] MFA Rules not processed for user `3f9385dec85a4e0cba21c2a840124f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:31:25.943694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-918571e4-81e5-4565-8ca4-3676c33809ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:25.965756 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:26.031871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 644/1310] 10.222.0.16 () {58 vars in 1062 bytes} [Mon Jul 18 10:31:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:31:26.041158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658483a9-14db-4798-a60f-3634b02ac8ca None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:31:26.043399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-658483a9-14db-4798-a60f-3634b02ac8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:26.178317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658483a9-14db-4798-a60f-3634b02ac8ca None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:31:26.270505 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b88c06-7a61-435b-90d0-e49d602623b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:31:26.271169 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b88c06-7a61-435b-90d0-e49d602623b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:26.271453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b88c06-7a61-435b-90d0-e49d602623b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:26.271732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b88c06-7a61-435b-90d0-e49d602623b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:26.273438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-18b88c06-7a61-435b-90d0-e49d602623b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:26.340231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:26.408440 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b88c06-7a61-435b-90d0-e49d602623b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:31:26.409908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b88c06-7a61-435b-90d0-e49d602623b2 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:31:26.434172 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 667/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:31:28.833126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce977c46-fd11-4d6d-b6e4-d3307b8c7ea1 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:28.833708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce977c46-fd11-4d6d-b6e4-d3307b8c7ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:28.833708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce977c46-fd11-4d6d-b6e4-d3307b8c7ea1 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:28.835125 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 645/1312] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:31:28.841508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd5d0f-df53-4efa-9ca0-103c004f8445 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:28.841923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd5d0f-df53-4efa-9ca0-103c004f8445 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:28.842052 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd5d0f-df53-4efa-9ca0-103c004f8445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:28.911416 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-43fd5d0f-df53-4efa-9ca0-103c004f8445 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:31:28.912630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-43fd5d0f-df53-4efa-9ca0-103c004f8445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:29.013701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 668/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:31:29.053267 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce977c46-fd11-4d6d-b6e4-d3307b8c7ea1 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:31:29.054877 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ce977c46-fd11-4d6d-b6e4-d3307b8c7ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:29.167655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce977c46-fd11-4d6d-b6e4-d3307b8c7ea1 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:31:29.239863 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:29.242231 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58042c3c-b867-4394-b6bf-0d43812b264f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:31:29.242902 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58042c3c-b867-4394-b6bf-0d43812b264f service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:29.243204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58042c3c-b867-4394-b6bf-0d43812b264f service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:29.243455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58042c3c-b867-4394-b6bf-0d43812b264f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:29.245354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-58042c3c-b867-4394-b6bf-0d43812b264f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:29.357719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58042c3c-b867-4394-b6bf-0d43812b264f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:31:29.359112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58042c3c-b867-4394-b6bf-0d43812b264f service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:31:29.377581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 646/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:31:32.018807 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be46ddf-4c81-4de9-b699-a4a7f00ff5a6 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:32.019343 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be46ddf-4c81-4de9-b699-a4a7f00ff5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:32.019343 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be46ddf-4c81-4de9-b699-a4a7f00ff5a6 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:32.020737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 669/1315] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:31:32.026670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9b591-3b40-46ce-9956-94e14080a432 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:32.027113 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9b591-3b40-46ce-9956-94e14080a432 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:32.027241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9b591-3b40-46ce-9956-94e14080a432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:32.094306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c4d9b591-3b40-46ce-9956-94e14080a432 None None] MFA Rules not processed for user `f2602cd3e1e84ece9b07e9808df280f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:31:32.095561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c4d9b591-3b40-46ce-9956-94e14080a432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:32.151767 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:32.197871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 647/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:31:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:31:32.238912 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be46ddf-4c81-4de9-b699-a4a7f00ff5a6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:31:32.240467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8be46ddf-4c81-4de9-b699-a4a7f00ff5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:32.250589 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:32.348840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be46ddf-4c81-4de9-b699-a4a7f00ff5a6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:31:32.422908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4029bd-e204-4cc5-a3ef-cea173ce6582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:31:32.423619 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4029bd-e204-4cc5-a3ef-cea173ce6582 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:32.423857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4029bd-e204-4cc5-a3ef-cea173ce6582 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:32.424127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4029bd-e204-4cc5-a3ef-cea173ce6582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:32.425764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9b4029bd-e204-4cc5-a3ef-cea173ce6582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:32.488509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:32.535685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4029bd-e204-4cc5-a3ef-cea173ce6582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:31:32.537121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4029bd-e204-4cc5-a3ef-cea173ce6582 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:31:32.555154 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 670/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:31:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:31:35.542685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c33ea-b213-447d-b6c5-5e44362b681c None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:35.543239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c33ea-b213-447d-b6c5-5e44362b681c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:35.543239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c33ea-b213-447d-b6c5-5e44362b681c None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:35.544657 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 648/1318] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:31:35.550783 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e88cd-e1ff-432e-a691-6287115d6e91 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:35.551583 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e88cd-e1ff-432e-a691-6287115d6e91 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:35.551583 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e88cd-e1ff-432e-a691-6287115d6e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:35.623460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f89e88cd-e1ff-432e-a691-6287115d6e91 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:31:35.624750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f89e88cd-e1ff-432e-a691-6287115d6e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:35.726295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 671/1319] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:31:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:31:35.767692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c33ea-b213-447d-b6c5-5e44362b681c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:31:35.769221 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-fe3c33ea-b213-447d-b6c5-5e44362b681c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:35.878885 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c33ea-b213-447d-b6c5-5e44362b681c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:31:35.957818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed3297-c121-4fee-9e70-cae0d4077fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:31:35.958512 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed3297-c121-4fee-9e70-cae0d4077fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:35.958797 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed3297-c121-4fee-9e70-cae0d4077fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:35.959073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed3297-c121-4fee-9e70-cae0d4077fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:35.960757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ebed3297-c121-4fee-9e70-cae0d4077fa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:35.969269 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:36.077107 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed3297-c121-4fee-9e70-cae0d4077fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:31:36.078594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed3297-c121-4fee-9e70-cae0d4077fa3 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:31:36.097333 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 649/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:31:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:31:39.410976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06702a0-5b4d-4dd9-8666-22809f366a16 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:39.411510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06702a0-5b4d-4dd9-8666-22809f366a16 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:39.411510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06702a0-5b4d-4dd9-8666-22809f366a16 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:39.412939 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 672/1321] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:31:39.419265 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c928f10-703b-4661-8f16-316bb8aa38f7 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:39.419819 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c928f10-703b-4661-8f16-316bb8aa38f7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:39.419819 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c928f10-703b-4661-8f16-316bb8aa38f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:39.486860 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9c928f10-703b-4661-8f16-316bb8aa38f7 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:31:39.488089 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9c928f10-703b-4661-8f16-316bb8aa38f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:39.560563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:39.601080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 650/1322] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:31:39.654086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc91086-9ef9-48da-b5c9-b8b091d9dd37 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:39.654421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc91086-9ef9-48da-b5c9-b8b091d9dd37 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:39.654709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc91086-9ef9-48da-b5c9-b8b091d9dd37 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:39.656087 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 673/1323] 10.222.0.16 () {54 vars in 965 bytes} [Mon Jul 18 10:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:31:39.662219 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bcf24-f974-47e8-86f3-68003e6b753e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:39.662540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bcf24-f974-47e8-86f3-68003e6b753e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:39.662820 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bcf24-f974-47e8-86f3-68003e6b753e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:39.740896 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-dd7bcf24-f974-47e8-86f3-68003e6b753e None None] MFA Rules not processed for user `3f9385dec85a4e0cba21c2a840124f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:31:39.742122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-dd7bcf24-f974-47e8-86f3-68003e6b753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:39.826704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 651/1324] 10.222.0.16 () {58 vars in 1062 bytes} [Mon Jul 18 10:31:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:31:39.835949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc91086-9ef9-48da-b5c9-b8b091d9dd37 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:31:39.837703 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4dc91086-9ef9-48da-b5c9-b8b091d9dd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:39.859462 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:39.962581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc91086-9ef9-48da-b5c9-b8b091d9dd37 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:31:40.041973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa797a85-aa09-4ac9-a895-27ba52b0dc73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:31:40.042676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa797a85-aa09-4ac9-a895-27ba52b0dc73 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:40.042962 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa797a85-aa09-4ac9-a895-27ba52b0dc73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:40.043246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa797a85-aa09-4ac9-a895-27ba52b0dc73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:40.045001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fa797a85-aa09-4ac9-a895-27ba52b0dc73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:40.122576 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:40.163349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa797a85-aa09-4ac9-a895-27ba52b0dc73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:31:40.164804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa797a85-aa09-4ac9-a895-27ba52b0dc73 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:31:40.184597 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 674/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:31:42.569804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3af0b-72fc-4e13-a2e7-c445a47a70fa None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:42.570566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3af0b-72fc-4e13-a2e7-c445a47a70fa None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:42.570566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3af0b-72fc-4e13-a2e7-c445a47a70fa None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:42.572668 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 652/1326] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:31:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:31:42.578555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8c962-f121-48b9-8221-6c0c265e33d5 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:42.579035 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8c962-f121-48b9-8221-6c0c265e33d5 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:42.579132 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8c962-f121-48b9-8221-6c0c265e33d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:42.658984 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-54e8c962-f121-48b9-8221-6c0c265e33d5 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:31:42.660206 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-54e8c962-f121-48b9-8221-6c0c265e33d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:42.770144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 675/1327] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:31:42.813482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3af0b-72fc-4e13-a2e7-c445a47a70fa None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:31:42.815176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a8c3af0b-72fc-4e13-a2e7-c445a47a70fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:42.880681 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:42.932591 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3af0b-72fc-4e13-a2e7-c445a47a70fa None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:31:43.027928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5a7fa-f248-465c-8f73-30aa96531571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:31:43.028592 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a7fa-f248-465c-8f73-30aa96531571 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:43.028876 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a7fa-f248-465c-8f73-30aa96531571 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:43.029153 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a7fa-f248-465c-8f73-30aa96531571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:43.030867 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0ce5a7fa-f248-465c-8f73-30aa96531571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:43.150359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:43.152949 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5a7fa-f248-465c-8f73-30aa96531571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:31:43.154452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5a7fa-f248-465c-8f73-30aa96531571 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:31:43.175070 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 653/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:31:45.308298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d738a88-d07e-4469-abb7-04bdcb624719 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:45.308840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d738a88-d07e-4469-abb7-04bdcb624719 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:45.308840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d738a88-d07e-4469-abb7-04bdcb624719 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:45.310231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 676/1329] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:31:45.315737 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ef75-5066-4adc-9af3-0e3a7bffbe2e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:45.316256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ef75-5066-4adc-9af3-0e3a7bffbe2e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:45.316357 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ef75-5066-4adc-9af3-0e3a7bffbe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:45.387421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-eb34ef75-5066-4adc-9af3-0e3a7bffbe2e None None] MFA Rules not processed for user `f2602cd3e1e84ece9b07e9808df280f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:31:45.388715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-eb34ef75-5066-4adc-9af3-0e3a7bffbe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:45.494871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 654/1330] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:31:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:31:45.534163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d738a88-d07e-4469-abb7-04bdcb624719 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:31:45.535995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9d738a88-d07e-4469-abb7-04bdcb624719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:45.578694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:45.681620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d738a88-d07e-4469-abb7-04bdcb624719 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:31:45.777570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca20b5-5cf5-444a-b271-6d0a35136afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:31:45.778250 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca20b5-5cf5-444a-b271-6d0a35136afd service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:45.778570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca20b5-5cf5-444a-b271-6d0a35136afd service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:45.778850 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca20b5-5cf5-444a-b271-6d0a35136afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:45.780522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-baca20b5-5cf5-444a-b271-6d0a35136afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:45.863865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:45.899511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca20b5-5cf5-444a-b271-6d0a35136afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:31:45.901880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca20b5-5cf5-444a-b271-6d0a35136afd service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:31:45.921315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 677/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:31:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:31:48.800544 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc7668-d0cd-4c4f-9d76-d598f3ce6007 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:48.801169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc7668-d0cd-4c4f-9d76-d598f3ce6007 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:48.801169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc7668-d0cd-4c4f-9d76-d598f3ce6007 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:48.802524 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 655/1332] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:31:48.808165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690620b-d730-4887-a240-b752fae85cc8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:48.808727 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690620b-d730-4887-a240-b752fae85cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:48.808727 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690620b-d730-4887-a240-b752fae85cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:48.875355 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0690620b-d730-4887-a240-b752fae85cc8 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:31:48.876545 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0690620b-d730-4887-a240-b752fae85cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:48.980321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 678/1333] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:31:49.017735 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc7668-d0cd-4c4f-9d76-d598f3ce6007 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:31:49.019311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2bcc7668-d0cd-4c4f-9d76-d598f3ce6007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:49.091936 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:49.155339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc7668-d0cd-4c4f-9d76-d598f3ce6007 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:31:49.211907 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7db157-1c6a-48b7-97d6-2a48b99a10c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:31:49.212804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7db157-1c6a-48b7-97d6-2a48b99a10c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:49.213300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7db157-1c6a-48b7-97d6-2a48b99a10c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:49.213659 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7db157-1c6a-48b7-97d6-2a48b99a10c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:49.215399 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ae7db157-1c6a-48b7-97d6-2a48b99a10c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:49.354863 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7db157-1c6a-48b7-97d6-2a48b99a10c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:31:49.356262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7db157-1c6a-48b7-97d6-2a48b99a10c5 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:31:49.366490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:49.376205 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 656/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:31:51.498985 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d7fc4-1cf1-44ec-b92a-36084bfc61ca None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:51.499569 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d7fc4-1cf1-44ec-b92a-36084bfc61ca None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:51.499569 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d7fc4-1cf1-44ec-b92a-36084bfc61ca None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:51.500916 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 679/1335] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:31:51.506429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d4b30-70a5-44c1-b9c6-ab6e51f33308 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:51.506875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d4b30-70a5-44c1-b9c6-ab6e51f33308 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:51.506981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d4b30-70a5-44c1-b9c6-ab6e51f33308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:51.576997 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f89d4b30-70a5-44c1-b9c6-ab6e51f33308 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:31:51.578246 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f89d4b30-70a5-44c1-b9c6-ab6e51f33308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:51.679357 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 657/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:31:51.721312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d7fc4-1cf1-44ec-b92a-36084bfc61ca None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:31:51.722937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2e8d7fc4-1cf1-44ec-b92a-36084bfc61ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:51.765954 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:51.835190 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d7fc4-1cf1-44ec-b92a-36084bfc61ca None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:31:51.912151 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b197c-f342-467b-bed8-6896e322a6ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:31:51.912885 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b197c-f342-467b-bed8-6896e322a6ea service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:51.913165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b197c-f342-467b-bed8-6896e322a6ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:51.913558 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b197c-f342-467b-bed8-6896e322a6ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:51.915879 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dc6b197c-f342-467b-bed8-6896e322a6ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:52.007616 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:52.035243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b197c-f342-467b-bed8-6896e322a6ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:31:52.036599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b197c-f342-467b-bed8-6896e322a6ea service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:31:52.057417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 680/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:31:54.791746 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fdc93-0d09-49ad-8957-9b330d4a6492 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:54.792307 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fdc93-0d09-49ad-8957-9b330d4a6492 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:54.792400 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fdc93-0d09-49ad-8957-9b330d4a6492 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:54.793858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 658/1338] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:31:54.799197 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be8e2-125f-4288-b76c-b384b7185628 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:54.799621 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be8e2-125f-4288-b76c-b384b7185628 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:54.799753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be8e2-125f-4288-b76c-b384b7185628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:54.870655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-4d9be8e2-125f-4288-b76c-b384b7185628 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:31:54.871873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4d9be8e2-125f-4288-b76c-b384b7185628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:54.974540 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 681/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:31:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:31:55.012513 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fdc93-0d09-49ad-8957-9b330d4a6492 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:31:55.014112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1f6fdc93-0d09-49ad-8957-9b330d4a6492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:55.094844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:55.125511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fdc93-0d09-49ad-8957-9b330d4a6492 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:31:55.201648 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b81a02-2994-4cb4-bc56-afde492b6155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:31:55.202296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b81a02-2994-4cb4-bc56-afde492b6155 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:31:55.202603 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b81a02-2994-4cb4-bc56-afde492b6155 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:31:55.202879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b81a02-2994-4cb4-bc56-afde492b6155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:31:55.204513 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d2b81a02-2994-4cb4-bc56-afde492b6155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:31:55.316586 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b81a02-2994-4cb4-bc56-afde492b6155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:31:55.317944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b81a02-2994-4cb4-bc56-afde492b6155 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:31:55.336183 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 659/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:31:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:32:00.080368 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85ede9-7428-4965-adf0-6fda5b80363c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:00.080880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85ede9-7428-4965-adf0-6fda5b80363c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:00.080985 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85ede9-7428-4965-adf0-6fda5b80363c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:00.082508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 682/1341] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:00.087834 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b711a28-6336-4c50-b899-9475daba021f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:00.088322 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b711a28-6336-4c50-b899-9475daba021f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:00.088511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b711a28-6336-4c50-b899-9475daba021f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:00.092742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:00.159516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-5b711a28-6336-4c50-b899-9475daba021f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:00.160739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5b711a28-6336-4c50-b899-9475daba021f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:00.273764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 660/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:00.314905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85ede9-7428-4965-adf0-6fda5b80363c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:00.316536 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1a85ede9-7428-4965-adf0-6fda5b80363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:00.366599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:00.428291 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85ede9-7428-4965-adf0-6fda5b80363c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:00.518743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43caf0-d778-4213-bdee-7e789f54009a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:00.519436 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43caf0-d778-4213-bdee-7e789f54009a service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:00.519802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43caf0-d778-4213-bdee-7e789f54009a service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:00.520124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43caf0-d778-4213-bdee-7e789f54009a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:00.521982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5e43caf0-d778-4213-bdee-7e789f54009a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:00.629890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:00.650709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43caf0-d778-4213-bdee-7e789f54009a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:00.652334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43caf0-d778-4213-bdee-7e789f54009a service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:00.675061 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 683/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:32:03.939944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45e76-0cdf-46bb-ad1c-39a7c6db4609 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:03.940480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45e76-0cdf-46bb-ad1c-39a7c6db4609 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:03.940480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45e76-0cdf-46bb-ad1c-39a7c6db4609 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:03.941844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 661/1344] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:03.947645 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fde6a-ec5f-45bd-af1c-fae6b036e6c1 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:03.948064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fde6a-ec5f-45bd-af1c-fae6b036e6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:03.948206 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fde6a-ec5f-45bd-af1c-fae6b036e6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:04.016490 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-603fde6a-ec5f-45bd-af1c-fae6b036e6c1 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:04.017714 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-603fde6a-ec5f-45bd-af1c-fae6b036e6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:04.118258 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 684/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:04.157135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb45e76-0cdf-46bb-ad1c-39a7c6db4609 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:04.158707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5eb45e76-0cdf-46bb-ad1c-39a7c6db4609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:04.250146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:04.269035 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb45e76-0cdf-46bb-ad1c-39a7c6db4609 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:04.346870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca7ceb-98b8-42e4-ae46-97d4cc88c18e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:04.347521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca7ceb-98b8-42e4-ae46-97d4cc88c18e service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:04.347797 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca7ceb-98b8-42e4-ae46-97d4cc88c18e service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:04.348076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca7ceb-98b8-42e4-ae46-97d4cc88c18e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:04.349704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-fcca7ceb-98b8-42e4-ae46-97d4cc88c18e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:04.471032 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca7ceb-98b8-42e4-ae46-97d4cc88c18e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:04.472476 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca7ceb-98b8-42e4-ae46-97d4cc88c18e service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:04.491562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 662/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:32:09.070645 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fcb56-78ca-49a6-94fb-dfd5a2867152 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:09.071317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fcb56-78ca-49a6-94fb-dfd5a2867152 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:09.071317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fcb56-78ca-49a6-94fb-dfd5a2867152 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:09.072654 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 685/1347] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:09.078281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5e8e-4fea-40e1-bb15-622f04a11cb0 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:09.078790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5e8e-4fea-40e1-bb15-622f04a11cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:09.078907 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5e8e-4fea-40e1-bb15-622f04a11cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:09.094873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:09.162239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0c1d5e8e-4fea-40e1-bb15-622f04a11cb0 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:09.163846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0c1d5e8e-4fea-40e1-bb15-622f04a11cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:09.292038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 663/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:09.332648 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fcb56-78ca-49a6-94fb-dfd5a2867152 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:09.334209 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0c0fcb56-78ca-49a6-94fb-dfd5a2867152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:09.398739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:09.448593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fcb56-78ca-49a6-94fb-dfd5a2867152 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:09.531384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19f725-378c-464b-ac31-2f2d8a041174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:09.532042 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19f725-378c-464b-ac31-2f2d8a041174 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:09.532347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19f725-378c-464b-ac31-2f2d8a041174 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:09.532582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19f725-378c-464b-ac31-2f2d8a041174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:09.534230 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8c19f725-378c-464b-ac31-2f2d8a041174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:09.642237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:09.646050 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19f725-378c-464b-ac31-2f2d8a041174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:09.647550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19f725-378c-464b-ac31-2f2d8a041174 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:09.666920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 686/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:32:14.662153 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef37d88-9828-4e16-96f9-760cce37d884 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:14.663081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef37d88-9828-4e16-96f9-760cce37d884 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:14.663081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef37d88-9828-4e16-96f9-760cce37d884 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:14.663914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 664/1350] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 18 10:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:14.670067 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a149dae-4db7-4ab6-a9cc-71325a8d501e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:14.670963 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a149dae-4db7-4ab6-a9cc-71325a8d501e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:14.671447 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a149dae-4db7-4ab6-a9cc-71325a8d501e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:14.806420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6a149dae-4db7-4ab6-a9cc-71325a8d501e None None] MFA Rules not processed for user `b8fd088faaba4d5c9745638c14f1a7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:14.808436 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6a149dae-4db7-4ab6-a9cc-71325a8d501e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:14.936738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 687/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 18 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:18.991858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5267a8e-c93f-4427-84c4-1a0c5e2c0efa None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:18.992430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5267a8e-c93f-4427-84c4-1a0c5e2c0efa None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:18.992430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5267a8e-c93f-4427-84c4-1a0c5e2c0efa None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:18.994172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 665/1352] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 18 10:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:18.999337 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264fe3d-8285-4e30-96fb-3a7901d042c6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:18.999839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264fe3d-8285-4e30-96fb-3a7901d042c6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:19.000026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264fe3d-8285-4e30-96fb-3a7901d042c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:19.059576 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:19.083415 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e264fe3d-8285-4e30-96fb-3a7901d042c6 None None] MFA Rules not processed for user `b8fd088faaba4d5c9745638c14f1a7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:19.084632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e264fe3d-8285-4e30-96fb-3a7901d042c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:19.204186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 688/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 18 10:32:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:19.289526 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=59 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:20.698401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34d073-9039-49ab-99ce-5c314de5e84c None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:20.699115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34d073-9039-49ab-99ce-5c314de5e84c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:20.699115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34d073-9039-49ab-99ce-5c314de5e84c None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:20.700547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 666/1354] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 18 10:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:20.705929 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416023b-c98a-484e-b91a-f5f48a98d4ad None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:20.706482 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416023b-c98a-484e-b91a-f5f48a98d4ad None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:20.706691 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416023b-c98a-484e-b91a-f5f48a98d4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:20.787454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-4416023b-c98a-484e-b91a-f5f48a98d4ad None None] MFA Rules not processed for user `b8fd088faaba4d5c9745638c14f1a7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:20.788654 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4416023b-c98a-484e-b91a-f5f48a98d4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:20.833180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:20.906105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 689/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 18 10:32:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:24.462191 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43725998-b88a-4d30-b168-a90eaffba0ca None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:24.462767 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43725998-b88a-4d30-b168-a90eaffba0ca None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:24.462767 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43725998-b88a-4d30-b168-a90eaffba0ca None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:24.464345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 667/1356] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:24.471259 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07d269-0dd3-4b45-a60a-929545bdbde0 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:24.472316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07d269-0dd3-4b45-a60a-929545bdbde0 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:24.472820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07d269-0dd3-4b45-a60a-929545bdbde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:24.570793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1c07d269-0dd3-4b45-a60a-929545bdbde0 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:24.572145 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1c07d269-0dd3-4b45-a60a-929545bdbde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:24.694375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 690/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:24.742943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ec97b-d647-497e-83b4-deabccbaa902 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:24.744444 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ec97b-d647-497e-83b4-deabccbaa902 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:24.744782 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ec97b-d647-497e-83b4-deabccbaa902 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:24.746266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 668/1358] 10.222.0.16 () {54 vars in 962 bytes} [Mon Jul 18 10:32:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:24.766958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b067c-c566-4d49-ab08-761bd56929e2 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:24.767958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b067c-c566-4d49-ab08-761bd56929e2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:24.768806 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b067c-c566-4d49-ab08-761bd56929e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:24.786700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:24.853813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-fa3b067c-c566-4d49-ab08-761bd56929e2 None None] MFA Rules not processed for user `f7abf6b71ac3454ca547a750cef9220a`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:24.854963 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fa3b067c-c566-4d49-ab08-761bd56929e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:24.996592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 691/1359] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Jul 18 10:32:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:25.005246 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ec97b-d647-497e-83b4-deabccbaa902 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:25.007262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cb6ec97b-d647-497e-83b4-deabccbaa902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:25.177549 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ec97b-d647-497e-83b4-deabccbaa902 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:25.258977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:25.301670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318ca04-1ec0-4420-b29e-0243c5acfd85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:25.302337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318ca04-1ec0-4420-b29e-0243c5acfd85 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:25.302628 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318ca04-1ec0-4420-b29e-0243c5acfd85 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:25.302906 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318ca04-1ec0-4420-b29e-0243c5acfd85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:25.304533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9318ca04-1ec0-4420-b29e-0243c5acfd85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:25.401974 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318ca04-1ec0-4420-b29e-0243c5acfd85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:25.403539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318ca04-1ec0-4420-b29e-0243c5acfd85 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:25.422881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 669/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:32:27.706705 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cb4a8-4624-4247-aaf0-7da8037829ea None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:27.707316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cb4a8-4624-4247-aaf0-7da8037829ea None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:27.707414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cb4a8-4624-4247-aaf0-7da8037829ea None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:27.709125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 692/1361] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:27.715259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5884c83-8eb4-4f16-bd9c-d0c450694a4b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:27.715839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5884c83-8eb4-4f16-bd9c-d0c450694a4b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:27.715839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5884c83-8eb4-4f16-bd9c-d0c450694a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:27.800513 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f5884c83-8eb4-4f16-bd9c-d0c450694a4b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:27.801720 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f5884c83-8eb4-4f16-bd9c-d0c450694a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:27.845677 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:27.915226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 670/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:27.956421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cb4a8-4624-4247-aaf0-7da8037829ea None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:27.959809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a38cb4a8-4624-4247-aaf0-7da8037829ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:28.052977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:28.144129 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cb4a8-4624-4247-aaf0-7da8037829ea None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:28.271782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd17453-e91a-4349-b5f4-7577ef4841ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:28.272433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd17453-e91a-4349-b5f4-7577ef4841ac service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:28.272718 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd17453-e91a-4349-b5f4-7577ef4841ac service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:28.272992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd17453-e91a-4349-b5f4-7577ef4841ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:28.275529 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6dd17453-e91a-4349-b5f4-7577ef4841ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:28.302448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:28.379278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd17453-e91a-4349-b5f4-7577ef4841ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:28.380899 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd17453-e91a-4349-b5f4-7577ef4841ac service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:28.401588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 693/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:32:31.067280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da0c9-477d-4b86-a5cf-2a00c476d814 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:31.067845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da0c9-477d-4b86-a5cf-2a00c476d814 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:31.067845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da0c9-477d-4b86-a5cf-2a00c476d814 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:31.069778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 671/1364] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:31.076596 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9d267-9916-4c8d-9eed-11da6dfff32b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:31.077212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9d267-9916-4c8d-9eed-11da6dfff32b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:31.077212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9d267-9916-4c8d-9eed-11da6dfff32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:31.166483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6ff9d267-9916-4c8d-9eed-11da6dfff32b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:31.168351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6ff9d267-9916-4c8d-9eed-11da6dfff32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:31.279240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:31.282370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 694/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:31.333095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d5849-0278-48eb-b320-b81eb7bd144b None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:31.333380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d5849-0278-48eb-b320-b81eb7bd144b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:31.333908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d5849-0278-48eb-b320-b81eb7bd144b None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:31.335334 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 672/1366] 10.222.0.16 () {54 vars in 962 bytes} [Mon Jul 18 10:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:31.343248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e148fb-75da-46d4-9fcd-9ce758154036 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:31.343532 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e148fb-75da-46d4-9fcd-9ce758154036 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:31.344642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e148fb-75da-46d4-9fcd-9ce758154036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:31.446087 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-09e148fb-75da-46d4-9fcd-9ce758154036 None None] MFA Rules not processed for user `f7abf6b71ac3454ca547a750cef9220a`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:31.448640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-09e148fb-75da-46d4-9fcd-9ce758154036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:31.599791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 695/1367] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Jul 18 10:32:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:31.608930 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d5849-0278-48eb-b320-b81eb7bd144b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:31.610924 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f28d5849-0278-48eb-b320-b81eb7bd144b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:31.785958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d5849-0278-48eb-b320-b81eb7bd144b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:31.809734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:31.920529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a981c-749b-4da9-a0fb-7066d3e9ab03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:31.921223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a981c-749b-4da9-a0fb-7066d3e9ab03 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:31.921609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a981c-749b-4da9-a0fb-7066d3e9ab03 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:31.921988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a981c-749b-4da9-a0fb-7066d3e9ab03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:31.923797 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f65a981c-749b-4da9-a0fb-7066d3e9ab03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:32.033214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a981c-749b-4da9-a0fb-7066d3e9ab03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:32.034904 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a981c-749b-4da9-a0fb-7066d3e9ab03 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:32.054673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 673/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:32:32.928865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8ac15-4748-4a6f-89a2-cbbba2c6b33f None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:32.929404 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8ac15-4748-4a6f-89a2-cbbba2c6b33f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:32.929404 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8ac15-4748-4a6f-89a2-cbbba2c6b33f None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:32.932325 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 696/1369] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:32.936957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f40ab-20aa-4405-8d58-b6da5373f3fb None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:32.937626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f40ab-20aa-4405-8d58-b6da5373f3fb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:32.937626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f40ab-20aa-4405-8d58-b6da5373f3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:32.985985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:33.041371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ff2f40ab-20aa-4405-8d58-b6da5373f3fb None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:33.042938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ff2f40ab-20aa-4405-8d58-b6da5373f3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:33.185895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 674/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:32:33.498089 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3f748-95db-4a65-ab30-bccacc26d2d6 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:33.498933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3f748-95db-4a65-ab30-bccacc26d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:33.499417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3f748-95db-4a65-ab30-bccacc26d2d6 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:33.501031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 697/1371] 10.222.0.16 () {54 vars in 964 bytes} [Mon Jul 18 10:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:33.506926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c394ab8-feaa-4fcf-bd13-0eea13a9cbfa None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:33.507347 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c394ab8-feaa-4fcf-bd13-0eea13a9cbfa None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:33.507733 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c394ab8-feaa-4fcf-bd13-0eea13a9cbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:33.594969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-5c394ab8-feaa-4fcf-bd13-0eea13a9cbfa None None] MFA Rules not processed for user `08f27c6bc2744b9f92141a9c6906bc3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:33.596368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5c394ab8-feaa-4fcf-bd13-0eea13a9cbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:33.671717 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:33.709171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 675/1372] 10.222.0.16 () {58 vars in 1061 bytes} [Mon Jul 18 10:32:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:33.718071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3f748-95db-4a65-ab30-bccacc26d2d6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:33.719779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-03e3f748-95db-4a65-ab30-bccacc26d2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:33.777838 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:33.839930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3f748-95db-4a65-ab30-bccacc26d2d6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:33.920806 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15492d-62ea-4019-9201-2fda56b77a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:33.921612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15492d-62ea-4019-9201-2fda56b77a00 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:33.921992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15492d-62ea-4019-9201-2fda56b77a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:33.922394 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15492d-62ea-4019-9201-2fda56b77a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:33.924174 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-eb15492d-62ea-4019-9201-2fda56b77a00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:34.040401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:34.054623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15492d-62ea-4019-9201-2fda56b77a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:34.056635 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15492d-62ea-4019-9201-2fda56b77a00 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:34.076707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 698/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:32:34.441221 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10918d-781d-4a2b-9155-a948ec701dab None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:34.441944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10918d-781d-4a2b-9155-a948ec701dab None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:34.441944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10918d-781d-4a2b-9155-a948ec701dab None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:34.447930 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 676/1374] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:34.449682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfcec6-7a84-42d2-86fd-e9688368a0fd None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:34.449972 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfcec6-7a84-42d2-86fd-e9688368a0fd None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:34.450254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfcec6-7a84-42d2-86fd-e9688368a0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:34.522719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-bebfcec6-7a84-42d2-86fd-e9688368a0fd None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:34.524587 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-bebfcec6-7a84-42d2-86fd-e9688368a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:34.624907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 699/1375] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:34.671880 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10918d-781d-4a2b-9155-a948ec701dab None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:34.673408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3b10918d-781d-4a2b-9155-a948ec701dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:34.830415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10918d-781d-4a2b-9155-a948ec701dab None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:34.889916 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:34.955578 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5aedce-6d96-48e6-b2bb-acb3c6f1ae00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:34.956157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aedce-6d96-48e6-b2bb-acb3c6f1ae00 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:34.956440 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aedce-6d96-48e6-b2bb-acb3c6f1ae00 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:34.956715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5aedce-6d96-48e6-b2bb-acb3c6f1ae00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:34.958397 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cf5aedce-6d96-48e6-b2bb-acb3c6f1ae00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:35.049750 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5aedce-6d96-48e6-b2bb-acb3c6f1ae00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:35.051379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5aedce-6d96-48e6-b2bb-acb3c6f1ae00 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:35.069540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 677/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:32:37.284294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbeec1-38db-4766-afd2-f8e1418f1e2c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:37.284672 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbeec1-38db-4766-afd2-f8e1418f1e2c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:37.284827 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbeec1-38db-4766-afd2-f8e1418f1e2c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:37.286681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 700/1377] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:37.292096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc638bc-f433-4f06-9123-3ef08b2287e5 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:37.292521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc638bc-f433-4f06-9123-3ef08b2287e5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:37.292660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc638bc-f433-4f06-9123-3ef08b2287e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:37.376243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9dc638bc-f433-4f06-9123-3ef08b2287e5 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:37.377525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9dc638bc-f433-4f06-9123-3ef08b2287e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:37.387176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:37.501334 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 678/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:37.547542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbeec1-38db-4766-afd2-f8e1418f1e2c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:37.549132 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b9dbeec1-38db-4766-afd2-f8e1418f1e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:37.612483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:37.703782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbeec1-38db-4766-afd2-f8e1418f1e2c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:37.845013 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853c004-87cb-4376-a7d6-9ecaaa15f7f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:37.845746 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853c004-87cb-4376-a7d6-9ecaaa15f7f9 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:37.846056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853c004-87cb-4376-a7d6-9ecaaa15f7f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:37.847159 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853c004-87cb-4376-a7d6-9ecaaa15f7f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:37.848210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6853c004-87cb-4376-a7d6-9ecaaa15f7f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:37.881630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:37.977679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853c004-87cb-4376-a7d6-9ecaaa15f7f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:37.980265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853c004-87cb-4376-a7d6-9ecaaa15f7f9 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:38.000781 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 701/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:32:40.234415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8aae8-3a7c-40ca-8e45-1fecbc1cf7df None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:40.234974 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8aae8-3a7c-40ca-8e45-1fecbc1cf7df None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:40.235157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8aae8-3a7c-40ca-8e45-1fecbc1cf7df None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:40.236793 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 679/1380] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:40.242549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d0644-48d8-4d2e-8d54-773da96961d7 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:40.243062 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d0644-48d8-4d2e-8d54-773da96961d7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:40.243170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d0644-48d8-4d2e-8d54-773da96961d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:40.337016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-af5d0644-48d8-4d2e-8d54-773da96961d7 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:40.338250 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-af5d0644-48d8-4d2e-8d54-773da96961d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:40.437645 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:40.443674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 702/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:40.489475 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8aae8-3a7c-40ca-8e45-1fecbc1cf7df None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:40.490994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0cb8aae8-3a7c-40ca-8e45-1fecbc1cf7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:40.656344 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:40.668437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8aae8-3a7c-40ca-8e45-1fecbc1cf7df None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:40.794498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e63461-502f-475f-9e3e-f7c52b07dca7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:40.795432 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e63461-502f-475f-9e3e-f7c52b07dca7 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:40.795581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e63461-502f-475f-9e3e-f7c52b07dca7 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:40.795769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e63461-502f-475f-9e3e-f7c52b07dca7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:40.797854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-88e63461-502f-475f-9e3e-f7c52b07dca7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:40.912811 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e63461-502f-475f-9e3e-f7c52b07dca7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:40.915304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e63461-502f-475f-9e3e-f7c52b07dca7 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:40.936202 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:40.942744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 680/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:32:43.236226 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc799c8-0a38-47d7-b1a9-316d794fa2c9 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:43.236893 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc799c8-0a38-47d7-b1a9-316d794fa2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:43.236893 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc799c8-0a38-47d7-b1a9-316d794fa2c9 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:43.238175 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 703/1383] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:43.244748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b9d92-34f2-44de-992c-da1e2378f6e1 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:43.245309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b9d92-34f2-44de-992c-da1e2378f6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:43.245843 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b9d92-34f2-44de-992c-da1e2378f6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:43.320941 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4c2b9d92-34f2-44de-992c-da1e2378f6e1 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:43.322208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4c2b9d92-34f2-44de-992c-da1e2378f6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:43.425989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 681/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:43.471118 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc799c8-0a38-47d7-b1a9-316d794fa2c9 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:43.472657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5cc799c8-0a38-47d7-b1a9-316d794fa2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:43.649138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc799c8-0a38-47d7-b1a9-316d794fa2c9 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:43.720564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:43.892550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe9474-4bda-4f75-9804-ac3005156787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:43.893202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9474-4bda-4f75-9804-ac3005156787 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:43.893486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9474-4bda-4f75-9804-ac3005156787 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:43.893759 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9474-4bda-4f75-9804-ac3005156787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:43.895443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6efe9474-4bda-4f75-9804-ac3005156787 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:43.993405 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe9474-4bda-4f75-9804-ac3005156787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:43.995413 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe9474-4bda-4f75-9804-ac3005156787 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:44.016160 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 704/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:32:46.125070 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127010c0-1a98-42d0-b485-c5c6b65e7ddb None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:46.125989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127010c0-1a98-42d0-b485-c5c6b65e7ddb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:46.125989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127010c0-1a98-42d0-b485-c5c6b65e7ddb None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:46.127225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 682/1386] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:46.133389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce150cd-99c5-4490-94a1-d4c015dbc50c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:46.133873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce150cd-99c5-4490-94a1-d4c015dbc50c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:46.134050 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce150cd-99c5-4490-94a1-d4c015dbc50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:46.203156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2ce150cd-99c5-4490-94a1-d4c015dbc50c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:46.204521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2ce150cd-99c5-4490-94a1-d4c015dbc50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:46.246478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:46.317516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 705/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:46.363808 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127010c0-1a98-42d0-b485-c5c6b65e7ddb None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:46.365926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-127010c0-1a98-42d0-b485-c5c6b65e7ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:46.466095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:46.542109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127010c0-1a98-42d0-b485-c5c6b65e7ddb None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:46.665743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddba18-76f5-4c51-a14d-eeccc2ea862c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:46.666295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddba18-76f5-4c51-a14d-eeccc2ea862c service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:46.666612 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddba18-76f5-4c51-a14d-eeccc2ea862c service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:46.666893 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddba18-76f5-4c51-a14d-eeccc2ea862c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:46.668562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5bddba18-76f5-4c51-a14d-eeccc2ea862c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:46.709958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:46.766008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddba18-76f5-4c51-a14d-eeccc2ea862c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:46.768096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddba18-76f5-4c51-a14d-eeccc2ea862c service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:46.792343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 683/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:32:49.115405 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05387a2-1a4b-4fe9-9d35-eb7a46c340c2 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:49.116003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05387a2-1a4b-4fe9-9d35-eb7a46c340c2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:49.116003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05387a2-1a4b-4fe9-9d35-eb7a46c340c2 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:49.117997 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 706/1389] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:49.123911 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67d866-a7b0-446b-bcea-38ce6d7ddd23 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:49.124412 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67d866-a7b0-446b-bcea-38ce6d7ddd23 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:49.124548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67d866-a7b0-446b-bcea-38ce6d7ddd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:49.195050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4f67d866-a7b0-446b-bcea-38ce6d7ddd23 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:49.197053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4f67d866-a7b0-446b-bcea-38ce6d7ddd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:49.295839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 684/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:49.348987 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05387a2-1a4b-4fe9-9d35-eb7a46c340c2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:49.350854 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d05387a2-1a4b-4fe9-9d35-eb7a46c340c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:49.521036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05387a2-1a4b-4fe9-9d35-eb7a46c340c2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:49.541438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:49.650452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e671588-6f81-4081-b836-689b81822a63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:49.651100 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e671588-6f81-4081-b836-689b81822a63 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:49.651510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e671588-6f81-4081-b836-689b81822a63 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:49.652406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e671588-6f81-4081-b836-689b81822a63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:49.654276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1e671588-6f81-4081-b836-689b81822a63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:49.744438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e671588-6f81-4081-b836-689b81822a63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:49.746028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e671588-6f81-4081-b836-689b81822a63 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:49.765013 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 707/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:32:49.908355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010c90c-ee7b-4cea-9fab-0ee334fa50f9 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:49.908545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010c90c-ee7b-4cea-9fab-0ee334fa50f9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:49.908832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010c90c-ee7b-4cea-9fab-0ee334fa50f9 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:49.910236 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 685/1392] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:49.915606 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441daf2-ec5a-4aae-8437-0d505515628b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:49.915960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441daf2-ec5a-4aae-8437-0d505515628b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:49.916247 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441daf2-ec5a-4aae-8437-0d505515628b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:49.942351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:49.988025 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3441daf2-ec5a-4aae-8437-0d505515628b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:49.988025 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3441daf2-ec5a-4aae-8437-0d505515628b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:50.099117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 708/1393] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:50.156737 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ec280-3e28-4778-905e-b773350f7806 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:50.157247 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ec280-3e28-4778-905e-b773350f7806 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:50.157390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ec280-3e28-4778-905e-b773350f7806 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:50.158906 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 686/1394] 10.222.0.16 () {54 vars in 961 bytes} [Mon Jul 18 10:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:50.164901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b80cf-bcc7-4972-bfac-80b58f4ed712 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:50.165386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b80cf-bcc7-4972-bfac-80b58f4ed712 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:50.165719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b80cf-bcc7-4972-bfac-80b58f4ed712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:50.244998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8c2b80cf-bcc7-4972-bfac-80b58f4ed712 None None] MFA Rules not processed for user `7f93de99555742ca9bd99d707d1cdbee`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:50.246226 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8c2b80cf-bcc7-4972-bfac-80b58f4ed712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:50.289831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:50.328335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 709/1395] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Jul 18 10:32:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:50.335827 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ec280-3e28-4778-905e-b773350f7806 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:50.337337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5f5ec280-3e28-4778-905e-b773350f7806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:50.353367 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:50.449882 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ec280-3e28-4778-905e-b773350f7806 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:50.528779 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def4616-7807-445d-b243-fe9d7b8be996 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f93de99555742ca9bd99d707d1cdbee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:50.529425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def4616-7807-445d-b243-fe9d7b8be996 service glance] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:50.529750 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def4616-7807-445d-b243-fe9d7b8be996 service glance] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:50.530048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def4616-7807-445d-b243-fe9d7b8be996 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:50.531875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9def4616-7807-445d-b243-fe9d7b8be996 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:50.605538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:50.651522 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def4616-7807-445d-b243-fe9d7b8be996 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:50.653080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def4616-7807-445d-b243-fe9d7b8be996 service glance] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:50.671960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 687/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:32:51.652932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ba720-c2ea-4ad8-8221-f4324a31f8c8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:51.652932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ba720-c2ea-4ad8-8221-f4324a31f8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:51.652932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ba720-c2ea-4ad8-8221-f4324a31f8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:51.715429 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-226ba720-c2ea-4ad8-8221-f4324a31f8c8 None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:51.716634 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-226ba720-c2ea-4ad8-8221-f4324a31f8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:51.807857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 710/1397] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 18 10:32:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:51.854798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ca2bc-f327-41ce-bb44-7f2eb188b216 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:51.855299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ca2bc-f327-41ce-bb44-7f2eb188b216 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:51.855454 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ca2bc-f327-41ce-bb44-7f2eb188b216 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:51.856914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 688/1398] 10.222.0.16 () {54 vars in 943 bytes} [Mon Jul 18 10:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:51.863568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb3081-bb11-4b41-a3bf-fb15758820f8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:51.863922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb3081-bb11-4b41-a3bf-fb15758820f8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:51.864229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb3081-bb11-4b41-a3bf-fb15758820f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:51.937490 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:51.947473 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c1eb3081-bb11-4b41-a3bf-fb15758820f8 None None] MFA Rules not processed for user `a8ee2beff1a7487d92c1c5940f2784f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:51.948791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c1eb3081-bb11-4b41-a3bf-fb15758820f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:51.986199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b6ce4-968e-42e5-83f7-dfbd95a216b6 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:51.986532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b6ce4-968e-42e5-83f7-dfbd95a216b6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:51.986817 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b6ce4-968e-42e5-83f7-dfbd95a216b6 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:51.988210 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 689/1399] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:51.994850 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6f0b9-7cf2-4c3b-b27c-98bba80997c6 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:51.995091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6f0b9-7cf2-4c3b-b27c-98bba80997c6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:51.995399 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6f0b9-7cf2-4c3b-b27c-98bba80997c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:52.061935 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-68b6f0b9-7cf2-4c3b-b27c-98bba80997c6 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:52.063182 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-68b6f0b9-7cf2-4c3b-b27c-98bba80997c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:52.069673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 711/1400] 10.222.0.16 () {58 vars in 1040 bytes} [Mon Jul 18 10:32:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:52.079226 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb3081-bb11-4b41-a3bf-fb15758820f8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:52.089137 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb3081-bb11-4b41-a3bf-fb15758820f8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:52.164688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 690/1401] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:52.202537 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ed5ad-d392-4ded-ac88-60f34c783448 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:52.202537 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ed5ad-d392-4ded-ac88-60f34c783448 service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:52.202741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ed5ad-d392-4ded-ac88-60f34c783448 service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:52.203020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ed5ad-d392-4ded-ac88-60f34c783448 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:52.204824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b67ed5ad-d392-4ded-ac88-60f34c783448 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:52.207761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:52.211836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6f0b9-7cf2-4c3b-b27c-98bba80997c6 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:52.213137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-68b6f0b9-7cf2-4c3b-b27c-98bba80997c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:52.241553 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:52.298241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ed5ad-d392-4ded-ac88-60f34c783448 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:52.299973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ed5ad-d392-4ded-ac88-60f34c783448 service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:52.308844 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 712/1402] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:32:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 10:32:52.335449 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6f0b9-7cf2-4c3b-b27c-98bba80997c6 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:52.456610 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d79da8-a13d-47cd-b3b7-658cde2db579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:52.457175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d79da8-a13d-47cd-b3b7-658cde2db579 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:52.457544 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d79da8-a13d-47cd-b3b7-658cde2db579 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:52.457861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d79da8-a13d-47cd-b3b7-658cde2db579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:52.459558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-40d79da8-a13d-47cd-b3b7-658cde2db579 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:52.479417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:52.553509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d79da8-a13d-47cd-b3b7-658cde2db579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:52.555401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d79da8-a13d-47cd-b3b7-658cde2db579 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:52.575445 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 691/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:32:54.869368 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da81a9a-18ac-4dfa-a732-9eeb71341099 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:54.869978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da81a9a-18ac-4dfa-a732-9eeb71341099 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:54.869978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da81a9a-18ac-4dfa-a732-9eeb71341099 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:54.871343 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 713/1404] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:32:54.877014 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264ed53-873e-4215-9074-aaa138a073ac None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:54.882121 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264ed53-873e-4215-9074-aaa138a073ac None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:54.882121 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264ed53-873e-4215-9074-aaa138a073ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:54.956494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1264ed53-873e-4215-9074-aaa138a073ac None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:54.960998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1264ed53-873e-4215-9074-aaa138a073ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:55.069235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:55.090383 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 692/1405] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:55.128900 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da81a9a-18ac-4dfa-a732-9eeb71341099 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:55.139383 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0da81a9a-18ac-4dfa-a732-9eeb71341099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:55.297289 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:55.301942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da81a9a-18ac-4dfa-a732-9eeb71341099 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:55.437622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9e1f1-2dc9-4050-9c3f-fc7892f139a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:55.438719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9e1f1-2dc9-4050-9c3f-fc7892f139a3 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:55.439181 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9e1f1-2dc9-4050-9c3f-fc7892f139a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:55.439461 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9e1f1-2dc9-4050-9c3f-fc7892f139a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:55.441274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d3d9e1f1-2dc9-4050-9c3f-fc7892f139a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:55.551199 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9e1f1-2dc9-4050-9c3f-fc7892f139a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:55.554890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9e1f1-2dc9-4050-9c3f-fc7892f139a3 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:55.582507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 714/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:32:57.949229 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b47d5-36b1-400a-8947-cbb0bc59da72 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:57.949796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b47d5-36b1-400a-8947-cbb0bc59da72 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:57.949796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b47d5-36b1-400a-8947-cbb0bc59da72 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:57.951497 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 693/1407] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:32:57.957193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73659fc-8a3f-4a05-9e22-106dff996a18 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:57.957579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73659fc-8a3f-4a05-9e22-106dff996a18 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:57.957776 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73659fc-8a3f-4a05-9e22-106dff996a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:57.961724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:58.048521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f73659fc-8a3f-4a05-9e22-106dff996a18 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:32:58.050263 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f73659fc-8a3f-4a05-9e22-106dff996a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:58.169303 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 715/1408] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:32:58.216017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b47d5-36b1-400a-8947-cbb0bc59da72 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:32:58.217617 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-289b47d5-36b1-400a-8947-cbb0bc59da72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:58.406047 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b47d5-36b1-400a-8947-cbb0bc59da72 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:32:58.494983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:58.553472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d96b3-8a36-40af-8087-1b7c32697089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:32:58.554182 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d96b3-8a36-40af-8087-1b7c32697089 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:32:58.554514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d96b3-8a36-40af-8087-1b7c32697089 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:32:58.554797 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d96b3-8a36-40af-8087-1b7c32697089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:32:58.556489 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a77d96b3-8a36-40af-8087-1b7c32697089 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:32:58.686957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d96b3-8a36-40af-8087-1b7c32697089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:32:58.689246 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d96b3-8a36-40af-8087-1b7c32697089 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:32:58.727583 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 694/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:08.167459 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=64 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:08.751839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=64 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:16.222213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c9d24-8637-4107-a8e9-da8284f4e7d7 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:16.222787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c9d24-8637-4107-a8e9-da8284f4e7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:16.222787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c9d24-8637-4107-a8e9-da8284f4e7d7 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:16.224198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 716/1410] 10.222.0.16 () {54 vars in 918 bytes} [Mon Jul 18 10:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:16.229458 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d6077-2cf7-4a3d-a118-dfaf3f8f8728 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:16.229947 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d6077-2cf7-4a3d-a118-dfaf3f8f8728 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:16.230054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d6077-2cf7-4a3d-a118-dfaf3f8f8728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:16.305756 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3d3d6077-2cf7-4a3d-a118-dfaf3f8f8728 None None] MFA Rules not processed for user `b8fd088faaba4d5c9745638c14f1a7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:16.307005 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3d3d6077-2cf7-4a3d-a118-dfaf3f8f8728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:16.417872 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 695/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Jul 18 10:33:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:16.432502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c272418-58e0-4873-9288-50245da039c6 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:16.432782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c272418-58e0-4873-9288-50245da039c6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:16.433058 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c272418-58e0-4873-9288-50245da039c6 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:16.434575 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 717/1412] 10.222.0.16 () {54 vars in 918 bytes} [Mon Jul 18 10:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:16.439576 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64915320-9a6e-4522-930c-f4463d819654 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:16.440080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64915320-9a6e-4522-930c-f4463d819654 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:16.440498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64915320-9a6e-4522-930c-f4463d819654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:16.516225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:16.518787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-64915320-9a6e-4522-930c-f4463d819654 None None] MFA Rules not processed for user `f7abf6b71ac3454ca547a750cef9220a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:16.520001 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-64915320-9a6e-4522-930c-f4463d819654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:16.639457 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 696/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Jul 18 10:33:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:19.159828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd86ea4-3559-41d9-b1a2-2dc25a8f584f None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:19.160215 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd86ea4-3559-41d9-b1a2-2dc25a8f584f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:19.160374 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd86ea4-3559-41d9-b1a2-2dc25a8f584f None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:19.161762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:19.167309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdaa7e-3dfd-497d-87a8-f16c03b33bdd None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:19.168499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdaa7e-3dfd-497d-87a8-f16c03b33bdd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:19.168646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdaa7e-3dfd-497d-87a8-f16c03b33bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:19.235333 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-dacdaa7e-3dfd-497d-87a8-f16c03b33bdd None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:19.236539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-dacdaa7e-3dfd-497d-87a8-f16c03b33bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:19.292362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:19.335557 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:19.379684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd86ea4-3559-41d9-b1a2-2dc25a8f584f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:19.381419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8fd86ea4-3559-41d9-b1a2-2dc25a8f584f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:19.531080 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd86ea4-3559-41d9-b1a2-2dc25a8f584f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:19.603979 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:19.644789 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ebe14-6e10-47dc-b13d-f557a3a7fea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:19.645433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ebe14-6e10-47dc-b13d-f557a3a7fea9 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:19.645711 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ebe14-6e10-47dc-b13d-f557a3a7fea9 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:19.645982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ebe14-6e10-47dc-b13d-f557a3a7fea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:19.647643 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-da9ebe14-6e10-47dc-b13d-f557a3a7fea9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:19.737441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ebe14-6e10-47dc-b13d-f557a3a7fea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:19.739075 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ebe14-6e10-47dc-b13d-f557a3a7fea9 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:19.758151 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 719/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:20.687232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7b9f4-490d-45df-b200-69d3e1b27498 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:20.687749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7b9f4-490d-45df-b200-69d3e1b27498 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:20.687749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7b9f4-490d-45df-b200-69d3e1b27498 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:20.689119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:20.694242 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d8669-8fa6-41db-8692-1462d71c8679 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:20.694763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d8669-8fa6-41db-8692-1462d71c8679 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:20.694872 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d8669-8fa6-41db-8692-1462d71c8679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:20.770120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f91d8669-8fa6-41db-8692-1462d71c8679 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:20.771363 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f91d8669-8fa6-41db-8692-1462d71c8679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:20.799840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:20.874032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:21.028825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7b9f4-490d-45df-b200-69d3e1b27498 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:21.030598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a0b7b9f4-490d-45df-b200-69d3e1b27498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:21.178367 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7b9f4-490d-45df-b200-69d3e1b27498 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:21.221243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:21.295788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b34f-401f-4525-b957-5749310c999d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:21.296431 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b34f-401f-4525-b957-5749310c999d service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:21.296716 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b34f-401f-4525-b957-5749310c999d service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:21.296991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b34f-401f-4525-b957-5749310c999d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:21.298665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4456b34f-401f-4525-b957-5749310c999d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:21.391479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456b34f-401f-4525-b957-5749310c999d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:21.393076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456b34f-401f-4525-b957-5749310c999d service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:21.411496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 699/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:22.312955 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b7d1c-b26b-45d2-96d7-73e7551ec42c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:22.313475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b7d1c-b26b-45d2-96d7-73e7551ec42c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:22.313475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b7d1c-b26b-45d2-96d7-73e7551ec42c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:22.315219 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:22.326076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c4e46-526d-40d6-82dd-113d91442580 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:22.326589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c4e46-526d-40d6-82dd-113d91442580 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:22.326695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c4e46-526d-40d6-82dd-113d91442580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:22.381969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:22.404858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-623c4e46-526d-40d6-82dd-113d91442580 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:22.406072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-623c4e46-526d-40d6-82dd-113d91442580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:22.506700 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:22.661138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b7d1c-b26b-45d2-96d7-73e7551ec42c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:22.662647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dd7b7d1c-b26b-45d2-96d7-73e7551ec42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:22.812237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b7d1c-b26b-45d2-96d7-73e7551ec42c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:22.825371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:22.943221 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043343b9-c827-4292-9d2d-b7f9b89b000d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:22.943780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043343b9-c827-4292-9d2d-b7f9b89b000d service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:22.944057 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043343b9-c827-4292-9d2d-b7f9b89b000d service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:22.944327 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043343b9-c827-4292-9d2d-b7f9b89b000d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:22.945939 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-043343b9-c827-4292-9d2d-b7f9b89b000d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:23.037859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043343b9-c827-4292-9d2d-b7f9b89b000d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:23.039541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043343b9-c827-4292-9d2d-b7f9b89b000d service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:23.060890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 722/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:23.944178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc195dc-26c1-47f4-97e9-3b82a8abb265 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:23.944720 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc195dc-26c1-47f4-97e9-3b82a8abb265 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:23.944720 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc195dc-26c1-47f4-97e9-3b82a8abb265 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:23.946098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:33:23.951747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fbbee-51fe-4352-bb16-fd15d44dad45 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:23.952160 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fbbee-51fe-4352-bb16-fd15d44dad45 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:23.952331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fbbee-51fe-4352-bb16-fd15d44dad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:23.971436 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:24.029521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d33fbbee-51fe-4352-bb16-fd15d44dad45 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:24.030767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d33fbbee-51fe-4352-bb16-fd15d44dad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:24.130179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:24.287380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc195dc-26c1-47f4-97e9-3b82a8abb265 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:24.288927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5dc195dc-26c1-47f4-97e9-3b82a8abb265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:24.400135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:24.436947 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc195dc-26c1-47f4-97e9-3b82a8abb265 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:24.551880 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f68d0-eb9f-409b-91ed-09bb9957b052 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:24.552444 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f68d0-eb9f-409b-91ed-09bb9957b052 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:24.552727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f68d0-eb9f-409b-91ed-09bb9957b052 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:24.553002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f68d0-eb9f-409b-91ed-09bb9957b052 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:24.554737 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f81f68d0-eb9f-409b-91ed-09bb9957b052 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:24.632201 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:24.645962 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f68d0-eb9f-409b-91ed-09bb9957b052 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:24.647826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f68d0-eb9f-409b-91ed-09bb9957b052 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:24.666950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 702/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:25.557892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9410cb3-fb92-47c6-92b9-18c6f4012c43 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:25.558552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9410cb3-fb92-47c6-92b9-18c6f4012c43 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:25.558646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9410cb3-fb92-47c6-92b9-18c6f4012c43 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:25.560117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:25.565674 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9854ba-dd44-4e31-ab1a-c7e2ba3c6946 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:25.566145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9854ba-dd44-4e31-ab1a-c7e2ba3c6946 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:25.566259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9854ba-dd44-4e31-ab1a-c7e2ba3c6946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:25.645349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4a9854ba-dd44-4e31-ab1a-c7e2ba3c6946 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:25.646746 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4a9854ba-dd44-4e31-ab1a-c7e2ba3c6946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:25.748721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:25.900418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9410cb3-fb92-47c6-92b9-18c6f4012c43 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:25.902233 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b9410cb3-fb92-47c6-92b9-18c6f4012c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:25.994073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:26.056933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9410cb3-fb92-47c6-92b9-18c6f4012c43 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:26.172865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da71cbf-7ff4-45dc-84ce-6577f7f4c44d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:26.173430 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da71cbf-7ff4-45dc-84ce-6577f7f4c44d service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:26.173711 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da71cbf-7ff4-45dc-84ce-6577f7f4c44d service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:26.173983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da71cbf-7ff4-45dc-84ce-6577f7f4c44d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:26.175657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7da71cbf-7ff4-45dc-84ce-6577f7f4c44d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:26.224293 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:26.267671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da71cbf-7ff4-45dc-84ce-6577f7f4c44d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:26.269342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da71cbf-7ff4-45dc-84ce-6577f7f4c44d service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:26.287528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 725/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:27.196267 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca178f3-7d01-42f1-9ec2-b4d2a20ef3c3 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:27.196882 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca178f3-7d01-42f1-9ec2-b4d2a20ef3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:27.196882 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca178f3-7d01-42f1-9ec2-b4d2a20ef3c3 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:27.198225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:33:27.203755 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd85b97-767d-4d16-84c2-26ab42caa203 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:27.204187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd85b97-767d-4d16-84c2-26ab42caa203 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:27.204453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd85b97-767d-4d16-84c2-26ab42caa203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:27.286563 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2fd85b97-767d-4d16-84c2-26ab42caa203 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:27.287786 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2fd85b97-767d-4d16-84c2-26ab42caa203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:27.388513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:27.544208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca178f3-7d01-42f1-9ec2-b4d2a20ef3c3 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:27.545858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-fca178f3-7d01-42f1-9ec2-b4d2a20ef3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:27.597394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:27.698145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca178f3-7d01-42f1-9ec2-b4d2a20ef3c3 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:27.814642 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cdc078-b1db-480e-8aa2-28abca06b1bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:27.815194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdc078-b1db-480e-8aa2-28abca06b1bb service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:27.815478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdc078-b1db-480e-8aa2-28abca06b1bb service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:27.815759 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdc078-b1db-480e-8aa2-28abca06b1bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:27.817463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-06cdc078-b1db-480e-8aa2-28abca06b1bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:27.824828 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:27.909439 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cdc078-b1db-480e-8aa2-28abca06b1bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:27.911088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cdc078-b1db-480e-8aa2-28abca06b1bb service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:27.929905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 705/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:28.828590 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87a904-b166-46dd-be37-b82831ad64d9 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:28.829165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87a904-b166-46dd-be37-b82831ad64d9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:28.829165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87a904-b166-46dd-be37-b82831ad64d9 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:28.830677 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:28.836027 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c6866-6f50-4236-bed4-1d9008f83bce None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:28.836442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c6866-6f50-4236-bed4-1d9008f83bce None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:28.836584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c6866-6f50-4236-bed4-1d9008f83bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:28.915381 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c59c6866-6f50-4236-bed4-1d9008f83bce None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:28.916615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c59c6866-6f50-4236-bed4-1d9008f83bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:28.988544 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:29.018488 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:29.171561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87a904-b166-46dd-be37-b82831ad64d9 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:29.173108 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0c87a904-b166-46dd-be37-b82831ad64d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:29.191711 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:29.324172 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87a904-b166-46dd-be37-b82831ad64d9 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:29.413890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:29.441383 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322f409-88d6-4e6f-90d6-c8120f62d3d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:29.441904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322f409-88d6-4e6f-90d6-c8120f62d3d3 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:29.442186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322f409-88d6-4e6f-90d6-c8120f62d3d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:29.442514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322f409-88d6-4e6f-90d6-c8120f62d3d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:29.444141 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0322f409-88d6-4e6f-90d6-c8120f62d3d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:29.539374 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322f409-88d6-4e6f-90d6-c8120f62d3d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:29.541100 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322f409-88d6-4e6f-90d6-c8120f62d3d3 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:29.560719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 728/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:30.515314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1466d-d2b7-4607-86cb-c44eef6542ed None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:30.516187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1466d-d2b7-4607-86cb-c44eef6542ed None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:30.516187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1466d-d2b7-4607-86cb-c44eef6542ed None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:30.517251 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:30.522968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50ead4-2e63-4596-829f-190c755b867d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:30.523425 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50ead4-2e63-4596-829f-190c755b867d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:30.523853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50ead4-2e63-4596-829f-190c755b867d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:30.603618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ec50ead4-2e63-4596-829f-190c755b867d None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:30.605438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ec50ead4-2e63-4596-829f-190c755b867d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:30.648923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:30.705909 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:30.858946 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1466d-d2b7-4607-86cb-c44eef6542ed None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:30.860650 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9fb1466d-d2b7-4607-86cb-c44eef6542ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:31.012292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1466d-d2b7-4607-86cb-c44eef6542ed None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:31.066598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:31.128415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3601022-5e24-428b-a62f-6eb6c16c2623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:31.128985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3601022-5e24-428b-a62f-6eb6c16c2623 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:31.129264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3601022-5e24-428b-a62f-6eb6c16c2623 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:31.129542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3601022-5e24-428b-a62f-6eb6c16c2623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:31.131233 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b3601022-5e24-428b-a62f-6eb6c16c2623 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:31.228980 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3601022-5e24-428b-a62f-6eb6c16c2623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:31.231582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3601022-5e24-428b-a62f-6eb6c16c2623 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:31.252841 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 708/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:32.161326 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f2e56-fe4f-4f90-8d4e-d42022578430 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:32.161907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f2e56-fe4f-4f90-8d4e-d42022578430 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:32.161907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f2e56-fe4f-4f90-8d4e-d42022578430 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:32.163292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:33:32.168901 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aecfb3-7279-4078-85ed-f4b80f41d9d6 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:32.169368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aecfb3-7279-4078-85ed-f4b80f41d9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:32.169488 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aecfb3-7279-4078-85ed-f4b80f41d9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:32.244127 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-33aecfb3-7279-4078-85ed-f4b80f41d9d6 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:32.245343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-33aecfb3-7279-4078-85ed-f4b80f41d9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:32.248571 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:32.345930 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:32.497468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f2e56-fe4f-4f90-8d4e-d42022578430 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:32.499276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a65f2e56-fe4f-4f90-8d4e-d42022578430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:32.652626 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f2e56-fe4f-4f90-8d4e-d42022578430 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:32.682545 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:32.781522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc1e9b-82f2-41c0-ab10-70a9a8e0a7b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:32.782071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc1e9b-82f2-41c0-ab10-70a9a8e0a7b7 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:32.782369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc1e9b-82f2-41c0-ab10-70a9a8e0a7b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:32.782640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc1e9b-82f2-41c0-ab10-70a9a8e0a7b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:32.784454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-27cc1e9b-82f2-41c0-ab10-70a9a8e0a7b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:32.880858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc1e9b-82f2-41c0-ab10-70a9a8e0a7b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:32.882506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc1e9b-82f2-41c0-ab10-70a9a8e0a7b7 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:32.902654 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 731/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:34.874394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dec783-f46d-4f62-ba62-446fd7076b66 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:34.874966 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dec783-f46d-4f62-ba62-446fd7076b66 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:34.874966 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dec783-f46d-4f62-ba62-446fd7076b66 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:34.876495 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:34.881940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39100b4-a757-4da5-a89c-f896be72a1b6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:34.882775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39100b4-a757-4da5-a89c-f896be72a1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:34.882775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39100b4-a757-4da5-a89c-f896be72a1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:34.924011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:34.951516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a39100b4-a757-4da5-a89c-f896be72a1b6 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:34.953037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a39100b4-a757-4da5-a89c-f896be72a1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:35.051090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:35.090085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dec783-f46d-4f62-ba62-446fd7076b66 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:35.091831 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d6dec783-f46d-4f62-ba62-446fd7076b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:35.200549 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dec783-f46d-4f62-ba62-446fd7076b66 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:35.233790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:35.277019 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858eebc-6fe2-40fb-89b6-d4187737e82c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:35.277677 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858eebc-6fe2-40fb-89b6-d4187737e82c service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:35.277962 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858eebc-6fe2-40fb-89b6-d4187737e82c service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:35.278277 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858eebc-6fe2-40fb-89b6-d4187737e82c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:35.279975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6858eebc-6fe2-40fb-89b6-d4187737e82c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:35.397312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858eebc-6fe2-40fb-89b6-d4187737e82c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:35.398806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858eebc-6fe2-40fb-89b6-d4187737e82c service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:35.420046 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 711/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:37.653449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1a85a-bc1a-48e9-bc49-0add0f57e80d None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:37.654127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1a85a-bc1a-48e9-bc49-0add0f57e80d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:37.654127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1a85a-bc1a-48e9-bc49-0add0f57e80d None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:37.655390 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:37.661157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802f504-e4ef-4826-99b3-83f9ad32f1a6 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:37.661636 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802f504-e4ef-4826-99b3-83f9ad32f1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:37.661749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802f504-e4ef-4826-99b3-83f9ad32f1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:37.727796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-5802f504-e4ef-4826-99b3-83f9ad32f1a6 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:37.729025 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5802f504-e4ef-4826-99b3-83f9ad32f1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:37.742529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:37.834079 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:37.874376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1a85a-bc1a-48e9-bc49-0add0f57e80d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:37.875890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-51f1a85a-bc1a-48e9-bc49-0add0f57e80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:37.982265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1a85a-bc1a-48e9-bc49-0add0f57e80d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:37.994243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:38.056304 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bca50-690a-482b-8884-dac45a2c3e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:38.056945 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bca50-690a-482b-8884-dac45a2c3e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:38.057224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bca50-690a-482b-8884-dac45a2c3e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:38.057499 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bca50-690a-482b-8884-dac45a2c3e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:38.059292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7f1bca50-690a-482b-8884-dac45a2c3e32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:38.170993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bca50-690a-482b-8884-dac45a2c3e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:38.172425 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bca50-690a-482b-8884-dac45a2c3e32 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:38.191069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 734/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:40.652074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b0407-0e7d-4adb-852e-8ea86dc17deb None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:40.652718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b0407-0e7d-4adb-852e-8ea86dc17deb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:40.652718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b0407-0e7d-4adb-852e-8ea86dc17deb None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:40.654085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:40.659382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17699e-b09b-45af-a2a8-1a8072e6c7dd None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:40.659846 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17699e-b09b-45af-a2a8-1a8072e6c7dd None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:40.659961 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17699e-b09b-45af-a2a8-1a8072e6c7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:40.708969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:40.728977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-cc17699e-b09b-45af-a2a8-1a8072e6c7dd None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:40.730999 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-cc17699e-b09b-45af-a2a8-1a8072e6c7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:40.832973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:40.873469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b0407-0e7d-4adb-852e-8ea86dc17deb None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:40.875100 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-778b0407-0e7d-4adb-852e-8ea86dc17deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:40.982217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b0407-0e7d-4adb-852e-8ea86dc17deb None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:41.022960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:41.058124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059fb25-9e5f-4896-a495-d13217b66c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:41.059160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059fb25-9e5f-4896-a495-d13217b66c00 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:41.059452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059fb25-9e5f-4896-a495-d13217b66c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:41.059740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059fb25-9e5f-4896-a495-d13217b66c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:41.061437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d059fb25-9e5f-4896-a495-d13217b66c00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:41.185232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059fb25-9e5f-4896-a495-d13217b66c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:41.186786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059fb25-9e5f-4896-a495-d13217b66c00 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:41.209001 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 714/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:43.475441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afdfc6-5b97-4c13-94c2-f80e83aeafb6 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:43.476039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afdfc6-5b97-4c13-94c2-f80e83aeafb6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:43.476039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afdfc6-5b97-4c13-94c2-f80e83aeafb6 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:43.477383 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:43.483215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07569dd7-6d96-433c-9fd2-dde0dab3e391 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:43.483760 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07569dd7-6d96-433c-9fd2-dde0dab3e391 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:43.483868 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07569dd7-6d96-433c-9fd2-dde0dab3e391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:43.559556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-07569dd7-6d96-433c-9fd2-dde0dab3e391 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:43.560794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-07569dd7-6d96-433c-9fd2-dde0dab3e391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:43.586234 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:43.690766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:43.731829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afdfc6-5b97-4c13-94c2-f80e83aeafb6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:43.733357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b9afdfc6-5b97-4c13-94c2-f80e83aeafb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:43.855775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afdfc6-5b97-4c13-94c2-f80e83aeafb6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:43.877767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:43.948938 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90311664-c84f-4251-8c97-1603a8215834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:43.950095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90311664-c84f-4251-8c97-1603a8215834 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:43.950642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90311664-c84f-4251-8c97-1603a8215834 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:43.951104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90311664-c84f-4251-8c97-1603a8215834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:43.953823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-90311664-c84f-4251-8c97-1603a8215834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:44.078249 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90311664-c84f-4251-8c97-1603a8215834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:44.079701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90311664-c84f-4251-8c97-1603a8215834 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:44.100205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 737/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:33:46.340027 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb4fd9-d1ab-45db-835b-5ff3c8e506ec None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:46.340619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb4fd9-d1ab-45db-835b-5ff3c8e506ec None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:46.340619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb4fd9-d1ab-45db-835b-5ff3c8e506ec None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:46.342038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:46.350731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcc0db-e42b-4a95-8865-eaf74f033c26 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:46.351309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcc0db-e42b-4a95-8865-eaf74f033c26 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:46.351309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcc0db-e42b-4a95-8865-eaf74f033c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:46.439346 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:46.442612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-66bcc0db-e42b-4a95-8865-eaf74f033c26 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:46.443989 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-66bcc0db-e42b-4a95-8865-eaf74f033c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:46.564291 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:46.629601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb4fd9-d1ab-45db-835b-5ff3c8e506ec None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:46.631532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-85cb4fd9-d1ab-45db-835b-5ff3c8e506ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:46.772317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb4fd9-d1ab-45db-835b-5ff3c8e506ec None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:46.845983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:46.882660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786fbae-1d4e-4822-8dfe-4832e7b8e630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:46.883270 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786fbae-1d4e-4822-8dfe-4832e7b8e630 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:46.883556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786fbae-1d4e-4822-8dfe-4832e7b8e630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:46.883833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786fbae-1d4e-4822-8dfe-4832e7b8e630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:46.886421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f786fbae-1d4e-4822-8dfe-4832e7b8e630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:47.056787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786fbae-1d4e-4822-8dfe-4832e7b8e630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:47.059094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786fbae-1d4e-4822-8dfe-4832e7b8e630 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:47.082592 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 717/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:33:49.392376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3ba11-105c-4263-8e4f-0a4d14c35d71 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:49.393055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3ba11-105c-4263-8e4f-0a4d14c35d71 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:49.393055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3ba11-105c-4263-8e4f-0a4d14c35d71 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:49.395164 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:49.401211 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447df8c6-dd4a-4863-b8ba-a4783e030348 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:49.402649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447df8c6-dd4a-4863-b8ba-a4783e030348 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:49.402649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447df8c6-dd4a-4863-b8ba-a4783e030348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:49.476745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-447df8c6-dd4a-4863-b8ba-a4783e030348 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:49.477990 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-447df8c6-dd4a-4863-b8ba-a4783e030348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:49.509579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:49.585672 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:49.626985 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3ba11-105c-4263-8e4f-0a4d14c35d71 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:49.628505 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8da3ba11-105c-4263-8e4f-0a4d14c35d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:49.746421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3ba11-105c-4263-8e4f-0a4d14c35d71 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:49.779354 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:49.828213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64388d-36ea-4507-96f7-add4089e101d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:49.828923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64388d-36ea-4507-96f7-add4089e101d service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:49.829204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64388d-36ea-4507-96f7-add4089e101d service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:49.829483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64388d-36ea-4507-96f7-add4089e101d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:49.831223 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ab64388d-36ea-4507-96f7-add4089e101d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:49.945859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64388d-36ea-4507-96f7-add4089e101d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:49.947348 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64388d-36ea-4507-96f7-add4089e101d service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:49.968140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 740/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:52.063051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d889d-e0a5-4828-8390-f37dffb5a2dc None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:52.063626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d889d-e0a5-4828-8390-f37dffb5a2dc None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:52.063626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d889d-e0a5-4828-8390-f37dffb5a2dc None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:52.065262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:52.071309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673a185-4b34-4278-8aa5-24a6ecc3069b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:52.071825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673a185-4b34-4278-8aa5-24a6ecc3069b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:52.071924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673a185-4b34-4278-8aa5-24a6ecc3069b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:52.142502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3673a185-4b34-4278-8aa5-24a6ecc3069b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:52.143707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3673a185-4b34-4278-8aa5-24a6ecc3069b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:52.152492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:52.244332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:52.284505 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d889d-e0a5-4828-8390-f37dffb5a2dc None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:52.286109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-329d889d-e0a5-4828-8390-f37dffb5a2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:52.395559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d889d-e0a5-4828-8390-f37dffb5a2dc None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:52.455548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:52.476299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5bb71-1868-41a1-876a-69bfb77e522a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:52.476955 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5bb71-1868-41a1-876a-69bfb77e522a service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:52.477241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5bb71-1868-41a1-876a-69bfb77e522a service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:52.477520 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5bb71-1868-41a1-876a-69bfb77e522a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:52.479266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0be5bb71-1868-41a1-876a-69bfb77e522a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:52.598056 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5bb71-1868-41a1-876a-69bfb77e522a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:52.599471 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5bb71-1868-41a1-876a-69bfb77e522a service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:52.619334 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 720/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:33:54.743742 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aa05a-f178-42da-9d8c-e83896c86592 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:54.744357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aa05a-f178-42da-9d8c-e83896c86592 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:54.744357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aa05a-f178-42da-9d8c-e83896c86592 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:54.746527 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:54.752532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46d26c-c1f3-48a5-a878-3c85da63630b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:54.753063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46d26c-c1f3-48a5-a878-3c85da63630b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:54.753063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46d26c-c1f3-48a5-a878-3c85da63630b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:54.827937 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8e46d26c-c1f3-48a5-a878-3c85da63630b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:54.829457 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8e46d26c-c1f3-48a5-a878-3c85da63630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:54.873291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:54.935610 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:54.974845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394aa05a-f178-42da-9d8c-e83896c86592 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:54.976399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-394aa05a-f178-42da-9d8c-e83896c86592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:55.085352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394aa05a-f178-42da-9d8c-e83896c86592 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:55.126526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:55.165977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511aba7c-1779-4bcf-9a1f-d5331212bca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:55.166665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511aba7c-1779-4bcf-9a1f-d5331212bca0 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:55.167697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511aba7c-1779-4bcf-9a1f-d5331212bca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:55.167976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511aba7c-1779-4bcf-9a1f-d5331212bca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:55.169648 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-511aba7c-1779-4bcf-9a1f-d5331212bca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:55.286259 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511aba7c-1779-4bcf-9a1f-d5331212bca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:55.287805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511aba7c-1779-4bcf-9a1f-d5331212bca0 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:55.308020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 743/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:57.409000 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f8095-6996-49f9-ab47-bda486db1bff None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:57.409595 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f8095-6996-49f9-ab47-bda486db1bff None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:57.409595 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f8095-6996-49f9-ab47-bda486db1bff None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:57.411032 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:57.416954 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27762b0c-b697-4138-802e-d18db64147a4 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:57.418058 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27762b0c-b697-4138-802e-d18db64147a4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:57.418058 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27762b0c-b697-4138-802e-d18db64147a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:57.485886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-27762b0c-b697-4138-802e-d18db64147a4 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:57.487147 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-27762b0c-b697-4138-802e-d18db64147a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:57.506367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:57.587892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:57.625477 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f8095-6996-49f9-ab47-bda486db1bff None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:57.627122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-eb8f8095-6996-49f9-ab47-bda486db1bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:57.736765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f8095-6996-49f9-ab47-bda486db1bff None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:57.808099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:57.815595 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80785f3-bdd7-482c-9819-1765fccbde0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:57.816350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80785f3-bdd7-482c-9819-1765fccbde0b service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:57.818258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80785f3-bdd7-482c-9819-1765fccbde0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:57.818258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80785f3-bdd7-482c-9819-1765fccbde0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:57.818572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c80785f3-bdd7-482c-9819-1765fccbde0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:57.933290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80785f3-bdd7-482c-9819-1765fccbde0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:57.934704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80785f3-bdd7-482c-9819-1765fccbde0b service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:57.953187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 723/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:00.033426 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70355f-357a-43c5-9d3a-096d01c144d4 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:00.033986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70355f-357a-43c5-9d3a-096d01c144d4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:00.033986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70355f-357a-43c5-9d3a-096d01c144d4 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:00.035449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:00.040909 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3412d8d-8b57-4bce-afed-acc9f57bc456 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:00.041305 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3412d8d-8b57-4bce-afed-acc9f57bc456 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:00.041469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3412d8d-8b57-4bce-afed-acc9f57bc456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:00.107229 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c3412d8d-8b57-4bce-afed-acc9f57bc456 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:00.108432 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c3412d8d-8b57-4bce-afed-acc9f57bc456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:00.160078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:00.210374 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:00.247384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70355f-357a-43c5-9d3a-096d01c144d4 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:00.249161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0b70355f-357a-43c5-9d3a-096d01c144d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:00.352820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70355f-357a-43c5-9d3a-096d01c144d4 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:00.401333 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:00.427967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bff34-5049-40ef-8256-4ab38fbcf402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:00.428665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bff34-5049-40ef-8256-4ab38fbcf402 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:00.428948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bff34-5049-40ef-8256-4ab38fbcf402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:00.429221 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bff34-5049-40ef-8256-4ab38fbcf402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:00.430949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-aa8bff34-5049-40ef-8256-4ab38fbcf402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:00.549560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bff34-5049-40ef-8256-4ab38fbcf402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:00.551097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bff34-5049-40ef-8256-4ab38fbcf402 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:00.569847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 746/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:10.208481 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=22 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:10.567367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=66 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:20.544058 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da970f9e-9d9b-420a-90a1-fa14ac56585c None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:20.544661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da970f9e-9d9b-420a-90a1-fa14ac56585c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:20.544661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da970f9e-9d9b-420a-90a1-fa14ac56585c None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:20.546080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 725/1471] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:20.551691 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb36bc-b3c4-40da-a7b2-f956bbe8b0d9 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:20.552166 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb36bc-b3c4-40da-a7b2-f956bbe8b0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:20.552270 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb36bc-b3c4-40da-a7b2-f956bbe8b0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:20.623517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-87eb36bc-b3c4-40da-a7b2-f956bbe8b0d9 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:20.624746 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-87eb36bc-b3c4-40da-a7b2-f956bbe8b0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:20.728120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 747/1472] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:20.780176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6454a0d-ff3c-4d02-a8db-92c8fe668a85 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:20.780467 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6454a0d-ff3c-4d02-a8db-92c8fe668a85 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:20.780749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6454a0d-ff3c-4d02-a8db-92c8fe668a85 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:20.782148 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 726/1473] 10.222.0.16 () {54 vars in 961 bytes} [Mon Jul 18 10:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:20.787132 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94902a5-55ca-4b10-8985-26366ff3a3ff None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:20.787421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94902a5-55ca-4b10-8985-26366ff3a3ff None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:20.787700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94902a5-55ca-4b10-8985-26366ff3a3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:20.867711 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c94902a5-55ca-4b10-8985-26366ff3a3ff None None] MFA Rules not processed for user `7f93de99555742ca9bd99d707d1cdbee`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:20.868880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c94902a5-55ca-4b10-8985-26366ff3a3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:20.890502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:20.948744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 748/1474] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Jul 18 10:34:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:20.956302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6454a0d-ff3c-4d02-a8db-92c8fe668a85 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:20.957831 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f6454a0d-ff3c-4d02-a8db-92c8fe668a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:21.067520 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6454a0d-ff3c-4d02-a8db-92c8fe668a85 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:21.144620 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d051c28-2b65-4cab-bdaa-03523c97819b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f93de99555742ca9bd99d707d1cdbee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:21.145179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d051c28-2b65-4cab-bdaa-03523c97819b service glance] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:21.145458 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d051c28-2b65-4cab-bdaa-03523c97819b service glance] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:21.145734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d051c28-2b65-4cab-bdaa-03523c97819b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:21.147413 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5d051c28-2b65-4cab-bdaa-03523c97819b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:21.206137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:21.265389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d051c28-2b65-4cab-bdaa-03523c97819b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:21.266886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d051c28-2b65-4cab-bdaa-03523c97819b service glance] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:21.285916 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 727/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:23.492274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac8c0a-c08d-4f5a-a288-8d10e0f62fe1 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:23.492851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac8c0a-c08d-4f5a-a288-8d10e0f62fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:23.492851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac8c0a-c08d-4f5a-a288-8d10e0f62fe1 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:23.494254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 749/1476] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:23.500154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ee0f3-5cb3-433d-b0b3-6129c22322d1 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:23.500588 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ee0f3-5cb3-433d-b0b3-6129c22322d1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:23.500700 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ee0f3-5cb3-433d-b0b3-6129c22322d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:23.569949 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2d6ee0f3-5cb3-433d-b0b3-6129c22322d1 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:23.571200 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2d6ee0f3-5cb3-433d-b0b3-6129c22322d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:23.671003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 728/1477] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:34:23.694144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac8c0a-c08d-4f5a-a288-8d10e0f62fe1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:23.695703 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-62ac8c0a-c08d-4f5a-a288-8d10e0f62fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:23.829395 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac8c0a-c08d-4f5a-a288-8d10e0f62fe1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:23.878802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:23.924395 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50befb25-3987-4179-8b62-c0739ccdfe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:23.925052 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50befb25-3987-4179-8b62-c0739ccdfe08 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:23.925328 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50befb25-3987-4179-8b62-c0739ccdfe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:23.925599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50befb25-3987-4179-8b62-c0739ccdfe08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:23.926823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50befb25-3987-4179-8b62-c0739ccdfe08 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:23.928592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: WARNING py.warnings [None req-50befb25-3987-4179-8b62-c0739ccdfe08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:34:23.928592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: warnings.warn(msg) Jul 18 10:34:23.928592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: Jul 18 10:34:23.929731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50befb25-3987-4179-8b62-c0739ccdfe08 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:23.950498 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 750/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 18 10:34:23 2022] GET /identity/v3/projects => generated 2553 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:34:26.020813 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48c943-6a50-43ca-941f-fabe35be0410 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:26.021226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48c943-6a50-43ca-941f-fabe35be0410 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:26.021422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48c943-6a50-43ca-941f-fabe35be0410 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:26.022938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 729/1479] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:26.028610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a13d1-59a3-4cc0-b4da-01ab4d14923c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:26.029097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a13d1-59a3-4cc0-b4da-01ab4d14923c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:26.029097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a13d1-59a3-4cc0-b4da-01ab4d14923c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:26.095497 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-fb1a13d1-59a3-4cc0-b4da-01ab4d14923c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:26.096717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fb1a13d1-59a3-4cc0-b4da-01ab4d14923c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:26.197092 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 751/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:26.240261 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48c943-6a50-43ca-941f-fabe35be0410 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:26.241853 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-fa48c943-6a50-43ca-941f-fabe35be0410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:26.252966 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:26.518993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48c943-6a50-43ca-941f-fabe35be0410 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:26.603577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:26.636827 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b1ad-8bb3-4269-9f17-1723877f9b9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:26.637475 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b1ad-8bb3-4269-9f17-1723877f9b9f service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:26.637865 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b1ad-8bb3-4269-9f17-1723877f9b9f service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:26.638142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b1ad-8bb3-4269-9f17-1723877f9b9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:26.639848 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-69a9b1ad-8bb3-4269-9f17-1723877f9b9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:26.739359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b1ad-8bb3-4269-9f17-1723877f9b9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:26.740976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b1ad-8bb3-4269-9f17-1723877f9b9f service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:26.760128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 730/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:29.016441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ec364-3d3b-495a-8030-362414f7c2dc None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:29.016975 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ec364-3d3b-495a-8030-362414f7c2dc None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:29.016975 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ec364-3d3b-495a-8030-362414f7c2dc None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:29.018392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 752/1482] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:29.023661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb84f2a-5c51-4376-abfc-c1545bd819ab None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:29.024590 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb84f2a-5c51-4376-abfc-c1545bd819ab None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:29.024590 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb84f2a-5c51-4376-abfc-c1545bd819ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:29.091921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-bbb84f2a-5c51-4376-abfc-c1545bd819ab None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:29.093327 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-bbb84f2a-5c51-4376-abfc-c1545bd819ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:29.141643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:29.192335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 731/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:29.228587 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ec364-3d3b-495a-8030-362414f7c2dc None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:29.231130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0e5ec364-3d3b-495a-8030-362414f7c2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:29.256458 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:29.339987 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ec364-3d3b-495a-8030-362414f7c2dc None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:29.416127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4cf44-8358-47a2-956f-0e332a998df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:29.417031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4cf44-8358-47a2-956f-0e332a998df1 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:29.417328 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4cf44-8358-47a2-956f-0e332a998df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:29.417623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4cf44-8358-47a2-956f-0e332a998df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:29.419305 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4fe4cf44-8358-47a2-956f-0e332a998df1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:29.496535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:29.533401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4cf44-8358-47a2-956f-0e332a998df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:29.534964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4cf44-8358-47a2-956f-0e332a998df1 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:29.554348 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 753/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:31.661450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6447dc9-2b58-4bd3-b016-aa63215b93dd None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:31.662054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6447dc9-2b58-4bd3-b016-aa63215b93dd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:31.662054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6447dc9-2b58-4bd3-b016-aa63215b93dd None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:31.663451 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 732/1485] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:31.669794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc29ca-5dfd-45f3-ac92-aa567f3ace91 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:31.670262 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc29ca-5dfd-45f3-ac92-aa567f3ace91 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:31.670385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc29ca-5dfd-45f3-ac92-aa567f3ace91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:31.739611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b8bc29ca-5dfd-45f3-ac92-aa567f3ace91 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:31.740820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b8bc29ca-5dfd-45f3-ac92-aa567f3ace91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:31.841997 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 754/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:31.882182 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6447dc9-2b58-4bd3-b016-aa63215b93dd None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:31.883748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b6447dc9-2b58-4bd3-b016-aa63215b93dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:32.007693 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6447dc9-2b58-4bd3-b016-aa63215b93dd None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:32.084095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:32.085949 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026db65-e88b-491c-bee2-22568cfff195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:32.086631 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026db65-e88b-491c-bee2-22568cfff195 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:32.086920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026db65-e88b-491c-bee2-22568cfff195 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:32.087195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026db65-e88b-491c-bee2-22568cfff195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:32.089598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e026db65-e88b-491c-bee2-22568cfff195 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:32.206200 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026db65-e88b-491c-bee2-22568cfff195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:32.207729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026db65-e88b-491c-bee2-22568cfff195 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:32.227042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 733/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:34.515792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cea0c-4372-46fa-a645-5eb08e31219c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:34.516706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cea0c-4372-46fa-a645-5eb08e31219c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:34.516706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cea0c-4372-46fa-a645-5eb08e31219c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:34.518396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 755/1488] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:34.523733 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa3b62-c0ce-4fd4-baad-6904e92471cb None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:34.524188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa3b62-c0ce-4fd4-baad-6904e92471cb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:34.524294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa3b62-c0ce-4fd4-baad-6904e92471cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:34.593099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f8fa3b62-c0ce-4fd4-baad-6904e92471cb None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:34.594396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f8fa3b62-c0ce-4fd4-baad-6904e92471cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:34.656122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:34.700875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 734/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:34.746848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cea0c-4372-46fa-a645-5eb08e31219c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:34.748770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1c5cea0c-4372-46fa-a645-5eb08e31219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:34.789465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:34.865778 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cea0c-4372-46fa-a645-5eb08e31219c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:34.949890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6a774-6d6b-409d-baaf-e9ec309f2bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:34.950993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6a774-6d6b-409d-baaf-e9ec309f2bdd service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:34.951471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6a774-6d6b-409d-baaf-e9ec309f2bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:34.951775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6a774-6d6b-409d-baaf-e9ec309f2bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:34.953502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-bdd6a774-6d6b-409d-baaf-e9ec309f2bdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:35.042904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:35.077386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6a774-6d6b-409d-baaf-e9ec309f2bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:35.079311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6a774-6d6b-409d-baaf-e9ec309f2bdd service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:35.100763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 756/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:37.758418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf97500-af6d-4926-8af7-d1a2af1746b2 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:37.758989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf97500-af6d-4926-8af7-d1a2af1746b2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:37.758989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf97500-af6d-4926-8af7-d1a2af1746b2 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:37.760465 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 735/1491] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 18 10:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:37.766137 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce9d9-8a92-401d-b49c-c1540a756f71 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:37.766653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce9d9-8a92-401d-b49c-c1540a756f71 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:37.766832 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce9d9-8a92-401d-b49c-c1540a756f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:37.834713 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-074ce9d9-8a92-401d-b49c-c1540a756f71 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:37.835943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-074ce9d9-8a92-401d-b49c-c1540a756f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:37.937890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 757/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:37.986964 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf97500-af6d-4926-8af7-d1a2af1746b2 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:37.988724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8cf97500-af6d-4926-8af7-d1a2af1746b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:38.102704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf97500-af6d-4926-8af7-d1a2af1746b2 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:38.185992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fc744-b434-4f4b-91a7-8d709981d0c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:38.186678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fc744-b434-4f4b-91a7-8d709981d0c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:38.186960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fc744-b434-4f4b-91a7-8d709981d0c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:38.187234 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fc744-b434-4f4b-91a7-8d709981d0c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:38.188938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cf3fc744-b434-4f4b-91a7-8d709981d0c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:38.199780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:38.302958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fc744-b434-4f4b-91a7-8d709981d0c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:38.304374 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fc744-b434-4f4b-91a7-8d709981d0c3 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:38.323374 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 736/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:47.935964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=82 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:48.320565 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=50 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:21.086980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc700a7-d4ab-4f5d-88e8-5a5568ae6ddd None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:21.087585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc700a7-d4ab-4f5d-88e8-5a5568ae6ddd None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:21.087585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc700a7-d4ab-4f5d-88e8-5a5568ae6ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:21.168571 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-dfc700a7-d4ab-4f5d-88e8-5a5568ae6ddd None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:36:21.182282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dfc700a7-d4ab-4f5d-88e8-5a5568ae6ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:21.272318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 758/1494] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:36:21.281473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce86ed5-1377-4a03-ad8b-68efc09630ba None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:21.281877 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce86ed5-1377-4a03-ad8b-68efc09630ba None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:21.282084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce86ed5-1377-4a03-ad8b-68efc09630ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:21.362401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0ce86ed5-1377-4a03-ad8b-68efc09630ba None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:36:21.363614 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0ce86ed5-1377-4a03-ad8b-68efc09630ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:21.461314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 737/1495] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:36:21.465957 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc700a7-d4ab-4f5d-88e8-5a5568ae6ddd None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:21.467191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dfc700a7-d4ab-4f5d-88e8-5a5568ae6ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:21.479634 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc700a7-d4ab-4f5d-88e8-5a5568ae6ddd None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:21.544507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:21.577723 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c54b1c-3d3c-44b1-8342-a738889435a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:21.578399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c54b1c-3d3c-44b1-8342-a738889435a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:21.578682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c54b1c-3d3c-44b1-8342-a738889435a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:21.578954 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c54b1c-3d3c-44b1-8342-a738889435a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:21.579669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c54b1c-3d3c-44b1-8342-a738889435a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:36:21.579970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c54b1c-3d3c-44b1-8342-a738889435a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:21.580983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: WARNING py.warnings [None req-c7c54b1c-3d3c-44b1-8342-a738889435a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:36:21.580983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: warnings.warn(msg) Jul 18 10:36:21.580983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: Jul 18 10:36:21.581869 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c54b1c-3d3c-44b1-8342-a738889435a2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:21.595526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 759/1496] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:36:21.604551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce86ed5-1377-4a03-ad8b-68efc09630ba None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:21.613830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce86ed5-1377-4a03-ad8b-68efc09630ba None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:21.676716 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:21.717016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5dcad-9285-46b6-889b-46a9b95a5753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:21.717679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5dcad-9285-46b6-889b-46a9b95a5753 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:21.717956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5dcad-9285-46b6-889b-46a9b95a5753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:21.718225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5dcad-9285-46b6-889b-46a9b95a5753 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:21.718949 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5dcad-9285-46b6-889b-46a9b95a5753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:21.720726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: WARNING py.warnings [None req-9dc5dcad-9285-46b6-889b-46a9b95a5753 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:36:21.720726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: warnings.warn(msg) Jul 18 10:36:21.720726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: Jul 18 10:36:21.721928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5dcad-9285-46b6-889b-46a9b95a5753 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:21.857058 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 738/1497] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:36:21 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:36:21.861159 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c54b1c-3d3c-44b1-8342-a738889435a2 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:21.862741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c7c54b1c-3d3c-44b1-8342-a738889435a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:21.901999 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c54b1c-3d3c-44b1-8342-a738889435a2 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:22.000349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45778bd6-30b1-4b57-9560-35bac522057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:22.001026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45778bd6-30b1-4b57-9560-35bac522057e admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:22.001304 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45778bd6-30b1-4b57-9560-35bac522057e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:22.001575 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45778bd6-30b1-4b57-9560-35bac522057e admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:22.002272 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45778bd6-30b1-4b57-9560-35bac522057e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:22.003358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: WARNING py.warnings [None req-45778bd6-30b1-4b57-9560-35bac522057e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:36:22.003358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: warnings.warn(msg) Jul 18 10:36:22.003358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: Jul 18 10:36:22.004582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45778bd6-30b1-4b57-9560-35bac522057e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:22.111375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 760/1498] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:36:21 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:36:22.115843 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5dcad-9285-46b6-889b-46a9b95a5753 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:22.117628 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9dc5dcad-9285-46b6-889b-46a9b95a5753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:22.183647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5dcad-9285-46b6-889b-46a9b95a5753 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:22.271010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:22.281479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adc126-005d-44de-a40b-f93f3ec99fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:22.282154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adc126-005d-44de-a40b-f93f3ec99fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:22.282474 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adc126-005d-44de-a40b-f93f3ec99fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:22.282752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adc126-005d-44de-a40b-f93f3ec99fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:22.283477 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adc126-005d-44de-a40b-f93f3ec99fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:22.284496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: WARNING py.warnings [None req-25adc126-005d-44de-a40b-f93f3ec99fcc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:36:22.284496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: warnings.warn(msg) Jul 18 10:36:22.284496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: Jul 18 10:36:22.285387 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adc126-005d-44de-a40b-f93f3ec99fcc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:22.299381 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 739/1499] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:36:22.303574 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45778bd6-30b1-4b57-9560-35bac522057e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:22.305785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-45778bd6-30b1-4b57-9560-35bac522057e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:22.317673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45778bd6-30b1-4b57-9560-35bac522057e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:22.343850 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:22.416331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5870449-9faf-4e07-bb0d-9d4cbd7c07b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:22.416929 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5870449-9faf-4e07-bb0d-9d4cbd7c07b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:22.417211 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5870449-9faf-4e07-bb0d-9d4cbd7c07b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:22.417489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5870449-9faf-4e07-bb0d-9d4cbd7c07b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:22.418234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5870449-9faf-4e07-bb0d-9d4cbd7c07b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:22.419320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: WARNING py.warnings [None req-c5870449-9faf-4e07-bb0d-9d4cbd7c07b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:36:22.419320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: warnings.warn(msg) Jul 18 10:36:22.419320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: Jul 18 10:36:22.420241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5870449-9faf-4e07-bb0d-9d4cbd7c07b7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:22.435531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 761/1500] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:36:22.439830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adc126-005d-44de-a40b-f93f3ec99fcc admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:22.441427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-25adc126-005d-44de-a40b-f93f3ec99fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:22.479225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adc126-005d-44de-a40b-f93f3ec99fcc admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:22.577701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca9ceb-7d22-42dc-9c34-a8bf341cf2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:22.578663 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca9ceb-7d22-42dc-9c34-a8bf341cf2e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:22.578984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca9ceb-7d22-42dc-9c34-a8bf341cf2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:22.579265 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca9ceb-7d22-42dc-9c34-a8bf341cf2e2 admin admin] PATH_INFO: `/v3/projects/713e42818711450697e88bd03dcd3f2e/users/5bbacacc88fc4f12bbe777b92d32b5b4/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:22.602215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca9ceb-7d22-42dc-9c34-a8bf341cf2e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=713e42818711450697e88bd03dcd3f2e, user_id=5bbacacc88fc4f12bbe777b92d32b5b4, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:22.603292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: WARNING py.warnings [None req-47ca9ceb-7d22-42dc-9c34-a8bf341cf2e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:36:22.603292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: warnings.warn(msg) Jul 18 10:36:22.603292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: Jul 18 10:36:22.605291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca9ceb-7d22-42dc-9c34-a8bf341cf2e2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:22.716614 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 740/1501] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:36:22 2022] PUT /identity/v3/projects/713e42818711450697e88bd03dcd3f2e/users/5bbacacc88fc4f12bbe777b92d32b5b4/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:36:22.729927 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96777a-2e69-41a4-bf04-201a6f8b7e86 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:22.730218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96777a-2e69-41a4-bf04-201a6f8b7e86 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:22.730543 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96777a-2e69-41a4-bf04-201a6f8b7e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:22.787614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-af96777a-2e69-41a4-bf04-201a6f8b7e86 None None] MFA Rules not processed for user `5bbacacc88fc4f12bbe777b92d32b5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:36:22.788834 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-af96777a-2e69-41a4-bf04-201a6f8b7e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:22.871198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 762/1502] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:36:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:36:22.884913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f0c48-4834-49ea-b166-fdb8b809caac None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:22.885205 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f0c48-4834-49ea-b166-fdb8b809caac None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:22.885491 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f0c48-4834-49ea-b166-fdb8b809caac None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:22.886928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 741/1503] 10.222.0.16 () {54 vars in 964 bytes} [Mon Jul 18 10:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:36:22.891914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1592de9-9d78-45d5-916f-d7830de4f4e9 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:22.892200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1592de9-9d78-45d5-916f-d7830de4f4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:22.892478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1592de9-9d78-45d5-916f-d7830de4f4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:22.922923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:22.968439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f1592de9-9d78-45d5-916f-d7830de4f4e9 None None] MFA Rules not processed for user `08f27c6bc2744b9f92141a9c6906bc3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:36:22.969579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f1592de9-9d78-45d5-916f-d7830de4f4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:23.047754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 763/1504] 10.222.0.16 () {58 vars in 1061 bytes} [Mon Jul 18 10:36:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:36:23.056063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f0c48-4834-49ea-b166-fdb8b809caac None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:23.057691 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-319f0c48-4834-49ea-b166-fdb8b809caac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:23.112555 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:23.174120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f0c48-4834-49ea-b166-fdb8b809caac None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:23.249916 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aade21-62e2-4ed0-93a9-393a64b8a264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:23.250601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aade21-62e2-4ed0-93a9-393a64b8a264 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:23.250887 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aade21-62e2-4ed0-93a9-393a64b8a264 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:23.251165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aade21-62e2-4ed0-93a9-393a64b8a264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:23.252896 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-96aade21-62e2-4ed0-93a9-393a64b8a264 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:23.358508 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aade21-62e2-4ed0-93a9-393a64b8a264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:23.359950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aade21-62e2-4ed0-93a9-393a64b8a264 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:23.363486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:23.378311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 742/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:36:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:36:23.422208 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61613cba-baca-45b3-a25d-cc2917356574 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:23.422734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61613cba-baca-45b3-a25d-cc2917356574 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:23.422846 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61613cba-baca-45b3-a25d-cc2917356574 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:23.424070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 764/1506] 10.222.0.16 () {52 vars in 829 bytes} [Mon Jul 18 10:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:36:23.427699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aade21-62e2-4ed0-93a9-393a64b8a264 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:23.428977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-96aade21-62e2-4ed0-93a9-393a64b8a264 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:23.533208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aade21-62e2-4ed0-93a9-393a64b8a264 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:23.641326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f3b78-24be-4c8b-8a72-3dc7377ea8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:23.642217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f3b78-24be-4c8b-8a72-3dc7377ea8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:23.642529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f3b78-24be-4c8b-8a72-3dc7377ea8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:23.642802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f3b78-24be-4c8b-8a72-3dc7377ea8df admin admin] PATH_INFO: `/v3/users/5bbacacc88fc4f12bbe777b92d32b5b4` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:23.658182 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f3b78-24be-4c8b-8a72-3dc7377ea8df admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bbacacc88fc4f12bbe777b92d32b5b4)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:23.659285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: WARNING py.warnings [None req-4a7f3b78-24be-4c8b-8a72-3dc7377ea8df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:36:23.659285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: warnings.warn(msg) Jul 18 10:36:23.659285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: Jul 18 10:36:23.660525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f3b78-24be-4c8b-8a72-3dc7377ea8df admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:23.672854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:23.925114 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4a7f3b78-24be-4c8b-8a72-3dc7377ea8df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bbacacc88fc4f12bbe777b92d32b5b4'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:36:24.006748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4a7f3b78-24be-4c8b-8a72-3dc7377ea8df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bbacacc88fc4f12bbe777b92d32b5b4'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:36:24.024086 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4a7f3b78-24be-4c8b-8a72-3dc7377ea8df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bbacacc88fc4f12bbe777b92d32b5b4'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:36:24.024592 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4a7f3b78-24be-4c8b-8a72-3dc7377ea8df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bbacacc88fc4f12bbe777b92d32b5b4'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:36:24.045160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4a7f3b78-24be-4c8b-8a72-3dc7377ea8df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bbacacc88fc4f12bbe777b92d32b5b4'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:36:24.053371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 743/1507] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:36:23 2022] DELETE /identity/v3/users/5bbacacc88fc4f12bbe777b92d32b5b4 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:36:24.061559 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d2d63-8eab-4408-82d5-4aa65a79c4c6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:24.061843 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d2d63-8eab-4408-82d5-4aa65a79c4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:24.062121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d2d63-8eab-4408-82d5-4aa65a79c4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:24.127186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b25d2d63-8eab-4408-82d5-4aa65a79c4c6 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:36:24.128531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b25d2d63-8eab-4408-82d5-4aa65a79c4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:24.220464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:24.235454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 765/1508] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:36:24.248531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f3b78-24be-4c8b-8a72-3dc7377ea8df admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:24.250412 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4a7f3b78-24be-4c8b-8a72-3dc7377ea8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:24.382626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f3b78-24be-4c8b-8a72-3dc7377ea8df admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:24.443937 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:24.467452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689b8d2-3b78-4c45-9ff8-b1b9375830f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:24.468513 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689b8d2-3b78-4c45-9ff8-b1b9375830f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:24.468988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689b8d2-3b78-4c45-9ff8-b1b9375830f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:24.469416 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689b8d2-3b78-4c45-9ff8-b1b9375830f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:24.471988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5689b8d2-3b78-4c45-9ff8-b1b9375830f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:24.626053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689b8d2-3b78-4c45-9ff8-b1b9375830f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:24.627545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689b8d2-3b78-4c45-9ff8-b1b9375830f0 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:24.650952 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 744/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:36:25.415865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d2d63-8eab-4408-82d5-4aa65a79c4c6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:25.417104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b25d2d63-8eab-4408-82d5-4aa65a79c4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:25.430826 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d2d63-8eab-4408-82d5-4aa65a79c4c6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:25.547525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97a583-872c-4aa9-a1cf-ec96984096c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:25.548771 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97a583-872c-4aa9-a1cf-ec96984096c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:25.548771 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97a583-872c-4aa9-a1cf-ec96984096c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:25.549034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97a583-872c-4aa9-a1cf-ec96984096c7 admin admin] PATH_INFO: `/v3/projects/713e42818711450697e88bd03dcd3f2e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:25.564546 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97a583-872c-4aa9-a1cf-ec96984096c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=713e42818711450697e88bd03dcd3f2e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:25.565653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: WARNING py.warnings [None req-ac97a583-872c-4aa9-a1cf-ec96984096c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:36:25.565653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: warnings.warn(msg) Jul 18 10:36:25.565653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: Jul 18 10:36:25.566894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97a583-872c-4aa9-a1cf-ec96984096c7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:25.703663 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac97a583-872c-4aa9-a1cf-ec96984096c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713e42818711450697e88bd03dcd3f2e', 'request_id': 'req-ac97a583-872c-4aa9-a1cf-ec96984096c7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:36:25.717210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac97a583-872c-4aa9-a1cf-ec96984096c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713e42818711450697e88bd03dcd3f2e', 'request_id': 'req-ac97a583-872c-4aa9-a1cf-ec96984096c7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:36:25.723391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac97a583-872c-4aa9-a1cf-ec96984096c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713e42818711450697e88bd03dcd3f2e', 'request_id': 'req-ac97a583-872c-4aa9-a1cf-ec96984096c7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:36:25.858974 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac97a583-872c-4aa9-a1cf-ec96984096c7 admin admin] The token cache is being invalidate because project 713e42818711450697e88bd03dcd3f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:36:25.859271 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac97a583-872c-4aa9-a1cf-ec96984096c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:36:25.859753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac97a583-872c-4aa9-a1cf-ec96984096c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:36:25.861308 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 766/1510] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:36:25 2022] DELETE /identity/v3/projects/713e42818711450697e88bd03dcd3f2e => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:36:34.647969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=62 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:35.856623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:21.692721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898e9d8-abb3-457e-9805-cea13e8b4a63 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:21.693335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898e9d8-abb3-457e-9805-cea13e8b4a63 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:21.693335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898e9d8-abb3-457e-9805-cea13e8b4a63 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:21.695190 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:38:21.701059 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f64c4-ed8d-43b5-ba29-1440a990a621 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:21.701653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f64c4-ed8d-43b5-ba29-1440a990a621 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:21.701653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f64c4-ed8d-43b5-ba29-1440a990a621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:21.793638 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-238f64c4-ed8d-43b5-ba29-1440a990a621 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:38:21.794898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-238f64c4-ed8d-43b5-ba29-1440a990a621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:38:21.938052 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:38:22.108923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898e9d8-abb3-457e-9805-cea13e8b4a63 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:38:22.111477 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1898e9d8-abb3-457e-9805-cea13e8b4a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:38:22.274744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898e9d8-abb3-457e-9805-cea13e8b4a63 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:38:22.280978 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72560187-c87a-4651-b0ce-90b4794ba05e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:38:22.281733 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560187-c87a-4651-b0ce-90b4794ba05e service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:22.282128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560187-c87a-4651-b0ce-90b4794ba05e service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:22.282554 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560187-c87a-4651-b0ce-90b4794ba05e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:22.300497 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72560187-c87a-4651-b0ce-90b4794ba05e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:38:22.303714 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72560187-c87a-4651-b0ce-90b4794ba05e service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:38:22.323939 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 746/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:38:23.265466 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb7d6-48ba-42f4-a471-1faedefc2c25 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:23.266112 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb7d6-48ba-42f4-a471-1faedefc2c25 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:23.266399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb7d6-48ba-42f4-a471-1faedefc2c25 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:23.267914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 768/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:38:23.274715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099040b9-59d6-49e6-a217-d4a57d25d95a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:23.275562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099040b9-59d6-49e6-a217-d4a57d25d95a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:23.275562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099040b9-59d6-49e6-a217-d4a57d25d95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:23.296000 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-099040b9-59d6-49e6-a217-d4a57d25d95a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:38:23.297371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-099040b9-59d6-49e6-a217-d4a57d25d95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:38:23.305955 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 747/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:38:23.472929 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bb7d6-48ba-42f4-a471-1faedefc2c25 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:38:23.489091 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bb7d6-48ba-42f4-a471-1faedefc2c25 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:38:23.495749 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba75705-eac9-4e3c-bc24-26c29b22fb6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:38:23.496426 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba75705-eac9-4e3c-bc24-26c29b22fb6d service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:23.496707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba75705-eac9-4e3c-bc24-26c29b22fb6d service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:23.497010 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba75705-eac9-4e3c-bc24-26c29b22fb6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:23.508105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba75705-eac9-4e3c-bc24-26c29b22fb6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:38:23.510008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba75705-eac9-4e3c-bc24-26c29b22fb6d service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:38:23.522071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 769/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:38:25.033049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe16b6-2a4d-4817-9f9d-6b6b6510a4e6 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:25.033868 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe16b6-2a4d-4817-9f9d-6b6b6510a4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:25.034033 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe16b6-2a4d-4817-9f9d-6b6b6510a4e6 None None] PATH_INFO: `/v3` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:25.035485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 748/1517] 10.222.0.17 () {54 vars in 925 bytes} [Mon Jul 18 10:38:25 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:38:25.043872 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b8900-ef8c-43c6-9493-db805d046606 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:25.044433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b8900-ef8c-43c6-9493-db805d046606 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:25.044433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b8900-ef8c-43c6-9493-db805d046606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:25.120312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-139b8900-ef8c-43c6-9493-db805d046606 None None] MFA Rules not processed for user `b8fd088faaba4d5c9745638c14f1a7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:38:25.121449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-139b8900-ef8c-43c6-9493-db805d046606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:38:25.139844 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:25.202391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 770/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Jul 18 10:38:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:38:29.592190 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d14fd-bf2a-4344-bb1c-18c23c315fef None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:29.592742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d14fd-bf2a-4344-bb1c-18c23c315fef None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:29.592742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d14fd-bf2a-4344-bb1c-18c23c315fef None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:29.594032 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 749/1519] 10.222.0.16 () {54 vars in 961 bytes} [Mon Jul 18 10:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:38:29.600346 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94199698-1a04-4476-8575-0293687c0779 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:29.601062 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94199698-1a04-4476-8575-0293687c0779 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:29.601062 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94199698-1a04-4476-8575-0293687c0779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:29.624141 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-94199698-1a04-4476-8575-0293687c0779 None None] MFA Rules not processed for user `b8fd088faaba4d5c9745638c14f1a7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:38:29.625655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-94199698-1a04-4476-8575-0293687c0779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:38:29.637561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 771/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Jul 18 10:38:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:38:29.645209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d14fd-bf2a-4344-bb1c-18c23c315fef None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:38:29.659728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d14fd-bf2a-4344-bb1c-18c23c315fef None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:38:29.666999 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa076f-836d-49a4-a38e-a793c1cdac16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fd088faaba4d5c9745638c14f1a7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:38:29.667769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa076f-836d-49a4-a38e-a793c1cdac16 service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:29.668054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa076f-836d-49a4-a38e-a793c1cdac16 service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:29.668325 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa076f-836d-49a4-a38e-a793c1cdac16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:29.679661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa076f-836d-49a4-a38e-a793c1cdac16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:38:29.681706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa076f-836d-49a4-a38e-a793c1cdac16 service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:38:29.693717 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 750/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:38:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:38:34.923970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068504ae-edf9-4b1e-9726-bd962e36001b None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:34.924629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068504ae-edf9-4b1e-9726-bd962e36001b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:34.924629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068504ae-edf9-4b1e-9726-bd962e36001b None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:34.926419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:38:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:38:34.932956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113404f-bfa9-45c0-9472-ee630225f161 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:34.933547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113404f-bfa9-45c0-9472-ee630225f161 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:34.933547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113404f-bfa9-45c0-9472-ee630225f161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:34.953272 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-7113404f-bfa9-45c0-9472-ee630225f161 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:38:34.954647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7113404f-bfa9-45c0-9472-ee630225f161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:38:34.963060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:38:35.121140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068504ae-edf9-4b1e-9726-bd962e36001b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:38:35.141400 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068504ae-edf9-4b1e-9726-bd962e36001b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:38:35.147675 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4019cc-6bd4-4fc3-8398-b477fc8b84da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:38:35.148556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4019cc-6bd4-4fc3-8398-b477fc8b84da service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:35.149126 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4019cc-6bd4-4fc3-8398-b477fc8b84da service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:35.149558 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4019cc-6bd4-4fc3-8398-b477fc8b84da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:35.158998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4019cc-6bd4-4fc3-8398-b477fc8b84da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:38:35.161201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4019cc-6bd4-4fc3-8398-b477fc8b84da service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:38:35.172541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 773/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:38:36.042504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70997518-4edb-44bf-81dc-eb24b48174d0 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:36.043315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70997518-4edb-44bf-81dc-eb24b48174d0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:36.043315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70997518-4edb-44bf-81dc-eb24b48174d0 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:36.044522 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:38:36.049936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38d534-e5f6-413b-980b-76b65fdc3f8a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:36.050813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38d534-e5f6-413b-980b-76b65fdc3f8a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:36.050813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38d534-e5f6-413b-980b-76b65fdc3f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:36.070272 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-fc38d534-e5f6-413b-980b-76b65fdc3f8a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:38:36.071526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fc38d534-e5f6-413b-980b-76b65fdc3f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:38:36.079760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:38:36.239126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70997518-4edb-44bf-81dc-eb24b48174d0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:38:36.264084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70997518-4edb-44bf-81dc-eb24b48174d0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:38:36.273952 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd6198-46de-40fe-8b18-e8c784a29057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:38:36.275112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd6198-46de-40fe-8b18-e8c784a29057 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:36.275643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd6198-46de-40fe-8b18-e8c784a29057 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:36.276164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd6198-46de-40fe-8b18-e8c784a29057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:36.293072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd6198-46de-40fe-8b18-e8c784a29057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:38:36.295959 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd6198-46de-40fe-8b18-e8c784a29057 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:38:36.312519 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 753/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:38:40.536219 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a3c8c-980d-40e9-a4e3-28464d62b339 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:40.536824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a3c8c-980d-40e9-a4e3-28464d62b339 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:40.536824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a3c8c-980d-40e9-a4e3-28464d62b339 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:40.538972 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:38:40.545654 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692b0f1-9406-4c19-8b9e-a42153e24d22 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:40.553005 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692b0f1-9406-4c19-8b9e-a42153e24d22 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:40.553005 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692b0f1-9406-4c19-8b9e-a42153e24d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:40.566690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1692b0f1-9406-4c19-8b9e-a42153e24d22 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:38:40.567951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1692b0f1-9406-4c19-8b9e-a42153e24d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:38:40.576904 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:38:40.626248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a3c8c-980d-40e9-a4e3-28464d62b339 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:38:40.628287 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5e0a3c8c-980d-40e9-a4e3-28464d62b339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:38:40.740966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a3c8c-980d-40e9-a4e3-28464d62b339 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:38:40.745725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06767107-34bf-40fc-9e8a-242c18816f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:38:40.745923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06767107-34bf-40fc-9e8a-242c18816f69 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:40.746158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06767107-34bf-40fc-9e8a-242c18816f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:40.746503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06767107-34bf-40fc-9e8a-242c18816f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:40.757812 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06767107-34bf-40fc-9e8a-242c18816f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:38:40.759346 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06767107-34bf-40fc-9e8a-242c18816f69 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:38:40.769851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 776/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:38:43.015928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fc2d9-2aa9-4a37-85b7-ccf96431b711 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:43.016543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fc2d9-2aa9-4a37-85b7-ccf96431b711 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:43.016543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fc2d9-2aa9-4a37-85b7-ccf96431b711 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:43.018318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:38:43.026535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d4a2f-0e1d-4f48-b35a-43210b7eb754 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:43.027157 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d4a2f-0e1d-4f48-b35a-43210b7eb754 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:43.027586 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d4a2f-0e1d-4f48-b35a-43210b7eb754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:43.054208 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e66d4a2f-0e1d-4f48-b35a-43210b7eb754 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:38:43.055685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e66d4a2f-0e1d-4f48-b35a-43210b7eb754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:38:43.064027 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:38:43.104187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fc2d9-2aa9-4a37-85b7-ccf96431b711 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:38:43.121651 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fc2d9-2aa9-4a37-85b7-ccf96431b711 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:38:43.126411 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4e52e-2c03-4a40-bd93-bd0c50520aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:38:43.127281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4e52e-2c03-4a40-bd93-bd0c50520aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:43.127588 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4e52e-2c03-4a40-bd93-bd0c50520aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:43.127872 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4e52e-2c03-4a40-bd93-bd0c50520aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:43.144135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4e52e-2c03-4a40-bd93-bd0c50520aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:38:43.147335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4e52e-2c03-4a40-bd93-bd0c50520aa3 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:38:43.167087 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 756/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:38:47.084698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0668f81-cc38-4ff6-8652-4c63cbceddda None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:47.085275 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0668f81-cc38-4ff6-8652-4c63cbceddda None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:47.085275 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0668f81-cc38-4ff6-8652-4c63cbceddda None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:47.086805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:38:47.092944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca954f-70a7-46cc-85c1-50c6ee354c7e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:47.093482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca954f-70a7-46cc-85c1-50c6ee354c7e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:47.093482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca954f-70a7-46cc-85c1-50c6ee354c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:47.100206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=81 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:47.113773 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-64ca954f-70a7-46cc-85c1-50c6ee354c7e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:38:47.115136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-64ca954f-70a7-46cc-85c1-50c6ee354c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:38:47.124251 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:38:47.453674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0668f81-cc38-4ff6-8652-4c63cbceddda None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:38:47.455409 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b0668f81-cc38-4ff6-8652-4c63cbceddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:38:47.530421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:47.545078 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0668f81-cc38-4ff6-8652-4c63cbceddda None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:38:47.548896 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21714bd9-187a-4c6f-8f00-9c004cf1b06b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:38:47.549546 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21714bd9-187a-4c6f-8f00-9c004cf1b06b service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:47.549826 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21714bd9-187a-4c6f-8f00-9c004cf1b06b service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:47.550098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21714bd9-187a-4c6f-8f00-9c004cf1b06b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:47.560015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21714bd9-187a-4c6f-8f00-9c004cf1b06b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:38:47.561559 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21714bd9-187a-4c6f-8f00-9c004cf1b06b service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:38:47.572401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 779/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:38:49.680830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df86e9d-0f25-425c-a46e-0a219ebd7d7a None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:49.681439 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df86e9d-0f25-425c-a46e-0a219ebd7d7a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:49.681585 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df86e9d-0f25-425c-a46e-0a219ebd7d7a None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:49.683298 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:38:49.689922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5e5ca-8422-4dbe-850a-7974135b9252 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:49.690707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5e5ca-8422-4dbe-850a-7974135b9252 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:49.690908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5e5ca-8422-4dbe-850a-7974135b9252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:49.719292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-eae5e5ca-8422-4dbe-850a-7974135b9252 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:38:49.721437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-eae5e5ca-8422-4dbe-850a-7974135b9252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:38:49.735744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:38:50.054161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df86e9d-0f25-425c-a46e-0a219ebd7d7a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:38:50.055884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0df86e9d-0f25-425c-a46e-0a219ebd7d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:38:50.070489 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df86e9d-0f25-425c-a46e-0a219ebd7d7a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:38:50.075065 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee8087-650f-4265-b666-fc18c85b62c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:38:50.075065 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee8087-650f-4265-b666-fc18c85b62c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:38:50.075323 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee8087-650f-4265-b666-fc18c85b62c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:38:50.075498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee8087-650f-4265-b666-fc18c85b62c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:38:50.086383 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee8087-650f-4265-b666-fc18c85b62c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:38:50.087853 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee8087-650f-4265-b666-fc18c85b62c8 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:38:50.098625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 759/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:38:59.711194 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=11 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:39:00.093832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=8 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:26.753142 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cd981-9ad1-4572-9293-ddc8f43af458 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:26.756461 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cd981-9ad1-4572-9293-ddc8f43af458 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:26.756461 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cd981-9ad1-4572-9293-ddc8f43af458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:26.800811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7f1cd981-9ad1-4572-9293-ddc8f43af458 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:26.804149 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7f1cd981-9ad1-4572-9293-ddc8f43af458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:26.824622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 781/1540] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:26.835724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf378795-5944-4282-94e9-2c0a0615047f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:26.836802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf378795-5944-4282-94e9-2c0a0615047f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:26.837304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf378795-5944-4282-94e9-2c0a0615047f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:26.867909 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-cf378795-5944-4282-94e9-2c0a0615047f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:26.869610 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cf378795-5944-4282-94e9-2c0a0615047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:26.882070 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 760/1541] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:40:26.887383 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cd981-9ad1-4572-9293-ddc8f43af458 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:26.902544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cd981-9ad1-4572-9293-ddc8f43af458 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:26.912731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdb9e7-351b-4423-bde9-c2afacc6b5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:26.913423 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdb9e7-351b-4423-bde9-c2afacc6b5fd admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:26.913716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdb9e7-351b-4423-bde9-c2afacc6b5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:26.913995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdb9e7-351b-4423-bde9-c2afacc6b5fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:26.914788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdb9e7-351b-4423-bde9-c2afacc6b5fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:40:26.915097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdb9e7-351b-4423-bde9-c2afacc6b5fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:26.917216 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdb9e7-351b-4423-bde9-c2afacc6b5fd admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:26.936281 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 782/1542] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:40:26.945002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf378795-5944-4282-94e9-2c0a0615047f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:26.961736 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf378795-5944-4282-94e9-2c0a0615047f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:26.976594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09281e-2643-4d7e-878b-1b4b30e9977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:26.977285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09281e-2643-4d7e-878b-1b4b30e9977a admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:26.977579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09281e-2643-4d7e-878b-1b4b30e9977a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:26.977837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09281e-2643-4d7e-878b-1b4b30e9977a admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:26.978587 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09281e-2643-4d7e-878b-1b4b30e9977a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:26.980577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09281e-2643-4d7e-878b-1b4b30e9977a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:27.154530 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ced5c-d916-4d1c-a7f7-225424b32233 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.154803 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ced5c-d916-4d1c-a7f7-225424b32233 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.155152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ced5c-d916-4d1c-a7f7-225424b32233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.156201 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 761/1543] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:26 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:27.160476 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09281e-2643-4d7e-878b-1b4b30e9977a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:27.191783 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-409ced5c-d916-4d1c-a7f7-225424b32233 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:27.193671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-409ced5c-d916-4d1c-a7f7-225424b32233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:27.263210 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09281e-2643-4d7e-878b-1b4b30e9977a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:27.280447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb369023-7f73-46d3-a2cb-7d0ff1181055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:27.281153 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb369023-7f73-46d3-a2cb-7d0ff1181055 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.281434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb369023-7f73-46d3-a2cb-7d0ff1181055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.281710 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb369023-7f73-46d3-a2cb-7d0ff1181055 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.282457 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb369023-7f73-46d3-a2cb-7d0ff1181055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:27.283538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: WARNING py.warnings [None req-bb369023-7f73-46d3-a2cb-7d0ff1181055 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:40:27.283538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: warnings.warn(msg) Jul 18 10:40:27.283538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: Jul 18 10:40:27.284804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb369023-7f73-46d3-a2cb-7d0ff1181055 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:27.394013 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 783/1544] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:40:27.406724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680ee75-fca3-4038-a541-ac559cb8a122 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.406724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680ee75-fca3-4038-a541-ac559cb8a122 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.406724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680ee75-fca3-4038-a541-ac559cb8a122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.410808 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 762/1545] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:27 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:40:27.421393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb369023-7f73-46d3-a2cb-7d0ff1181055 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:27.446481 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb369023-7f73-46d3-a2cb-7d0ff1181055 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:27.456358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18035f-8127-4326-a177-a93be2816575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:27.457349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18035f-8127-4326-a177-a93be2816575 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.458564 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18035f-8127-4326-a177-a93be2816575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.459815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18035f-8127-4326-a177-a93be2816575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.461376 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18035f-8127-4326-a177-a93be2816575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:27.463672 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18035f-8127-4326-a177-a93be2816575 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:27.484874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3680ee75-fca3-4038-a541-ac559cb8a122 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:27.486557 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3680ee75-fca3-4038-a541-ac559cb8a122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:27.496122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 763/1546] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:27.498138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4584d0e-2f0e-432a-aa06-acbd1fab4a68 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.503601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4584d0e-2f0e-432a-aa06-acbd1fab4a68 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.503601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4584d0e-2f0e-432a-aa06-acbd1fab4a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.515793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 784/1547] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:27.517316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680ee75-fca3-4038-a541-ac559cb8a122 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:27.539421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c4584d0e-2f0e-432a-aa06-acbd1fab4a68 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:27.539819 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680ee75-fca3-4038-a541-ac559cb8a122 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:27.543581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c4584d0e-2f0e-432a-aa06-acbd1fab4a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:27.553686 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98a7bd-57dd-4749-8549-dc51c571d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:27.555420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98a7bd-57dd-4749-8549-dc51c571d931 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.555918 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98a7bd-57dd-4749-8549-dc51c571d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.556386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98a7bd-57dd-4749-8549-dc51c571d931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.557317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98a7bd-57dd-4749-8549-dc51c571d931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:27.565460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98a7bd-57dd-4749-8549-dc51c571d931 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:27.571352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 764/1548] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:27.573310 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4584d0e-2f0e-432a-aa06-acbd1fab4a68 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:27.589617 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4584d0e-2f0e-432a-aa06-acbd1fab4a68 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:27.590570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 785/1549] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:27.592434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae2d60-d775-4db4-bfb4-299ff34d6f96 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.592742 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae2d60-d775-4db4-bfb4-299ff34d6f96 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.593041 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae2d60-d775-4db4-bfb4-299ff34d6f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.600226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d38a47-cb76-49cd-b76b-9e61c70f08bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:27.600955 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d38a47-cb76-49cd-b76b-9e61c70f08bf admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.601240 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d38a47-cb76-49cd-b76b-9e61c70f08bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.601563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d38a47-cb76-49cd-b76b-9e61c70f08bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.602314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d38a47-cb76-49cd-b76b-9e61c70f08bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:40:27.602657 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d38a47-cb76-49cd-b76b-9e61c70f08bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:27.605356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: WARNING py.warnings [None req-19d38a47-cb76-49cd-b76b-9e61c70f08bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:40:27.605356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: warnings.warn(msg) Jul 18 10:40:27.605356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: Jul 18 10:40:27.607193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d38a47-cb76-49cd-b76b-9e61c70f08bf admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:27.620087 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-31ae2d60-d775-4db4-bfb4-299ff34d6f96 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:27.626295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 765/1550] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:40:27.626585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-31ae2d60-d775-4db4-bfb4-299ff34d6f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:27.626874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fa4d2-a39a-4c89-9d91-97af8c1f5a96 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.626874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fa4d2-a39a-4c89-9d91-97af8c1f5a96 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.626874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fa4d2-a39a-4c89-9d91-97af8c1f5a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.646045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 786/1551] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:27.651505 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d159629-bc8a-4070-a223-98880e110512 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.652292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d159629-bc8a-4070-a223-98880e110512 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.652570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d159629-bc8a-4070-a223-98880e110512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.652769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f16fa4d2-a39a-4c89-9d91-97af8c1f5a96 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:27.653947 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f16fa4d2-a39a-4c89-9d91-97af8c1f5a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:27.662804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 766/1552] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:27.664637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24788ad-f3ea-4ba9-af98-80dbcb7817d8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.664932 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24788ad-f3ea-4ba9-af98-80dbcb7817d8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.665209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24788ad-f3ea-4ba9-af98-80dbcb7817d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.676178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7d159629-bc8a-4070-a223-98880e110512 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:27.683243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7d159629-bc8a-4070-a223-98880e110512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:27.685729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e24788ad-f3ea-4ba9-af98-80dbcb7817d8 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:27.686988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e24788ad-f3ea-4ba9-af98-80dbcb7817d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:27.688394 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 787/1553] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:27.689666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533a992-0405-45c6-aefa-0c3fe751900c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.690014 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533a992-0405-45c6-aefa-0c3fe751900c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.690294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533a992-0405-45c6-aefa-0c3fe751900c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.702244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 767/1554] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:27.703124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24788ad-f3ea-4ba9-af98-80dbcb7817d8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:27.716654 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d533a992-0405-45c6-aefa-0c3fe751900c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:27.717902 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d533a992-0405-45c6-aefa-0c3fe751900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:27.720483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24788ad-f3ea-4ba9-af98-80dbcb7817d8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:27.726689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfdaaf-30c4-4403-8fb0-7ebe8416881c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:27.727641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfdaaf-30c4-4403-8fb0-7ebe8416881c admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.728120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 788/1555] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:27.728281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfdaaf-30c4-4403-8fb0-7ebe8416881c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.728380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfdaaf-30c4-4403-8fb0-7ebe8416881c admin admin] PATH_INFO: `/v3/projects/26c9373ec83b4d298a93cba26351179f/users/97cdb445eecb4ef0bd5921e31d1019e1/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.731660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533a992-0405-45c6-aefa-0c3fe751900c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:27.744286 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533a992-0405-45c6-aefa-0c3fe751900c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:27.746688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfdaaf-30c4-4403-8fb0-7ebe8416881c admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c9373ec83b4d298a93cba26351179f, user_id=97cdb445eecb4ef0bd5921e31d1019e1, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:27.749734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfdaaf-30c4-4403-8fb0-7ebe8416881c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:27.751671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec69af-daec-4fc5-95fe-79f734268a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:27.752369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec69af-daec-4fc5-95fe-79f734268a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.752653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec69af-daec-4fc5-95fe-79f734268a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.752928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec69af-daec-4fc5-95fe-79f734268a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.753632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec69af-daec-4fc5-95fe-79f734268a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:27.754766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: WARNING py.warnings [None req-15ec69af-daec-4fc5-95fe-79f734268a7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:40:27.754766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: warnings.warn(msg) Jul 18 10:40:27.754766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: Jul 18 10:40:27.755965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec69af-daec-4fc5-95fe-79f734268a7e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:27.922612 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 768/1556] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:27 2022] PUT /identity/v3/projects/26c9373ec83b4d298a93cba26351179f/users/97cdb445eecb4ef0bd5921e31d1019e1/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:27.923891 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf535e9-2f69-4776-89ce-6efcfbbb04e0 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.924272 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf535e9-2f69-4776-89ce-6efcfbbb04e0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.924585 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf535e9-2f69-4776-89ce-6efcfbbb04e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.945238 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2cf535e9-2f69-4776-89ce-6efcfbbb04e0 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:27.946525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2cf535e9-2f69-4776-89ce-6efcfbbb04e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:27.974432 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 789/1557] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:27 2022] POST /identity/v3/projects => generated 365 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:27.974432 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d29fe2-ccb0-481a-9d50-a0d64d71ecf8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:27.978490 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d29fe2-ccb0-481a-9d50-a0d64d71ecf8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:27.978490 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d29fe2-ccb0-481a-9d50-a0d64d71ecf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:27.995734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e2d29fe2-ccb0-481a-9d50-a0d64d71ecf8 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:27.996965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e2d29fe2-ccb0-481a-9d50-a0d64d71ecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:28.003049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:28.028715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 769/1558] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:28.030449 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1db90-3136-454e-9348-033a530e5d2f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.031430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1db90-3136-454e-9348-033a530e5d2f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.031430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1db90-3136-454e-9348-033a530e5d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.052546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-5de1db90-3136-454e-9348-033a530e5d2f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:28.053805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5de1db90-3136-454e-9348-033a530e5d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:28.077225 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 790/1559] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:28.078582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc4aba-e30e-4bed-88a8-5c162281e90c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.078872 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc4aba-e30e-4bed-88a8-5c162281e90c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.079342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc4aba-e30e-4bed-88a8-5c162281e90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.099522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f1cc4aba-e30e-4bed-88a8-5c162281e90c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:28.101986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f1cc4aba-e30e-4bed-88a8-5c162281e90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:28.108645 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 791/1560] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:28.109908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638cd41-0825-4968-9f26-c81ca1e73dcb None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.110202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638cd41-0825-4968-9f26-c81ca1e73dcb None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.110507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638cd41-0825-4968-9f26-c81ca1e73dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.132023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7638cd41-0825-4968-9f26-c81ca1e73dcb None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:28.133292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7638cd41-0825-4968-9f26-c81ca1e73dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:28.135870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 770/1561] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:28.136845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1db90-3136-454e-9348-033a530e5d2f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:28.144783 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 792/1562] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:28.146632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c42e7-e28b-411e-bbf7-2daf71ce991d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.147057 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c42e7-e28b-411e-bbf7-2daf71ce991d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.147339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c42e7-e28b-411e-bbf7-2daf71ce991d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.147768 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1db90-3136-454e-9348-033a530e5d2f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:28.153926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b351bc-f8ae-4929-915d-75759a0e389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:28.154638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b351bc-f8ae-4929-915d-75759a0e389c admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.154917 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b351bc-f8ae-4929-915d-75759a0e389c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.155194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b351bc-f8ae-4929-915d-75759a0e389c admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.155934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b351bc-f8ae-4929-915d-75759a0e389c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:40:28.156237 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b351bc-f8ae-4929-915d-75759a0e389c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:28.158045 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b351bc-f8ae-4929-915d-75759a0e389c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:28.169970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:28.175254 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 771/1563] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:40:28.176363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b351bc-f8ae-4929-915d-75759a0e389c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:28.183040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8b9c42e7-e28b-411e-bbf7-2daf71ce991d None None] MFA Rules not processed for user `97cdb445eecb4ef0bd5921e31d1019e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:28.188144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8b9c42e7-e28b-411e-bbf7-2daf71ce991d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:28.196525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b351bc-f8ae-4929-915d-75759a0e389c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:28.202528 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996302c1-08f8-4ff6-981b-79cbad8234d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:28.202822 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996302c1-08f8-4ff6-981b-79cbad8234d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.203631 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996302c1-08f8-4ff6-981b-79cbad8234d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.203631 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996302c1-08f8-4ff6-981b-79cbad8234d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.204665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996302c1-08f8-4ff6-981b-79cbad8234d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:28.208126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996302c1-08f8-4ff6-981b-79cbad8234d0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:28.270477 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 793/1564] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:28.272300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b3986-f1d6-4fff-91e9-3ec949b94924 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.272582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b3986-f1d6-4fff-91e9-3ec949b94924 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.272860 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b3986-f1d6-4fff-91e9-3ec949b94924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.293261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-638b3986-f1d6-4fff-91e9-3ec949b94924 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:28.294514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-638b3986-f1d6-4fff-91e9-3ec949b94924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:28.306580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 794/1565] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:28.307548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b3986-f1d6-4fff-91e9-3ec949b94924 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:28.324634 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b3986-f1d6-4fff-91e9-3ec949b94924 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:28.329748 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c51a2-f45e-4c61-b10f-b4f4430e8bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:28.330455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c51a2-f45e-4c61-b10f-b4f4430e8bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.330742 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c51a2-f45e-4c61-b10f-b4f4430e8bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.331014 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c51a2-f45e-4c61-b10f-b4f4430e8bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.331744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c51a2-f45e-4c61-b10f-b4f4430e8bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:40:28.332045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c51a2-f45e-4c61-b10f-b4f4430e8bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:28.334276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c51a2-f45e-4c61-b10f-b4f4430e8bc4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:28.347321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 795/1566] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:40:28.352114 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 772/1567] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:28 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:28.352114 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996302c1-08f8-4ff6-981b-79cbad8234d0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:28.356660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c51a2-f45e-4c61-b10f-b4f4430e8bc4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:28.369341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c51a2-f45e-4c61-b10f-b4f4430e8bc4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:28.373972 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996302c1-08f8-4ff6-981b-79cbad8234d0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:28.378005 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72660a-e534-4c7d-a20f-8e1a37508915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:28.379119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72660a-e534-4c7d-a20f-8e1a37508915 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.379632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72660a-e534-4c7d-a20f-8e1a37508915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.380611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72660a-e534-4c7d-a20f-8e1a37508915 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.381894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72660a-e534-4c7d-a20f-8e1a37508915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:40:28.382670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72660a-e534-4c7d-a20f-8e1a37508915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:28.383854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaadfc-9f91-41e8-ba6e-9bd23222c9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:28.384917 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaadfc-9f91-41e8-ba6e-9bd23222c9af admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.385424 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaadfc-9f91-41e8-ba6e-9bd23222c9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.385670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72660a-e534-4c7d-a20f-8e1a37508915 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:28.385885 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaadfc-9f91-41e8-ba6e-9bd23222c9af admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.387182 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aaadfc-9f91-41e8-ba6e-9bd23222c9af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:40:28.387674 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aaadfc-9f91-41e8-ba6e-9bd23222c9af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:28.390476 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aaadfc-9f91-41e8-ba6e-9bd23222c9af admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:28.408253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 796/1568] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:40:28.409474 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72660a-e534-4c7d-a20f-8e1a37508915 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:28.423507 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 773/1569] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:40:28.423799 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72660a-e534-4c7d-a20f-8e1a37508915 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:28.425563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaadfc-9f91-41e8-ba6e-9bd23222c9af admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:28.432071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47ec25-cc5b-4950-9038-2cac9dc8b0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:28.433264 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47ec25-cc5b-4950-9038-2cac9dc8b0de admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.433723 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47ec25-cc5b-4950-9038-2cac9dc8b0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.434166 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47ec25-cc5b-4950-9038-2cac9dc8b0de admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.435530 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47ec25-cc5b-4950-9038-2cac9dc8b0de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:40:28.436030 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47ec25-cc5b-4950-9038-2cac9dc8b0de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:28.438590 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47ec25-cc5b-4950-9038-2cac9dc8b0de admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:28.443838 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaadfc-9f91-41e8-ba6e-9bd23222c9af admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:28.451204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa2bd7-003d-4d54-97a3-aaef9c5a10e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:28.452097 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa2bd7-003d-4d54-97a3-aaef9c5a10e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.452537 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa2bd7-003d-4d54-97a3-aaef9c5a10e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.452999 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa2bd7-003d-4d54-97a3-aaef9c5a10e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.454434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa2bd7-003d-4d54-97a3-aaef9c5a10e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:28.457534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa2bd7-003d-4d54-97a3-aaef9c5a10e9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:28.461518 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 797/1570] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:40:28.463782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def50d78-7a3d-4b44-8749-1c95f853a5f7 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.464083 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def50d78-7a3d-4b44-8749-1c95f853a5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.464411 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def50d78-7a3d-4b44-8749-1c95f853a5f7 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.466013 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 798/1571] 10.222.0.16 () {54 vars in 962 bytes} [Mon Jul 18 10:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:40:28.466606 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def50d78-7a3d-4b44-8749-1c95f853a5f7 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:28.485513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def50d78-7a3d-4b44-8749-1c95f853a5f7 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:28.491213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97855b-ee37-4e13-8351-66b11ef26cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:28.491908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97855b-ee37-4e13-8351-66b11ef26cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.492186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97855b-ee37-4e13-8351-66b11ef26cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.492461 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97855b-ee37-4e13-8351-66b11ef26cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.493199 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97855b-ee37-4e13-8351-66b11ef26cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:40:28.493516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97855b-ee37-4e13-8351-66b11ef26cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:28.495182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97855b-ee37-4e13-8351-66b11ef26cc7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:28.519532 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 799/1572] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:40:28.519532 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97855b-ee37-4e13-8351-66b11ef26cc7 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:28.524409 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97855b-ee37-4e13-8351-66b11ef26cc7 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:28.529513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bcc70-a7f4-4cd8-93c0-b4d07ae44455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:28.530184 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bcc70-a7f4-4cd8-93c0-b4d07ae44455 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.530507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bcc70-a7f4-4cd8-93c0-b4d07ae44455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.530857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bcc70-a7f4-4cd8-93c0-b4d07ae44455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.531564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bcc70-a7f4-4cd8-93c0-b4d07ae44455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:28.533696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bcc70-a7f4-4cd8-93c0-b4d07ae44455 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:28.621830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 774/1573] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:28 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:28.623285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa2bd7-003d-4d54-97a3-aaef9c5a10e9 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:28.655882 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 800/1574] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:28 2022] POST /identity/v3/projects => generated 357 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:28.665151 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bcc70-a7f4-4cd8-93c0-b4d07ae44455 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:28.703793 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa2bd7-003d-4d54-97a3-aaef9c5a10e9 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:28.731923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:28.756053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bcc70-a7f4-4cd8-93c0-b4d07ae44455 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:28.762350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5713a92-0b93-4db9-b6e3-e2eb6f8751bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:28.763135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5713a92-0b93-4db9-b6e3-e2eb6f8751bd admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.763415 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5713a92-0b93-4db9-b6e3-e2eb6f8751bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.763687 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5713a92-0b93-4db9-b6e3-e2eb6f8751bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.764386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5713a92-0b93-4db9-b6e3-e2eb6f8751bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:28.766385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5713a92-0b93-4db9-b6e3-e2eb6f8751bd admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:28.780386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf661c82-ed24-4a3c-b0e6-b4bbc2c79bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:28.781076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf661c82-ed24-4a3c-b0e6-b4bbc2c79bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.784062 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf661c82-ed24-4a3c-b0e6-b4bbc2c79bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.784062 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf661c82-ed24-4a3c-b0e6-b4bbc2c79bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.784062 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf661c82-ed24-4a3c-b0e6-b4bbc2c79bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:28.784062 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf661c82-ed24-4a3c-b0e6-b4bbc2c79bdd admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:28.795596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 775/1575] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:28.796460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf661c82-ed24-4a3c-b0e6-b4bbc2c79bdd admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:28.807183 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf661c82-ed24-4a3c-b0e6-b4bbc2c79bdd admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:28.811858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72850cb5-7b68-411c-9dae-717a86367275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:28.812511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72850cb5-7b68-411c-9dae-717a86367275 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.812797 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72850cb5-7b68-411c-9dae-717a86367275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.813075 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72850cb5-7b68-411c-9dae-717a86367275 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.813770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72850cb5-7b68-411c-9dae-717a86367275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:28.815715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72850cb5-7b68-411c-9dae-717a86367275 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:28.896572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 801/1576] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:28 2022] POST /identity/v3/projects => generated 375 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:28.897553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5713a92-0b93-4db9-b6e3-e2eb6f8751bd admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:28.902356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:28.968173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5713a92-0b93-4db9-b6e3-e2eb6f8751bd admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:28.973168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9958ab-c621-4633-a1c2-efacb99aabf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:28.974782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9958ab-c621-4633-a1c2-efacb99aabf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:28.975079 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9958ab-c621-4633-a1c2-efacb99aabf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:28.975357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9958ab-c621-4633-a1c2-efacb99aabf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:28.976087 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9958ab-c621-4633-a1c2-efacb99aabf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:28.978045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9958ab-c621-4633-a1c2-efacb99aabf5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:28.999112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 776/1577] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:28 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:29.000976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be014f-ab29-41eb-a3fd-0f81fcc041fe None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:29.001348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be014f-ab29-41eb-a3fd-0f81fcc041fe None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:29.001715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be014f-ab29-41eb-a3fd-0f81fcc041fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:29.055381 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-04be014f-ab29-41eb-a3fd-0f81fcc041fe None None] MFA Rules not processed for user `f7abf6b71ac3454ca547a750cef9220a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:29.056623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-04be014f-ab29-41eb-a3fd-0f81fcc041fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:29.136243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 777/1578] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Jul 18 10:40:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:29.137259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be014f-ab29-41eb-a3fd-0f81fcc041fe None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:29.148848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 802/1579] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:28 2022] POST /identity/v3/projects => generated 367 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:29.151000 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9958ab-c621-4633-a1c2-efacb99aabf5 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:29.218567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be014f-ab29-41eb-a3fd-0f81fcc041fe None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:29.247765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:29.248946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9958ab-c621-4633-a1c2-efacb99aabf5 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:29.257050 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb970b-a5ac-4908-86cc-d18949a25f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:29.259244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb970b-a5ac-4908-86cc-d18949a25f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:29.259244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb970b-a5ac-4908-86cc-d18949a25f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:29.259244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb970b-a5ac-4908-86cc-d18949a25f64 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:29.260430 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb970b-a5ac-4908-86cc-d18949a25f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:29.261679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb970b-a5ac-4908-86cc-d18949a25f64 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:29.288624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9573b4f-0f66-43c1-bb05-69a62ee7fd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:29.289395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9573b4f-0f66-43c1-bb05-69a62ee7fd44 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:29.289787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9573b4f-0f66-43c1-bb05-69a62ee7fd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:29.290140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9573b4f-0f66-43c1-bb05-69a62ee7fd44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:29.290946 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9573b4f-0f66-43c1-bb05-69a62ee7fd44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:29.293084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9573b4f-0f66-43c1-bb05-69a62ee7fd44 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:29.398046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 803/1580] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:29 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:29.399210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb970b-a5ac-4908-86cc-d18949a25f64 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:29.410252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb970b-a5ac-4908-86cc-d18949a25f64 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:29.415910 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d33ff-0789-465c-8f4e-efd5e353510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:29.417276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d33ff-0789-465c-8f4e-efd5e353510d admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:29.417276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d33ff-0789-465c-8f4e-efd5e353510d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:29.417276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d33ff-0789-465c-8f4e-efd5e353510d admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:29.417900 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d33ff-0789-465c-8f4e-efd5e353510d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:29.420052 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d33ff-0789-465c-8f4e-efd5e353510d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:29.453091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 778/1581] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:29 2022] POST /identity/v3/projects => generated 377 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:29.453091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9573b4f-0f66-43c1-bb05-69a62ee7fd44 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:29.536492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9573b4f-0f66-43c1-bb05-69a62ee7fd44 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:29.543629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b5b04-66d8-4589-96eb-1936a9cd652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:29.544344 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b5b04-66d8-4589-96eb-1936a9cd652d admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:29.544629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b5b04-66d8-4589-96eb-1936a9cd652d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:29.544912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b5b04-66d8-4589-96eb-1936a9cd652d admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:29.545690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b5b04-66d8-4589-96eb-1936a9cd652d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:29.547377 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b5b04-66d8-4589-96eb-1936a9cd652d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:29.547689 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 804/1582] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:29 2022] POST /identity/v3/users => generated 279 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:29.548639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d33ff-0789-465c-8f4e-efd5e353510d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:29.560120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 779/1583] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:29.564129 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b5b04-66d8-4589-96eb-1936a9cd652d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:29.564262 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d33ff-0789-465c-8f4e-efd5e353510d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:29.568417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5fe9e-a57a-4008-a6c4-1edae511be44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:29.569111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5fe9e-a57a-4008-a6c4-1edae511be44 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:29.569378 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5fe9e-a57a-4008-a6c4-1edae511be44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:29.569650 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5fe9e-a57a-4008-a6c4-1edae511be44 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:29.570368 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5fe9e-a57a-4008-a6c4-1edae511be44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:29.572458 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5fe9e-a57a-4008-a6c4-1edae511be44 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:29.576357 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b5b04-66d8-4589-96eb-1936a9cd652d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:29.581493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716cd2b-f1c9-4fdf-b133-d10e140128c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:29.582172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716cd2b-f1c9-4fdf-b133-d10e140128c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:29.582518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716cd2b-f1c9-4fdf-b133-d10e140128c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:29.583802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716cd2b-f1c9-4fdf-b133-d10e140128c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:29.584575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716cd2b-f1c9-4fdf-b133-d10e140128c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:29.586697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716cd2b-f1c9-4fdf-b133-d10e140128c5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:29.717740 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 805/1584] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:29 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:29.718760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5fe9e-a57a-4008-a6c4-1edae511be44 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:29.749472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 780/1585] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:29 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:29.749472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716cd2b-f1c9-4fdf-b133-d10e140128c5 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:29.763563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716cd2b-f1c9-4fdf-b133-d10e140128c5 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:29.769826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b694813-7f05-4c4f-84ce-d0939c4f1a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:29.772262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b694813-7f05-4c4f-84ce-d0939c4f1a50 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:29.772547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b694813-7f05-4c4f-84ce-d0939c4f1a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:29.772876 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b694813-7f05-4c4f-84ce-d0939c4f1a50 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:29.773582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b694813-7f05-4c4f-84ce-d0939c4f1a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:29.775631 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b694813-7f05-4c4f-84ce-d0939c4f1a50 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:29.779288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:29.817751 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5fe9e-a57a-4008-a6c4-1edae511be44 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:29.826893 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8936d2-8bae-432b-b2d8-d4c52cb4507d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:29.828048 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8936d2-8bae-432b-b2d8-d4c52cb4507d service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:29.828553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8936d2-8bae-432b-b2d8-d4c52cb4507d service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:29.829053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8936d2-8bae-432b-b2d8-d4c52cb4507d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:29.889863 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 781/1586] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:29 2022] POST /identity/v3/users => generated 284 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:29.893539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b694813-7f05-4c4f-84ce-d0939c4f1a50 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:29.902126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b694813-7f05-4c4f-84ce-d0939c4f1a50 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:29.908732 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104ebbe-8ea9-4288-8060-9ebf4e3f5bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:29.909441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104ebbe-8ea9-4288-8060-9ebf4e3f5bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:29.909724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104ebbe-8ea9-4288-8060-9ebf4e3f5bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:29.909999 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104ebbe-8ea9-4288-8060-9ebf4e3f5bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:29.911627 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104ebbe-8ea9-4288-8060-9ebf4e3f5bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:29.913002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104ebbe-8ea9-4288-8060-9ebf4e3f5bb6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:29.921529 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8936d2-8bae-432b-b2d8-d4c52cb4507d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:29.924677 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8936d2-8bae-432b-b2d8-d4c52cb4507d service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:29.926242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 782/1587] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:29.930442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104ebbe-8ea9-4288-8060-9ebf4e3f5bb6 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:29.933855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 806/1588] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:29.934833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8936d2-8bae-432b-b2d8-d4c52cb4507d service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:29.941099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104ebbe-8ea9-4288-8060-9ebf4e3f5bb6 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:29.946140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8936d2-8bae-432b-b2d8-d4c52cb4507d service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:29.948569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633f38b-420e-4502-8ee1-8290f989ac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:29.949779 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633f38b-420e-4502-8ee1-8290f989ac7e admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:29.950172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633f38b-420e-4502-8ee1-8290f989ac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:29.950584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633f38b-420e-4502-8ee1-8290f989ac7e admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:29.951464 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633f38b-420e-4502-8ee1-8290f989ac7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:29.952013 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0291e94-c5fc-4e2d-bee3-c127d9404df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:29.952681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0291e94-c5fc-4e2d-bee3-c127d9404df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:29.952959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0291e94-c5fc-4e2d-bee3-c127d9404df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:29.953233 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0291e94-c5fc-4e2d-bee3-c127d9404df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:29.953953 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0291e94-c5fc-4e2d-bee3-c127d9404df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:29.955638 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0291e94-c5fc-4e2d-bee3-c127d9404df6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:29.955807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633f38b-420e-4502-8ee1-8290f989ac7e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:29.968481 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 807/1589] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:29.969454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0291e94-c5fc-4e2d-bee3-c127d9404df6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:29.981190 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0291e94-c5fc-4e2d-bee3-c127d9404df6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:29.986019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ad336-2799-4c98-83f5-478243fdc795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:29.987023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ad336-2799-4c98-83f5-478243fdc795 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:29.987246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ad336-2799-4c98-83f5-478243fdc795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:29.987520 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ad336-2799-4c98-83f5-478243fdc795 admin admin] PATH_INFO: `/v3/projects/9a26bcf2db1040639fa8213833317a69/users/b2f5648e857a43e29b24d50918ad73b8/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.004267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ad336-2799-4c98-83f5-478243fdc795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a26bcf2db1040639fa8213833317a69, user_id=b2f5648e857a43e29b24d50918ad73b8, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.006218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: WARNING py.warnings [None req-659ad336-2799-4c98-83f5-478243fdc795 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:40:30.006218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: warnings.warn(msg) Jul 18 10:40:30.006218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: Jul 18 10:40:30.008198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ad336-2799-4c98-83f5-478243fdc795 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.078857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 783/1590] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:29 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:30.079619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633f38b-420e-4502-8ee1-8290f989ac7e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.091102 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633f38b-420e-4502-8ee1-8290f989ac7e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:30.096201 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301ecd9-29d4-48c9-8947-a99b20b155de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:30.097246 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301ecd9-29d4-48c9-8947-a99b20b155de admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.097555 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301ecd9-29d4-48c9-8947-a99b20b155de admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.097836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301ecd9-29d4-48c9-8947-a99b20b155de admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.098695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301ecd9-29d4-48c9-8947-a99b20b155de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.101677 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301ecd9-29d4-48c9-8947-a99b20b155de admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.112786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 784/1591] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:30.113775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301ecd9-29d4-48c9-8947-a99b20b155de admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.126108 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301ecd9-29d4-48c9-8947-a99b20b155de admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:30.134895 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 808/1592] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:29 2022] PUT /identity/v3/projects/9a26bcf2db1040639fa8213833317a69/users/b2f5648e857a43e29b24d50918ad73b8/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:30.136685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ad336-2799-4c98-83f5-478243fdc795 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.165540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:30.212232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319df35a-74dd-4b9a-a6f6-3ad3c5ea9988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:30.212915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319df35a-74dd-4b9a-a6f6-3ad3c5ea9988 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.213196 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319df35a-74dd-4b9a-a6f6-3ad3c5ea9988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.213476 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319df35a-74dd-4b9a-a6f6-3ad3c5ea9988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.214242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319df35a-74dd-4b9a-a6f6-3ad3c5ea9988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.215945 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319df35a-74dd-4b9a-a6f6-3ad3c5ea9988 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.233038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 785/1593] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:30.237113 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319df35a-74dd-4b9a-a6f6-3ad3c5ea9988 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.239763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ad336-2799-4c98-83f5-478243fdc795 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:30.245376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836fb6c-c120-4a73-b47c-aba0e3ea60c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:30.247671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836fb6c-c120-4a73-b47c-aba0e3ea60c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.248129 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836fb6c-c120-4a73-b47c-aba0e3ea60c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.248658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836fb6c-c120-4a73-b47c-aba0e3ea60c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.249569 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836fb6c-c120-4a73-b47c-aba0e3ea60c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.251667 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836fb6c-c120-4a73-b47c-aba0e3ea60c9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.252095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319df35a-74dd-4b9a-a6f6-3ad3c5ea9988 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:30.261123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822bfb7-de58-456e-8032-8cd2845a0ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:30.261857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822bfb7-de58-456e-8032-8cd2845a0ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.262140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822bfb7-de58-456e-8032-8cd2845a0ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.262462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822bfb7-de58-456e-8032-8cd2845a0ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.263518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822bfb7-de58-456e-8032-8cd2845a0ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.265647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822bfb7-de58-456e-8032-8cd2845a0ba6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.270043 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 809/1594] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:30.271241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836fb6c-c120-4a73-b47c-aba0e3ea60c9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.279222 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 786/1595] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:30.280115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822bfb7-de58-456e-8032-8cd2845a0ba6 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.288277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836fb6c-c120-4a73-b47c-aba0e3ea60c9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:30.290767 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822bfb7-de58-456e-8032-8cd2845a0ba6 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:30.297485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119544d-4a65-46b8-bc5f-fe4825c498ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:30.297697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ea2f3-ffc6-48ff-98e4-26737fa84fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:30.298388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ea2f3-ffc6-48ff-98e4-26737fa84fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.298743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ea2f3-ffc6-48ff-98e4-26737fa84fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.299086 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ea2f3-ffc6-48ff-98e4-26737fa84fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.299495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119544d-4a65-46b8-bc5f-fe4825c498ef admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.299933 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ea2f3-ffc6-48ff-98e4-26737fa84fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.300196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119544d-4a65-46b8-bc5f-fe4825c498ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.300762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119544d-4a65-46b8-bc5f-fe4825c498ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.302401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ea2f3-ffc6-48ff-98e4-26737fa84fcc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.302940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119544d-4a65-46b8-bc5f-fe4825c498ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.305999 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119544d-4a65-46b8-bc5f-fe4825c498ef admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.314514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 787/1596] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:30.315408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ea2f3-ffc6-48ff-98e4-26737fa84fcc admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.326707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ea2f3-ffc6-48ff-98e4-26737fa84fcc admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:30.327518 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 810/1597] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:30.329386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d0eb2-1c69-4a6e-8f83-f590e91d2d49 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.329614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d0eb2-1c69-4a6e-8f83-f590e91d2d49 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.329893 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d0eb2-1c69-4a6e-8f83-f590e91d2d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.334145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bde23-ff16-42ef-b469-0a243d5dacdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:30.334859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bde23-ff16-42ef-b469-0a243d5dacdc admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.335144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bde23-ff16-42ef-b469-0a243d5dacdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.336226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bde23-ff16-42ef-b469-0a243d5dacdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.336824 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bde23-ff16-42ef-b469-0a243d5dacdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.338757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bde23-ff16-42ef-b469-0a243d5dacdc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.351128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 788/1598] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:30.351789 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bde23-ff16-42ef-b469-0a243d5dacdc admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.363541 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bde23-ff16-42ef-b469-0a243d5dacdc admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:30.369810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05181d-27a5-4bdc-b2be-10ceef1eeaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:30.370143 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3e9d0eb2-1c69-4a6e-8f83-f590e91d2d49 None None] MFA Rules not processed for user `b2f5648e857a43e29b24d50918ad73b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:30.370533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05181d-27a5-4bdc-b2be-10ceef1eeaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.370809 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05181d-27a5-4bdc-b2be-10ceef1eeaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.371084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05181d-27a5-4bdc-b2be-10ceef1eeaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.371806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05181d-27a5-4bdc-b2be-10ceef1eeaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.371923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3e9d0eb2-1c69-4a6e-8f83-f590e91d2d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:30.373909 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05181d-27a5-4bdc-b2be-10ceef1eeaf4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.391491 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 789/1599] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:30.391491 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05181d-27a5-4bdc-b2be-10ceef1eeaf4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.391797 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:30.405055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05181d-27a5-4bdc-b2be-10ceef1eeaf4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:30.412401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e6838-1768-47f6-9820-4555988df432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:30.412827 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e6838-1768-47f6-9820-4555988df432 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.413109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e6838-1768-47f6-9820-4555988df432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.413388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e6838-1768-47f6-9820-4555988df432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.414128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e6838-1768-47f6-9820-4555988df432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.415846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e6838-1768-47f6-9820-4555988df432 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.430812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 790/1600] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:30.434825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e6838-1768-47f6-9820-4555988df432 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.464985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e6838-1768-47f6-9820-4555988df432 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:30.464985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c45879-65a5-43b7-b73f-2e3c3d721124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:30.464985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c45879-65a5-43b7-b73f-2e3c3d721124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.464985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c45879-65a5-43b7-b73f-2e3c3d721124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.468453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c45879-65a5-43b7-b73f-2e3c3d721124 admin admin] PATH_INFO: `/v3/projects/046e211ba15a408190bff2e5d979c544/users/649b66b27ef44ad5b218f6e8bb790963/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.472658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 811/1601] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:30.472658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d0eb2-1c69-4a6e-8f83-f590e91d2d49 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.478994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c45879-65a5-43b7-b73f-2e3c3d721124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=046e211ba15a408190bff2e5d979c544, user_id=649b66b27ef44ad5b218f6e8bb790963, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.480964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d0eb2-1c69-4a6e-8f83-f590e91d2d49 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:30.484299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c45879-65a5-43b7-b73f-2e3c3d721124 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.486198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c02ab7-d076-4907-97c6-de98051ec7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:30.487114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c02ab7-d076-4907-97c6-de98051ec7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.487798 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c02ab7-d076-4907-97c6-de98051ec7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.488385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c02ab7-d076-4907-97c6-de98051ec7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.493075 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c02ab7-d076-4907-97c6-de98051ec7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.498621 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c02ab7-d076-4907-97c6-de98051ec7b3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.510942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 812/1602] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:30.515002 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c02ab7-d076-4907-97c6-de98051ec7b3 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.528209 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c02ab7-d076-4907-97c6-de98051ec7b3 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:30.533921 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bfa33-fcb9-418a-988c-2ce87531d111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:30.534859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bfa33-fcb9-418a-988c-2ce87531d111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.535131 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bfa33-fcb9-418a-988c-2ce87531d111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.535591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bfa33-fcb9-418a-988c-2ce87531d111 admin admin] PATH_INFO: `/v3/projects/c1923310487d4925a9f7e1cf0b993a7c/users/be79776c4c204f6eb3f34963bb34a09f/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.555335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bfa33-fcb9-418a-988c-2ce87531d111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1923310487d4925a9f7e1cf0b993a7c, user_id=be79776c4c204f6eb3f34963bb34a09f, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.558055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bfa33-fcb9-418a-988c-2ce87531d111 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.602974 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 791/1603] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:30 2022] PUT /identity/v3/projects/046e211ba15a408190bff2e5d979c544/users/649b66b27ef44ad5b218f6e8bb790963/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:30.603928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c45879-65a5-43b7-b73f-2e3c3d721124 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.673240 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c45879-65a5-43b7-b73f-2e3c3d721124 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:30.679040 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976092a-5ea0-4d8a-89b4-d8138a257160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:30.679936 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976092a-5ea0-4d8a-89b4-d8138a257160 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.680220 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976092a-5ea0-4d8a-89b4-d8138a257160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.680554 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976092a-5ea0-4d8a-89b4-d8138a257160 admin admin] PATH_INFO: `/v3/projects/82a82fb4b6414d1788830f8bdb20204a/users/fc0bed9775be4a6bac89e8c34930bd69/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.700325 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976092a-5ea0-4d8a-89b4-d8138a257160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82a82fb4b6414d1788830f8bdb20204a, user_id=fc0bed9775be4a6bac89e8c34930bd69, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.703074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976092a-5ea0-4d8a-89b4-d8138a257160 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.716890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 813/1604] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:30 2022] PUT /identity/v3/projects/c1923310487d4925a9f7e1cf0b993a7c/users/be79776c4c204f6eb3f34963bb34a09f/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:30.723913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bfa33-fcb9-418a-988c-2ce87531d111 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.780300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 792/1605] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:30 2022] PUT /identity/v3/projects/82a82fb4b6414d1788830f8bdb20204a/users/fc0bed9775be4a6bac89e8c34930bd69/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:30.781313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976092a-5ea0-4d8a-89b4-d8138a257160 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.795602 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bfa33-fcb9-418a-988c-2ce87531d111 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:30.825482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:30.866029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95237c66-a513-4078-ad10-4ee8821fe26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:30.866029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95237c66-a513-4078-ad10-4ee8821fe26d admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.866029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95237c66-a513-4078-ad10-4ee8821fe26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.866029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95237c66-a513-4078-ad10-4ee8821fe26d admin admin] PATH_INFO: `/v3/projects/93d0f52b257c48c19cc77fc605729abf/users/cac2f73bfa37460ebe4438fce527b1db/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.868363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976092a-5ea0-4d8a-89b4-d8138a257160 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:30.873662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef7a59-855e-4157-bb56-ff395036b141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:30.874609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef7a59-855e-4157-bb56-ff395036b141 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:30.874887 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef7a59-855e-4157-bb56-ff395036b141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:30.875166 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef7a59-855e-4157-bb56-ff395036b141 admin admin] PATH_INFO: `/v3/projects/a062a166125e4d0c9086fc16d8215615/users/9e3bf1a14a424ccba70736a43cd888e1/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:30.880275 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95237c66-a513-4078-ad10-4ee8821fe26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d0f52b257c48c19cc77fc605729abf, user_id=cac2f73bfa37460ebe4438fce527b1db, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.883131 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95237c66-a513-4078-ad10-4ee8821fe26d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.891709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef7a59-855e-4157-bb56-ff395036b141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a062a166125e4d0c9086fc16d8215615, user_id=9e3bf1a14a424ccba70736a43cd888e1, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:30.894444 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef7a59-855e-4157-bb56-ff395036b141 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:30.968647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 814/1606] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:30 2022] PUT /identity/v3/projects/93d0f52b257c48c19cc77fc605729abf/users/cac2f73bfa37460ebe4438fce527b1db/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:30.969680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95237c66-a513-4078-ad10-4ee8821fe26d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:30.987301 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:30.999078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 793/1607] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:30 2022] PUT /identity/v3/projects/a062a166125e4d0c9086fc16d8215615/users/9e3bf1a14a424ccba70736a43cd888e1/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:30.999947 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef7a59-855e-4157-bb56-ff395036b141 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:31.052303 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95237c66-a513-4078-ad10-4ee8821fe26d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:31.071423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef7a59-855e-4157-bb56-ff395036b141 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:31.076528 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b0b59-532c-4263-b1ab-e53bb4604cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:31.077511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b0b59-532c-4263-b1ab-e53bb4604cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.077790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b0b59-532c-4263-b1ab-e53bb4604cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.083362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b0b59-532c-4263-b1ab-e53bb4604cdb admin admin] PATH_INFO: `/v3/projects/c2f28b1e666243fb9780f63e2fa6a6eb/users/43b46c9179024f6b89c579db0d570cd7/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.096716 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b0b59-532c-4263-b1ab-e53bb4604cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f28b1e666243fb9780f63e2fa6a6eb, user_id=43b46c9179024f6b89c579db0d570cd7, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:31.100526 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b0b59-532c-4263-b1ab-e53bb4604cdb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:31.118455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf61b0-e114-42de-a17d-95710c920ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:31.118455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf61b0-e114-42de-a17d-95710c920ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.118455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf61b0-e114-42de-a17d-95710c920ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.118455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf61b0-e114-42de-a17d-95710c920ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.118981 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf61b0-e114-42de-a17d-95710c920ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:31.120648 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf61b0-e114-42de-a17d-95710c920ce2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:31.180154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 794/1608] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:30 2022] PUT /identity/v3/projects/c2f28b1e666243fb9780f63e2fa6a6eb/users/43b46c9179024f6b89c579db0d570cd7/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:31.181579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7141acf-c153-4e29-9125-7de708f6c6e1 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.181872 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7141acf-c153-4e29-9125-7de708f6c6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.182262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7141acf-c153-4e29-9125-7de708f6c6e1 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.183748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 795/1609] 10.222.0.16 () {54 vars in 962 bytes} [Mon Jul 18 10:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:40:31.184857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacf7ef-f736-4c7b-9459-c037e08c8720 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.185147 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacf7ef-f736-4c7b-9459-c037e08c8720 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.185616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacf7ef-f736-4c7b-9459-c037e08c8720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.204370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2dacf7ef-f736-4c7b-9459-c037e08c8720 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:31.214463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2dacf7ef-f736-4c7b-9459-c037e08c8720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:31.245506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 815/1610] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:30 2022] POST /identity/v3/projects => generated 363 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:31.247601 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c7062-7c52-483d-bd19-6203ec474215 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.248328 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c7062-7c52-483d-bd19-6203ec474215 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.248328 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c7062-7c52-483d-bd19-6203ec474215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.278483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 796/1611] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:31.278483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563d9ac-9c0b-4abb-906d-ec821ed2fbce None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.278483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563d9ac-9c0b-4abb-906d-ec821ed2fbce None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.278483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563d9ac-9c0b-4abb-906d-ec821ed2fbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.291358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ce0c7062-7c52-483d-bd19-6203ec474215 None None] MFA Rules not processed for user `be79776c4c204f6eb3f34963bb34a09f`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:31.291358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ce0c7062-7c52-483d-bd19-6203ec474215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:31.313727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d563d9ac-9c0b-4abb-906d-ec821ed2fbce None None] MFA Rules not processed for user `fc0bed9775be4a6bac89e8c34930bd69`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:31.315000 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d563d9ac-9c0b-4abb-906d-ec821ed2fbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:31.351412 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:31.389331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 816/1612] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:31.392030 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d83c0f-0d83-4e09-a270-92cc13dec0d5 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.392518 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d83c0f-0d83-4e09-a270-92cc13dec0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.392917 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d83c0f-0d83-4e09-a270-92cc13dec0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.393431 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 797/1613] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:31.394695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45d6f1-dd39-46b6-8919-51454142c3a6 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.394985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45d6f1-dd39-46b6-8919-51454142c3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.395305 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45d6f1-dd39-46b6-8919-51454142c3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.412130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-19d83c0f-0d83-4e09-a270-92cc13dec0d5 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:31.413350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-19d83c0f-0d83-4e09-a270-92cc13dec0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:31.432335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-bb45d6f1-dd39-46b6-8919-51454142c3a6 None None] MFA Rules not processed for user `9e3bf1a14a424ccba70736a43cd888e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:31.433912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-bb45d6f1-dd39-46b6-8919-51454142c3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:31.447191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:31.477281 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 817/1614] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:31.478721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6c48-fa6e-4532-a143-b41855036e4b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.479092 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6c48-fa6e-4532-a143-b41855036e4b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.479450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6c48-fa6e-4532-a143-b41855036e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.499243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1f8f6c48-fa6e-4532-a143-b41855036e4b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:31.500724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1f8f6c48-fa6e-4532-a143-b41855036e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:31.511809 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 798/1616] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:31.513566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb5174-c3c8-480c-9415-6fe784bd0914 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.513924 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb5174-c3c8-480c-9415-6fe784bd0914 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.514350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb5174-c3c8-480c-9415-6fe784bd0914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.514709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 818/1615] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:31.515682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f6c48-fa6e-4532-a143-b41855036e4b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:31.527697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f6c48-fa6e-4532-a143-b41855036e4b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:31.533084 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0f938-b9bd-4235-96d2-7f96d504ccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:31.533837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0f938-b9bd-4235-96d2-7f96d504ccfd admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.534040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0f938-b9bd-4235-96d2-7f96d504ccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.534339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0f938-b9bd-4235-96d2-7f96d504ccfd admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.535046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0f938-b9bd-4235-96d2-7f96d504ccfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:31.537136 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0f938-b9bd-4235-96d2-7f96d504ccfd admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:31.537266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-dcbb5174-c3c8-480c-9415-6fe784bd0914 None None] MFA Rules not processed for user `f7abf6b71ac3454ca547a750cef9220a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:31.538452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-dcbb5174-c3c8-480c-9415-6fe784bd0914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:31.618202 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 799/1617] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Jul 18 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:31.619111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb5174-c3c8-480c-9415-6fe784bd0914 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:31.677669 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb5174-c3c8-480c-9415-6fe784bd0914 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:31.681726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2371910-fc98-44fb-ade6-cb298be150ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:31.683023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 819/1618] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:31 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:31.683197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2371910-fc98-44fb-ade6-cb298be150ba service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.683197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2371910-fc98-44fb-ade6-cb298be150ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.683375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2371910-fc98-44fb-ade6-cb298be150ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.683460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0f938-b9bd-4235-96d2-7f96d504ccfd admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:31.689810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:31.694244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2371910-fc98-44fb-ade6-cb298be150ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:31.695464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0f938-b9bd-4235-96d2-7f96d504ccfd admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:31.695764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2371910-fc98-44fb-ade6-cb298be150ba service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:31.700242 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34846b-8df8-485e-beea-86fb83c82180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:31.705267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34846b-8df8-485e-beea-86fb83c82180 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.705267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34846b-8df8-485e-beea-86fb83c82180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.705267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34846b-8df8-485e-beea-86fb83c82180 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.705267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34846b-8df8-485e-beea-86fb83c82180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:31.705267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34846b-8df8-485e-beea-86fb83c82180 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:31.707352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 800/1619] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:31.708852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2371910-fc98-44fb-ade6-cb298be150ba service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:31.720272 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2371910-fc98-44fb-ade6-cb298be150ba service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:31.725776 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363cc75-e1b6-4b08-bea0-600492890851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:31.726577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363cc75-e1b6-4b08-bea0-600492890851 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.726864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363cc75-e1b6-4b08-bea0-600492890851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.727147 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363cc75-e1b6-4b08-bea0-600492890851 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.727840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363cc75-e1b6-4b08-bea0-600492890851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:31.729781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363cc75-e1b6-4b08-bea0-600492890851 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:31.811708 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 820/1620] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:31 2022] POST /identity/v3/projects => generated 357 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:31.814453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34846b-8df8-485e-beea-86fb83c82180 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:31.871465 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 801/1621] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:31 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:31.873279 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363cc75-e1b6-4b08-bea0-600492890851 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:31.891835 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34846b-8df8-485e-beea-86fb83c82180 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:31.950983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363cc75-e1b6-4b08-bea0-600492890851 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:31.953225 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246aa68-f249-4e98-934e-08a38a4bb100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:31.954004 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246aa68-f249-4e98-934e-08a38a4bb100 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.954381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246aa68-f249-4e98-934e-08a38a4bb100 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.954747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246aa68-f249-4e98-934e-08a38a4bb100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.956936 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f42d0f-a883-43cd-9023-8583f370808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:31.958257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f42d0f-a883-43cd-9023-8583f370808f admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.958469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f42d0f-a883-43cd-9023-8583f370808f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.958778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f42d0f-a883-43cd-9023-8583f370808f admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:31.959451 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f42d0f-a883-43cd-9023-8583f370808f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:31.961422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f42d0f-a883-43cd-9023-8583f370808f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:31.965966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246aa68-f249-4e98-934e-08a38a4bb100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:31.967499 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246aa68-f249-4e98-934e-08a38a4bb100 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:31.982309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 821/1622] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:31.982309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246aa68-f249-4e98-934e-08a38a4bb100 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:31.988536 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246aa68-f249-4e98-934e-08a38a4bb100 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:31.992370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f844a-0b51-498c-bbb1-a292dccc23e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:31.993013 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f844a-0b51-498c-bbb1-a292dccc23e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:31.993297 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f844a-0b51-498c-bbb1-a292dccc23e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:31.993569 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f844a-0b51-498c-bbb1-a292dccc23e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:32.004923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f844a-0b51-498c-bbb1-a292dccc23e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:32.006506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f844a-0b51-498c-bbb1-a292dccc23e5 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:32.018301 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 822/1623] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:32.019411 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35a589-a4e3-48b5-907c-3aed49f39644 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:32.019699 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35a589-a4e3-48b5-907c-3aed49f39644 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:32.019977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35a589-a4e3-48b5-907c-3aed49f39644 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:32.022040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 823/1624] 10.222.0.16 () {54 vars in 912 bytes} [Mon Jul 18 10:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:40:32.022876 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35a589-a4e3-48b5-907c-3aed49f39644 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:32.036880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35a589-a4e3-48b5-907c-3aed49f39644 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:32.042484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afaeea-cb42-456b-ab55-3b9e01082a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:32.047449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afaeea-cb42-456b-ab55-3b9e01082a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:32.047449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afaeea-cb42-456b-ab55-3b9e01082a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:32.047449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afaeea-cb42-456b-ab55-3b9e01082a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:32.047449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afaeea-cb42-456b-ab55-3b9e01082a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:32.047449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afaeea-cb42-456b-ab55-3b9e01082a13 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:32.061155 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 824/1625] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:32.061155 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afaeea-cb42-456b-ab55-3b9e01082a13 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:32.072058 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afaeea-cb42-456b-ab55-3b9e01082a13 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:32.077472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0041a-2f6d-4286-8c4c-9c4441f5e790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:32.078222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0041a-2f6d-4286-8c4c-9c4441f5e790 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:32.078615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0041a-2f6d-4286-8c4c-9c4441f5e790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:32.078965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0041a-2f6d-4286-8c4c-9c4441f5e790 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:32.079667 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0041a-2f6d-4286-8c4c-9c4441f5e790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:32.081688 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0041a-2f6d-4286-8c4c-9c4441f5e790 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:32.113493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 802/1626] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:31 2022] POST /identity/v3/projects => generated 369 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:32.113493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f42d0f-a883-43cd-9023-8583f370808f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:32.198549 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f42d0f-a883-43cd-9023-8583f370808f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:32.205158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41917e19-a26c-4dc7-a89b-05e296860cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:32.205677 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41917e19-a26c-4dc7-a89b-05e296860cda admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:32.206150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41917e19-a26c-4dc7-a89b-05e296860cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:32.206793 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41917e19-a26c-4dc7-a89b-05e296860cda admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:32.207332 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41917e19-a26c-4dc7-a89b-05e296860cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:32.210438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41917e19-a26c-4dc7-a89b-05e296860cda admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:32.238082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 825/1627] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:32 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:32.239990 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db33e81-abc9-4b54-8322-06e0740cfba4 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:32.240547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db33e81-abc9-4b54-8322-06e0740cfba4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:32.241009 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db33e81-abc9-4b54-8322-06e0740cfba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:32.260244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:32.265998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2db33e81-abc9-4b54-8322-06e0740cfba4 None None] MFA Rules not processed for user `f7abf6b71ac3454ca547a750cef9220a`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:32.267338 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2db33e81-abc9-4b54-8322-06e0740cfba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:32.360023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 826/1628] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 18 10:40:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:32.361587 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db33e81-abc9-4b54-8322-06e0740cfba4 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:32.381102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db33e81-abc9-4b54-8322-06e0740cfba4 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:32.388931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b827d95-164f-4929-b44c-da6414181e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:32.390555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b827d95-164f-4929-b44c-da6414181e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:32.391081 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b827d95-164f-4929-b44c-da6414181e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:32.391600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b827d95-164f-4929-b44c-da6414181e77 admin admin] PATH_INFO: `/v3/projects/dfa294e3d24f4560b4dec757ee0d86a8/users/0d3e6db566004e6bbb31ea28e4519b10/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:32.419736 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 803/1629] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:32 2022] POST /identity/v3/users => generated 295 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:32.419736 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41917e19-a26c-4dc7-a89b-05e296860cda admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:32.420820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b827d95-164f-4929-b44c-da6414181e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa294e3d24f4560b4dec757ee0d86a8, user_id=0d3e6db566004e6bbb31ea28e4519b10, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:32.423679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b827d95-164f-4929-b44c-da6414181e77 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:32.430525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41917e19-a26c-4dc7-a89b-05e296860cda admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:32.435322 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616e8e0-e334-4d23-8a94-cd2c375f88c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:32.436322 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616e8e0-e334-4d23-8a94-cd2c375f88c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:32.436673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616e8e0-e334-4d23-8a94-cd2c375f88c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:32.437084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616e8e0-e334-4d23-8a94-cd2c375f88c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:32.437840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616e8e0-e334-4d23-8a94-cd2c375f88c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:32.439928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616e8e0-e334-4d23-8a94-cd2c375f88c2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:32.568106 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 804/1631] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:32 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:32.569659 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616e8e0-e334-4d23-8a94-cd2c375f88c2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:32.570883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 827/1631] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:32 2022] PUT /identity/v3/projects/dfa294e3d24f4560b4dec757ee0d86a8/users/0d3e6db566004e6bbb31ea28e4519b10/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:32.572176 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b827d95-164f-4929-b44c-da6414181e77 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:32.582655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616e8e0-e334-4d23-8a94-cd2c375f88c2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:32.618959 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:32.649400 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b827d95-164f-4929-b44c-da6414181e77 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:32.653392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ceb231-a672-48b2-b90c-34470fbca532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:32.654150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ceb231-a672-48b2-b90c-34470fbca532 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:32.654532 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ceb231-a672-48b2-b90c-34470fbca532 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:32.655323 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ceb231-a672-48b2-b90c-34470fbca532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:32.665290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ce965-b270-4edd-9b5b-8c59a9b2e18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:32.666406 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ce965-b270-4edd-9b5b-8c59a9b2e18e admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:32.667201 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ce965-b270-4edd-9b5b-8c59a9b2e18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:32.667489 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ce965-b270-4edd-9b5b-8c59a9b2e18e admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:32.668256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ce965-b270-4edd-9b5b-8c59a9b2e18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:32.670146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ce965-b270-4edd-9b5b-8c59a9b2e18e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:32.686968 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 805/1632] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:32.686968 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ce965-b270-4edd-9b5b-8c59a9b2e18e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:32.693660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ce965-b270-4edd-9b5b-8c59a9b2e18e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:32.698881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d6d1-ac2f-49af-b43e-6add0da11876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:32.699773 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d6d1-ac2f-49af-b43e-6add0da11876 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:32.700066 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d6d1-ac2f-49af-b43e-6add0da11876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:32.700339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d6d1-ac2f-49af-b43e-6add0da11876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:32.701075 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734d6d1-ac2f-49af-b43e-6add0da11876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:32.702891 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734d6d1-ac2f-49af-b43e-6add0da11876 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:32.721037 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 806/1633] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:32.721037 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d6d1-ac2f-49af-b43e-6add0da11876 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:32.734551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d6d1-ac2f-49af-b43e-6add0da11876 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:32.741127 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b3a62-051f-471e-9b69-a8afea46b812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:32.742166 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b3a62-051f-471e-9b69-a8afea46b812 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:32.742764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b3a62-051f-471e-9b69-a8afea46b812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:32.743171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b3a62-051f-471e-9b69-a8afea46b812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:32.744071 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b3a62-051f-471e-9b69-a8afea46b812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:32.745882 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b3a62-051f-471e-9b69-a8afea46b812 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:32.748350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ceb231-a672-48b2-b90c-34470fbca532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:32.751915 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ceb231-a672-48b2-b90c-34470fbca532 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:32.762566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 807/1634] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:32.762566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b3a62-051f-471e-9b69-a8afea46b812 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:32.774767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 828/1635] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:32.775730 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ceb231-a672-48b2-b90c-34470fbca532 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:32.778861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b3a62-051f-471e-9b69-a8afea46b812 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:32.793176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d2d9a-640d-43f4-9296-f5cbfe5070a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:32.794009 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d2d9a-640d-43f4-9296-f5cbfe5070a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:32.794487 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d2d9a-640d-43f4-9296-f5cbfe5070a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:32.794901 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d2d9a-640d-43f4-9296-f5cbfe5070a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:32.795733 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d2d9a-640d-43f4-9296-f5cbfe5070a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:32.800798 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ceb231-a672-48b2-b90c-34470fbca532 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:32.803271 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d2d9a-640d-43f4-9296-f5cbfe5070a3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:32.813741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4444af-6f5c-4ffd-8456-2e0b5d65e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:32.815694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4444af-6f5c-4ffd-8456-2e0b5d65e824 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:32.819575 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4444af-6f5c-4ffd-8456-2e0b5d65e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:32.820325 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4444af-6f5c-4ffd-8456-2e0b5d65e824 admin admin] PATH_INFO: `/v3/projects/2f1765b16d5449b8ba7b4090833f5ee5/users/bf403388dd9240b1966259b4095046d9/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:32.829207 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 808/1636] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:32.831173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d2d9a-640d-43f4-9296-f5cbfe5070a3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:32.848124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:32.852887 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d2d9a-640d-43f4-9296-f5cbfe5070a3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:32.856943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4444af-6f5c-4ffd-8456-2e0b5d65e824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1765b16d5449b8ba7b4090833f5ee5, user_id=bf403388dd9240b1966259b4095046d9, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:32.863180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4444af-6f5c-4ffd-8456-2e0b5d65e824 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:32.866230 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f082958-14c3-44c0-b85f-a087bd823a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:32.867497 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f082958-14c3-44c0-b85f-a087bd823a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:32.868041 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f082958-14c3-44c0-b85f-a087bd823a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:32.868550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f082958-14c3-44c0-b85f-a087bd823a39 admin admin] PATH_INFO: `/v3/projects/4a827591dac64ae0bb19d76944d95f48/users/6a58584176e94db59ec78b8885473cdf/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:32.902073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f082958-14c3-44c0-b85f-a087bd823a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a827591dac64ae0bb19d76944d95f48, user_id=6a58584176e94db59ec78b8885473cdf, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:32.906490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f082958-14c3-44c0-b85f-a087bd823a39 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:33.024156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 829/1637] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:32 2022] PUT /identity/v3/projects/2f1765b16d5449b8ba7b4090833f5ee5/users/bf403388dd9240b1966259b4095046d9/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:33.027484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4444af-6f5c-4ffd-8456-2e0b5d65e824 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:33.028242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 809/1638] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:32 2022] PUT /identity/v3/projects/4a827591dac64ae0bb19d76944d95f48/users/6a58584176e94db59ec78b8885473cdf/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:33.032269 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f082958-14c3-44c0-b85f-a087bd823a39 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:33.372671 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f082958-14c3-44c0-b85f-a087bd823a39 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:33.374378 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4444af-6f5c-4ffd-8456-2e0b5d65e824 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:33.374378 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5618b-4854-416f-aae0-26f2aa820cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:33.374378 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5618b-4854-416f-aae0-26f2aa820cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:33.374378 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5618b-4854-416f-aae0-26f2aa820cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:33.374678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5618b-4854-416f-aae0-26f2aa820cbf admin admin] PATH_INFO: `/v3/projects/dfa294e3d24f4560b4dec757ee0d86a8/users/0d3e6db566004e6bbb31ea28e4519b10/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:33.374678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5618b-4854-416f-aae0-26f2aa820cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa294e3d24f4560b4dec757ee0d86a8, user_id=0d3e6db566004e6bbb31ea28e4519b10, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:33.374678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5618b-4854-416f-aae0-26f2aa820cbf admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:33.374678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 830/1639] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:33 2022] PUT /identity/v3/projects/dfa294e3d24f4560b4dec757ee0d86a8/users/0d3e6db566004e6bbb31ea28e4519b10/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:33.374678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ee6d-ed5e-43cf-98a8-eb145caf7325 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:33.375076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ee6d-ed5e-43cf-98a8-eb145caf7325 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:33.375076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ee6d-ed5e-43cf-98a8-eb145caf7325 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:33.375076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 831/1640] 10.222.0.16 () {54 vars in 912 bytes} [Mon Jul 18 10:40:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:40:33.375076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ee6d-ed5e-43cf-98a8-eb145caf7325 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:33.375563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc5066-7501-4827-a050-621ee972f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:33.375563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc5066-7501-4827-a050-621ee972f7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:33.375563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc5066-7501-4827-a050-621ee972f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:33.375563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc5066-7501-4827-a050-621ee972f7b4 admin admin] PATH_INFO: `/v3/projects/bf168dcea7184503a3768fc5497cd1b6/users/eca5bf96e11640c8ae848d324bb9a0f1/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:33.376910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc5066-7501-4827-a050-621ee972f7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf168dcea7184503a3768fc5497cd1b6, user_id=eca5bf96e11640c8ae848d324bb9a0f1, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:33.376910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc5066-7501-4827-a050-621ee972f7b4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:33.380492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ee6d-ed5e-43cf-98a8-eb145caf7325 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:33.380492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58755fab-10ff-42f4-acf4-aedf55403adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:33.380492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58755fab-10ff-42f4-acf4-aedf55403adc admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:33.380492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58755fab-10ff-42f4-acf4-aedf55403adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:33.380821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58755fab-10ff-42f4-acf4-aedf55403adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:33.380821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58755fab-10ff-42f4-acf4-aedf55403adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:33.380821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58755fab-10ff-42f4-acf4-aedf55403adc admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:33.380821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 832/1641] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:33.380821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58755fab-10ff-42f4-acf4-aedf55403adc admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:33.380821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58755fab-10ff-42f4-acf4-aedf55403adc admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:33.381168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19265249-f251-454e-8818-312c6d818415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:33.381168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19265249-f251-454e-8818-312c6d818415 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:33.381168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19265249-f251-454e-8818-312c6d818415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:33.381168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19265249-f251-454e-8818-312c6d818415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:33.381460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19265249-f251-454e-8818-312c6d818415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:33.381460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19265249-f251-454e-8818-312c6d818415 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:33.389574 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 833/1642] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:33.391215 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94af72-ee5f-4c9d-8790-0823fb5c6ed4 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:33.391671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94af72-ee5f-4c9d-8790-0823fb5c6ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:33.391952 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94af72-ee5f-4c9d-8790-0823fb5c6ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:33.417410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-bc94af72-ee5f-4c9d-8790-0823fb5c6ed4 None None] MFA Rules not processed for user `f7abf6b71ac3454ca547a750cef9220a`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:33.419066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-bc94af72-ee5f-4c9d-8790-0823fb5c6ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:33.508538 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 834/1643] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 18 10:40:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:33.510511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5def2-604e-4070-b25c-0b17caf12529 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:33.510923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5def2-604e-4070-b25c-0b17caf12529 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:33.511420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5def2-604e-4070-b25c-0b17caf12529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:33.542973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-15b5def2-604e-4070-b25c-0b17caf12529 None None] MFA Rules not processed for user `0d3e6db566004e6bbb31ea28e4519b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:33.544235 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-15b5def2-604e-4070-b25c-0b17caf12529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:33.594865 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 810/1644] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:33 2022] PUT /identity/v3/projects/bf168dcea7184503a3768fc5497cd1b6/users/eca5bf96e11640c8ae848d324bb9a0f1/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:33.594865 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc5066-7501-4827-a050-621ee972f7b4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:33.627272 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 835/1645] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:33 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:33.628526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5def2-604e-4070-b25c-0b17caf12529 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:33.652664 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5def2-604e-4070-b25c-0b17caf12529 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:33.657977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14262da4-2142-4090-b5e3-a809183d7bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:33.659689 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262da4-2142-4090-b5e3-a809183d7bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:33.659977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262da4-2142-4090-b5e3-a809183d7bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:33.660262 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14262da4-2142-4090-b5e3-a809183d7bd6 admin admin] PATH_INFO: `/v3/projects/4a827591dac64ae0bb19d76944d95f48/users/6a58584176e94db59ec78b8885473cdf/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:33.663357 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc5066-7501-4827-a050-621ee972f7b4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:33.663556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14262da4-2142-4090-b5e3-a809183d7bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a827591dac64ae0bb19d76944d95f48, user_id=6a58584176e94db59ec78b8885473cdf, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:33.666894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14262da4-2142-4090-b5e3-a809183d7bd6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:33.668723 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f6289-f771-41e8-998b-530528ae750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:33.669775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6289-f771-41e8-998b-530528ae750f admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:33.670142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6289-f771-41e8-998b-530528ae750f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:33.670529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6289-f771-41e8-998b-530528ae750f admin admin] PATH_INFO: `/v3/projects/2f1765b16d5449b8ba7b4090833f5ee5/users/bf403388dd9240b1966259b4095046d9/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:33.672780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f6289-f771-41e8-998b-530528ae750f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1765b16d5449b8ba7b4090833f5ee5, user_id=bf403388dd9240b1966259b4095046d9, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:33.675574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f6289-f771-41e8-998b-530528ae750f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:33.686776 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 836/1646] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:33 2022] PUT /identity/v3/projects/4a827591dac64ae0bb19d76944d95f48/users/6a58584176e94db59ec78b8885473cdf/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:33.696421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 811/1647] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:33 2022] PUT /identity/v3/projects/2f1765b16d5449b8ba7b4090833f5ee5/users/bf403388dd9240b1966259b4095046d9/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:33.696421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f6289-f771-41e8-998b-530528ae750f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:33.696673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14262da4-2142-4090-b5e3-a809183d7bd6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:33.763878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:33.776341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14262da4-2142-4090-b5e3-a809183d7bd6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:33.786697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f6289-f771-41e8-998b-530528ae750f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:33.794260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec34dc-07d0-460f-bedb-da680129816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:33.795110 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec34dc-07d0-460f-bedb-da680129816a admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:33.795410 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec34dc-07d0-460f-bedb-da680129816a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:33.795745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec34dc-07d0-460f-bedb-da680129816a admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:33.796555 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec34dc-07d0-460f-bedb-da680129816a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:33.798595 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec34dc-07d0-460f-bedb-da680129816a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:33.811718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 812/1648] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:33.812791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec34dc-07d0-460f-bedb-da680129816a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:33.837757 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ce694-75b3-4504-a30c-4228bf5b2224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:33.838448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ce694-75b3-4504-a30c-4228bf5b2224 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:33.838826 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ce694-75b3-4504-a30c-4228bf5b2224 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:33.839119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ce694-75b3-4504-a30c-4228bf5b2224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:33.917670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ce694-75b3-4504-a30c-4228bf5b2224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:33.918720 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ce694-75b3-4504-a30c-4228bf5b2224 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:33.931604 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec34dc-07d0-460f-bedb-da680129816a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:33.931925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 837/1649] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:33.933237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af9ac-3f68-4f13-8039-6bb80e2df66e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:33.933601 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af9ac-3f68-4f13-8039-6bb80e2df66e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:33.933883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af9ac-3f68-4f13-8039-6bb80e2df66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:33.939576 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3df709-3caa-485b-b2d6-da5e86f4f484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:33.940721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3df709-3caa-485b-b2d6-da5e86f4f484 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:33.941280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3df709-3caa-485b-b2d6-da5e86f4f484 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:33.942528 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3df709-3caa-485b-b2d6-da5e86f4f484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:33.956868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:33.969525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-119af9ac-3f68-4f13-8039-6bb80e2df66e None None] MFA Rules not processed for user `6a58584176e94db59ec78b8885473cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:33.972989 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-119af9ac-3f68-4f13-8039-6bb80e2df66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:34.053720 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3df709-3caa-485b-b2d6-da5e86f4f484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:34.056407 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3df709-3caa-485b-b2d6-da5e86f4f484 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:34.068936 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 813/1650] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:33 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:34.070317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1e44e-af04-410a-896b-2c99052fe33a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:34.070734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1e44e-af04-410a-896b-2c99052fe33a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:34.070942 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1e44e-af04-410a-896b-2c99052fe33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:34.094115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 838/1651] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:34.094115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af9ac-3f68-4f13-8039-6bb80e2df66e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:34.106476 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af9ac-3f68-4f13-8039-6bb80e2df66e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:34.128496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f7d1e44e-af04-410a-896b-2c99052fe33a None None] MFA Rules not processed for user `bf403388dd9240b1966259b4095046d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:34.132736 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f7d1e44e-af04-410a-896b-2c99052fe33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:34.138339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8c4f2-7095-4a6a-b182-26a9b222fd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:34.139485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8c4f2-7095-4a6a-b182-26a9b222fd26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:34.140527 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8c4f2-7095-4a6a-b182-26a9b222fd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:34.141229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8c4f2-7095-4a6a-b182-26a9b222fd26 admin admin] PATH_INFO: `/v3/projects/bf168dcea7184503a3768fc5497cd1b6/users/eca5bf96e11640c8ae848d324bb9a0f1/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:34.147415 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8c4f2-7095-4a6a-b182-26a9b222fd26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf168dcea7184503a3768fc5497cd1b6, user_id=eca5bf96e11640c8ae848d324bb9a0f1, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:34.153063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8c4f2-7095-4a6a-b182-26a9b222fd26 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:34.182093 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 839/1652] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:34 2022] PUT /identity/v3/projects/bf168dcea7184503a3768fc5497cd1b6/users/eca5bf96e11640c8ae848d324bb9a0f1/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:34.182093 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8c4f2-7095-4a6a-b182-26a9b222fd26 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:34.234719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 814/1653] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:34 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:34.235629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1e44e-af04-410a-896b-2c99052fe33a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:34.253247 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1e44e-af04-410a-896b-2c99052fe33a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:34.265224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8c4f2-7095-4a6a-b182-26a9b222fd26 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:34.272659 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc99d4a-b1a0-422e-8140-f8b966630b97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:34.273708 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc99d4a-b1a0-422e-8140-f8b966630b97 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:34.274460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc99d4a-b1a0-422e-8140-f8b966630b97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:34.274844 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc99d4a-b1a0-422e-8140-f8b966630b97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:34.363458 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3cea3-84d1-4793-9f29-b2c93ef0995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:34.364703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3cea3-84d1-4793-9f29-b2c93ef0995e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:34.365098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3cea3-84d1-4793-9f29-b2c93ef0995e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:34.365474 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3cea3-84d1-4793-9f29-b2c93ef0995e admin admin] PATH_INFO: `/v3/users/97cdb445eecb4ef0bd5921e31d1019e1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:34.367028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3cea3-84d1-4793-9f29-b2c93ef0995e admin admin] RBAC: Authorizing `identity:delete_user(user_id=97cdb445eecb4ef0bd5921e31d1019e1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:34.369126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3cea3-84d1-4793-9f29-b2c93ef0995e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:34.369269 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc99d4a-b1a0-422e-8140-f8b966630b97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:34.371120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc99d4a-b1a0-422e-8140-f8b966630b97 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:34.384394 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 840/1654] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:34.385840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811f8ea-9bee-4933-828c-cedfaba89be7 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:34.386142 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811f8ea-9bee-4933-828c-cedfaba89be7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:34.387534 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811f8ea-9bee-4933-828c-cedfaba89be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:34.441570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c811f8ea-9bee-4933-828c-cedfaba89be7 None None] MFA Rules not processed for user `eca5bf96e11640c8ae848d324bb9a0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:34.445093 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c811f8ea-9bee-4933-828c-cedfaba89be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:34.556508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 841/1655] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:34 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:34.557480 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811f8ea-9bee-4933-828c-cedfaba89be7 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:34.573094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811f8ea-9bee-4933-828c-cedfaba89be7 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:34.592096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00cd5f-aab2-4065-9bdb-be1da1c1fdf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:34.594376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00cd5f-aab2-4065-9bdb-be1da1c1fdf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:34.595156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00cd5f-aab2-4065-9bdb-be1da1c1fdf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:34.595783 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00cd5f-aab2-4065-9bdb-be1da1c1fdf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:34.636391 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-90d3cea3-84d1-4793-9f29-b2c93ef0995e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97cdb445eecb4ef0bd5921e31d1019e1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:34.668598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:34.723991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00cd5f-aab2-4065-9bdb-be1da1c1fdf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:34.725622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00cd5f-aab2-4065-9bdb-be1da1c1fdf4 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:34.740006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 842/1656] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:34 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:34.763290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:34.764061 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-90d3cea3-84d1-4793-9f29-b2c93ef0995e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97cdb445eecb4ef0bd5921e31d1019e1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:34.780454 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-90d3cea3-84d1-4793-9f29-b2c93ef0995e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97cdb445eecb4ef0bd5921e31d1019e1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:34.781367 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-90d3cea3-84d1-4793-9f29-b2c93ef0995e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97cdb445eecb4ef0bd5921e31d1019e1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:34.799542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-90d3cea3-84d1-4793-9f29-b2c93ef0995e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97cdb445eecb4ef0bd5921e31d1019e1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:34.808792 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 815/1657] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:40:34 2022] DELETE /identity/v3/users/97cdb445eecb4ef0bd5921e31d1019e1 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:34.813734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c19fc-3766-482a-be35-a8578fe9b799 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:34.814154 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c19fc-3766-482a-be35-a8578fe9b799 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:34.814577 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c19fc-3766-482a-be35-a8578fe9b799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:34.834932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-fb8c19fc-3766-482a-be35-a8578fe9b799 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:34.836391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fb8c19fc-3766-482a-be35-a8578fe9b799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:34.962371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3cea3-84d1-4793-9f29-b2c93ef0995e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:34.964456 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-90d3cea3-84d1-4793-9f29-b2c93ef0995e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:34.983313 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 843/1658] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:35.008699 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c19fc-3766-482a-be35-a8578fe9b799 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:35.010423 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fb8c19fc-3766-482a-be35-a8578fe9b799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:35.064346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3cea3-84d1-4793-9f29-b2c93ef0995e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:35.070524 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6c534-67f6-4188-9c89-ffd2ec046f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:35.073722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6c534-67f6-4188-9c89-ffd2ec046f10 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:35.074679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6c534-67f6-4188-9c89-ffd2ec046f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:35.075783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6c534-67f6-4188-9c89-ffd2ec046f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:35.080175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-85a6c534-67f6-4188-9c89-ffd2ec046f10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:35.159792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c19fc-3766-482a-be35-a8578fe9b799 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:35.164487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07478557-ff5d-4d6d-aa8f-899c6eb3211f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:35.165294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07478557-ff5d-4d6d-aa8f-899c6eb3211f service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:35.169491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07478557-ff5d-4d6d-aa8f-899c6eb3211f service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:35.169491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07478557-ff5d-4d6d-aa8f-899c6eb3211f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:35.180231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07478557-ff5d-4d6d-aa8f-899c6eb3211f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:35.181714 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07478557-ff5d-4d6d-aa8f-899c6eb3211f service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:35.195134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 844/1659] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:40:35.226851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6c534-67f6-4188-9c89-ffd2ec046f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:35.234416 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6c534-67f6-4188-9c89-ffd2ec046f10 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:35.271728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 816/1660] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:34 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:40:35.819301 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07478557-ff5d-4d6d-aa8f-899c6eb3211f service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:35.821059 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-07478557-ff5d-4d6d-aa8f-899c6eb3211f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:35.830752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6c534-67f6-4188-9c89-ffd2ec046f10 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:35.841590 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07478557-ff5d-4d6d-aa8f-899c6eb3211f service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:35.849049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6c534-67f6-4188-9c89-ffd2ec046f10 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:35.855096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa7af4-74d6-4dc6-a183-5d8eacd95875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:35.856604 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa7af4-74d6-4dc6-a183-5d8eacd95875 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:35.857671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa7af4-74d6-4dc6-a183-5d8eacd95875 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:35.859072 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa7af4-74d6-4dc6-a183-5d8eacd95875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:35.867117 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eeca84-63d2-4021-b882-dac2c9a2fa0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:35.867886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1eaa7af4-74d6-4dc6-a183-5d8eacd95875 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:35.868509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eeca84-63d2-4021-b882-dac2c9a2fa0d service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:35.869373 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eeca84-63d2-4021-b882-dac2c9a2fa0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:35.870576 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eeca84-63d2-4021-b882-dac2c9a2fa0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:35.874198 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-83eeca84-63d2-4021-b882-dac2c9a2fa0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:36.055356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:36.067666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa7af4-74d6-4dc6-a183-5d8eacd95875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:36.073711 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa7af4-74d6-4dc6-a183-5d8eacd95875 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:36.083575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eeca84-63d2-4021-b882-dac2c9a2fa0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:36.088482 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:36.091467 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eeca84-63d2-4021-b882-dac2c9a2fa0d service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:36.101726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 845/1661] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:36.112251 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 817/1662] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:35 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:36.399466 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa7af4-74d6-4dc6-a183-5d8eacd95875 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:36.402234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1eaa7af4-74d6-4dc6-a183-5d8eacd95875 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:36.432424 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa7af4-74d6-4dc6-a183-5d8eacd95875 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:36.438292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b41d8-50d8-48c0-8179-ee547dc613d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:36.439413 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b41d8-50d8-48c0-8179-ee547dc613d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:36.439972 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b41d8-50d8-48c0-8179-ee547dc613d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:36.440377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b41d8-50d8-48c0-8179-ee547dc613d3 admin admin] PATH_INFO: `/v3/projects/26c9373ec83b4d298a93cba26351179f` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:36.442451 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b41d8-50d8-48c0-8179-ee547dc613d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c9373ec83b4d298a93cba26351179f)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:36.444820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b41d8-50d8-48c0-8179-ee547dc613d3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:36.616161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-136b41d8-50d8-48c0-8179-ee547dc613d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c9373ec83b4d298a93cba26351179f', 'request_id': 'req-136b41d8-50d8-48c0-8179-ee547dc613d3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:36.623218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-136b41d8-50d8-48c0-8179-ee547dc613d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c9373ec83b4d298a93cba26351179f', 'request_id': 'req-136b41d8-50d8-48c0-8179-ee547dc613d3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:36.628953 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-136b41d8-50d8-48c0-8179-ee547dc613d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c9373ec83b4d298a93cba26351179f', 'request_id': 'req-136b41d8-50d8-48c0-8179-ee547dc613d3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:36.939361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-136b41d8-50d8-48c0-8179-ee547dc613d3 admin admin] The token cache is being invalidate because project 26c9373ec83b4d298a93cba26351179f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:40:36.939969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-136b41d8-50d8-48c0-8179-ee547dc613d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:36.943810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-136b41d8-50d8-48c0-8179-ee547dc613d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:36.948771 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 846/1663] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:40:36 2022] DELETE /identity/v3/projects/26c9373ec83b4d298a93cba26351179f => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:36.956031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471b191-458e-4b9d-8d46-2c28fe0893d8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:36.957223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471b191-458e-4b9d-8d46-2c28fe0893d8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:36.958669 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471b191-458e-4b9d-8d46-2c28fe0893d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:37.012145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c471b191-458e-4b9d-8d46-2c28fe0893d8 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:37.012145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c471b191-458e-4b9d-8d46-2c28fe0893d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:37.184380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 818/1664] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:37.185099 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e24d-9dc6-49e0-b643-f22cc59a51e7 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:37.185570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e24d-9dc6-49e0-b643-f22cc59a51e7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:37.185792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e24d-9dc6-49e0-b643-f22cc59a51e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:37.258485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-9a85e24d-9dc6-49e0-b643-f22cc59a51e7 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:37.258485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9a85e24d-9dc6-49e0-b643-f22cc59a51e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:37.305113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 847/1665] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:37.312466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471b191-458e-4b9d-8d46-2c28fe0893d8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:37.340605 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471b191-458e-4b9d-8d46-2c28fe0893d8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:37.374765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f46613-2dcf-4571-8986-1db464694945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:37.375552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f46613-2dcf-4571-8986-1db464694945 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:37.375843 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f46613-2dcf-4571-8986-1db464694945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:37.376124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f46613-2dcf-4571-8986-1db464694945 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:37.377010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f46613-2dcf-4571-8986-1db464694945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:40:37.378438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e24d-9dc6-49e0-b643-f22cc59a51e7 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:37.380420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9a85e24d-9dc6-49e0-b643-f22cc59a51e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:37.383490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f46613-2dcf-4571-8986-1db464694945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:37.386291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f46613-2dcf-4571-8986-1db464694945 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:37.406639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 819/1666] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:40:37.412022 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f46613-2dcf-4571-8986-1db464694945 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:37.428228 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f46613-2dcf-4571-8986-1db464694945 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:37.434653 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32741c15-2b65-4ebb-9e4f-75a3d584452e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:37.440160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32741c15-2b65-4ebb-9e4f-75a3d584452e admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:37.440160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32741c15-2b65-4ebb-9e4f-75a3d584452e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:37.440160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32741c15-2b65-4ebb-9e4f-75a3d584452e admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:37.440160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32741c15-2b65-4ebb-9e4f-75a3d584452e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:37.442531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32741c15-2b65-4ebb-9e4f-75a3d584452e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:37.512686 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e24d-9dc6-49e0-b643-f22cc59a51e7 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:37.526592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6ee6a-d09e-4a7b-ba47-b368abdbb735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:37.530793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6ee6a-d09e-4a7b-ba47-b368abdbb735 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:37.531211 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6ee6a-d09e-4a7b-ba47-b368abdbb735 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:37.531601 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6ee6a-d09e-4a7b-ba47-b368abdbb735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:37.539310 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-60c6ee6a-d09e-4a7b-ba47-b368abdbb735 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:37.622074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 820/1667] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:37 2022] POST /identity/v3/projects => generated 403 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:37.626833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32741c15-2b65-4ebb-9e4f-75a3d584452e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:37.779944 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6ee6a-d09e-4a7b-ba47-b368abdbb735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:37.783769 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6ee6a-d09e-4a7b-ba47-b368abdbb735 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:37.801293 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 848/1668] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:37.822558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32741c15-2b65-4ebb-9e4f-75a3d584452e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:37.836292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf2736-4f12-4510-ad1f-bec6fa149272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:37.837325 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2736-4f12-4510-ad1f-bec6fa149272 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:37.837768 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2736-4f12-4510-ad1f-bec6fa149272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:37.838198 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2736-4f12-4510-ad1f-bec6fa149272 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:37.839077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf2736-4f12-4510-ad1f-bec6fa149272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:37.841383 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf2736-4f12-4510-ad1f-bec6fa149272 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:38.023840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 821/1669] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:37 2022] POST /identity/v3/users => generated 302 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:38.028065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6ee6a-d09e-4a7b-ba47-b368abdbb735 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:38.056053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6ee6a-d09e-4a7b-ba47-b368abdbb735 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:38.072094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462eb5a-a083-41dc-b146-3fbcd6a42657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:38.073026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462eb5a-a083-41dc-b146-3fbcd6a42657 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:38.074877 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462eb5a-a083-41dc-b146-3fbcd6a42657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:38.076555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462eb5a-a083-41dc-b146-3fbcd6a42657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:38.077438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462eb5a-a083-41dc-b146-3fbcd6a42657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:38.085363 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462eb5a-a083-41dc-b146-3fbcd6a42657 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:38.109024 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 849/1670] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:38.110671 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf2736-4f12-4510-ad1f-bec6fa149272 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:38.125587 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf2736-4f12-4510-ad1f-bec6fa149272 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:38.134517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8419c2c-730a-4c0e-8d63-bbafb6ec4e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:38.135451 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8419c2c-730a-4c0e-8d63-bbafb6ec4e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:38.135747 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8419c2c-730a-4c0e-8d63-bbafb6ec4e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:38.136147 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8419c2c-730a-4c0e-8d63-bbafb6ec4e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:38.137123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8419c2c-730a-4c0e-8d63-bbafb6ec4e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:38.138933 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8419c2c-730a-4c0e-8d63-bbafb6ec4e89 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:38.164742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 822/1671] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:38.166429 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462eb5a-a083-41dc-b146-3fbcd6a42657 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:38.189042 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462eb5a-a083-41dc-b146-3fbcd6a42657 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:38.207391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f73334-6a94-4aa5-b27b-0e90fa1cdc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:38.208491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73334-6a94-4aa5-b27b-0e90fa1cdc30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:38.208853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73334-6a94-4aa5-b27b-0e90fa1cdc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:38.209352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73334-6a94-4aa5-b27b-0e90fa1cdc30 admin admin] PATH_INFO: `/v3/projects/aac48eec80c9497cb56743547a708d06/users/8515c0beaca74b0386ec86f4ab21dd0c/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:38.242389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f73334-6a94-4aa5-b27b-0e90fa1cdc30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac48eec80c9497cb56743547a708d06, user_id=8515c0beaca74b0386ec86f4ab21dd0c, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:38.245998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f73334-6a94-4aa5-b27b-0e90fa1cdc30 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:38.277056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:38.450628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 850/1672] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:38 2022] PUT /identity/v3/projects/aac48eec80c9497cb56743547a708d06/users/8515c0beaca74b0386ec86f4ab21dd0c/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:38.466165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5aa8f-6672-4697-890b-29d1ce19e047 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:38.466839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5aa8f-6672-4697-890b-29d1ce19e047 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:38.467273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5aa8f-6672-4697-890b-29d1ce19e047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:38.561876 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-74d5aa8f-6672-4697-890b-29d1ce19e047 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:38.588209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-74d5aa8f-6672-4697-890b-29d1ce19e047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:38.722880 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 823/1673] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:38.732039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f73334-6a94-4aa5-b27b-0e90fa1cdc30 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:38.736396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d1f73334-6a94-4aa5-b27b-0e90fa1cdc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:38.883763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f73334-6a94-4aa5-b27b-0e90fa1cdc30 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:38.888138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c4ff0-d210-4492-a89b-a05ca3878d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:38.888934 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c4ff0-d210-4492-a89b-a05ca3878d8a service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:38.889513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c4ff0-d210-4492-a89b-a05ca3878d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:38.889623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c4ff0-d210-4492-a89b-a05ca3878d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:38.906601 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c4ff0-d210-4492-a89b-a05ca3878d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:38.908250 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c4ff0-d210-4492-a89b-a05ca3878d8a service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:38.931295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 851/1674] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:39.467822 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5aa8f-6672-4697-890b-29d1ce19e047 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:39.469950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-74d5aa8f-6672-4697-890b-29d1ce19e047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:39.501242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5aa8f-6672-4697-890b-29d1ce19e047 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:39.514073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdba9b-0b19-4230-903e-2fe151a4f9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:39.515149 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdba9b-0b19-4230-903e-2fe151a4f9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:39.515447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdba9b-0b19-4230-903e-2fe151a4f9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:39.515869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdba9b-0b19-4230-903e-2fe151a4f9aa admin admin] PATH_INFO: `/v3/users/b2f5648e857a43e29b24d50918ad73b8` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:39.522752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdba9b-0b19-4230-903e-2fe151a4f9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f5648e857a43e29b24d50918ad73b8)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:39.525364 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdba9b-0b19-4230-903e-2fe151a4f9aa admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:39.835266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8abdba9b-0b19-4230-903e-2fe151a4f9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f5648e857a43e29b24d50918ad73b8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:39.958292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8abdba9b-0b19-4230-903e-2fe151a4f9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f5648e857a43e29b24d50918ad73b8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:39.986938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8abdba9b-0b19-4230-903e-2fe151a4f9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f5648e857a43e29b24d50918ad73b8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:39.988843 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8abdba9b-0b19-4230-903e-2fe151a4f9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f5648e857a43e29b24d50918ad73b8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:40.043105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8abdba9b-0b19-4230-903e-2fe151a4f9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f5648e857a43e29b24d50918ad73b8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:40.068903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 824/1675] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:40:39 2022] DELETE /identity/v3/users/b2f5648e857a43e29b24d50918ad73b8 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:40.070498 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c1310-0557-48ff-8f76-25933e7d7b44 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:40.071249 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c1310-0557-48ff-8f76-25933e7d7b44 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:40.071249 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c1310-0557-48ff-8f76-25933e7d7b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:40.107753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-488c1310-0557-48ff-8f76-25933e7d7b44 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:40.109085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-488c1310-0557-48ff-8f76-25933e7d7b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:40.210508 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:40.245317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 852/1676] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:40.255914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdba9b-0b19-4230-903e-2fe151a4f9aa admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:40.257496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8abdba9b-0b19-4230-903e-2fe151a4f9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:40.319491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:40.400764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdba9b-0b19-4230-903e-2fe151a4f9aa admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:40.405418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e9e66-3293-4909-a540-68a186106619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:40.406168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e9e66-3293-4909-a540-68a186106619 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:40.406581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e9e66-3293-4909-a540-68a186106619 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:40.408130 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e9e66-3293-4909-a540-68a186106619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:40.430419 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e9e66-3293-4909-a540-68a186106619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:40.438191 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e9e66-3293-4909-a540-68a186106619 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:40.453675 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 825/1677] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:41.678727 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c1310-0557-48ff-8f76-25933e7d7b44 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:41.680226 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-488c1310-0557-48ff-8f76-25933e7d7b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:41.700076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c1310-0557-48ff-8f76-25933e7d7b44 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:41.708210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa01960-bdd9-4aab-8a1f-7dbb06ae08e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:41.710245 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa01960-bdd9-4aab-8a1f-7dbb06ae08e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:41.725338 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa01960-bdd9-4aab-8a1f-7dbb06ae08e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:41.725631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa01960-bdd9-4aab-8a1f-7dbb06ae08e3 admin admin] PATH_INFO: `/v3/projects/9a26bcf2db1040639fa8213833317a69` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:41.730823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa01960-bdd9-4aab-8a1f-7dbb06ae08e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a26bcf2db1040639fa8213833317a69)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:41.741459 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa01960-bdd9-4aab-8a1f-7dbb06ae08e3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:42.016671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dfa01960-bdd9-4aab-8a1f-7dbb06ae08e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a26bcf2db1040639fa8213833317a69', 'request_id': 'req-dfa01960-bdd9-4aab-8a1f-7dbb06ae08e3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:42.027396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dfa01960-bdd9-4aab-8a1f-7dbb06ae08e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a26bcf2db1040639fa8213833317a69', 'request_id': 'req-dfa01960-bdd9-4aab-8a1f-7dbb06ae08e3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:42.039235 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dfa01960-bdd9-4aab-8a1f-7dbb06ae08e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a26bcf2db1040639fa8213833317a69', 'request_id': 'req-dfa01960-bdd9-4aab-8a1f-7dbb06ae08e3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:42.217886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dfa01960-bdd9-4aab-8a1f-7dbb06ae08e3 admin admin] The token cache is being invalidate because project 9a26bcf2db1040639fa8213833317a69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:40:42.218954 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dfa01960-bdd9-4aab-8a1f-7dbb06ae08e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:42.220158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dfa01960-bdd9-4aab-8a1f-7dbb06ae08e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:42.223091 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 853/1678] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:40:41 2022] DELETE /identity/v3/projects/9a26bcf2db1040639fa8213833317a69 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:42.227331 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e9e66-3293-4909-a540-68a186106619 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:42.239204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e9e66-3293-4909-a540-68a186106619 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:42.373892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd97d46-469b-4ccf-b12c-3738914a6775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:42.375458 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd97d46-469b-4ccf-b12c-3738914a6775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:42.376108 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd97d46-469b-4ccf-b12c-3738914a6775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:42.376578 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd97d46-469b-4ccf-b12c-3738914a6775 admin admin] PATH_INFO: `/v3/users/0d3e6db566004e6bbb31ea28e4519b10` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:42.389028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd97d46-469b-4ccf-b12c-3738914a6775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3e6db566004e6bbb31ea28e4519b10)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:42.403058 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd97d46-469b-4ccf-b12c-3738914a6775 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:42.415552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:42.873845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0dd97d46-469b-4ccf-b12c-3738914a6775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3e6db566004e6bbb31ea28e4519b10'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:43.015422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0dd97d46-469b-4ccf-b12c-3738914a6775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3e6db566004e6bbb31ea28e4519b10'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:43.045488 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0dd97d46-469b-4ccf-b12c-3738914a6775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3e6db566004e6bbb31ea28e4519b10'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:43.050659 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0dd97d46-469b-4ccf-b12c-3738914a6775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3e6db566004e6bbb31ea28e4519b10'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:43.111770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0dd97d46-469b-4ccf-b12c-3738914a6775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3e6db566004e6bbb31ea28e4519b10'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:43.153854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 826/1679] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:40:42 2022] DELETE /identity/v3/users/0d3e6db566004e6bbb31ea28e4519b10 => generated 0 bytes in 927 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:43.473562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c330a-f066-41c1-891c-7760edbfc82b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:43.474203 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c330a-f066-41c1-891c-7760edbfc82b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:43.474633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c330a-f066-41c1-891c-7760edbfc82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:43.540971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5f9c330a-f066-41c1-891c-7760edbfc82b None None] MFA Rules not processed for user `8515c0beaca74b0386ec86f4ab21dd0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:43.546754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5f9c330a-f066-41c1-891c-7760edbfc82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:43.789413 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 854/1680] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:43.792840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd97d46-469b-4ccf-b12c-3738914a6775 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:43.792840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0dd97d46-469b-4ccf-b12c-3738914a6775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:43.813202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:43.971684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd97d46-469b-4ccf-b12c-3738914a6775 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:43.980124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c330a-f066-41c1-891c-7760edbfc82b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:43.982770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5f9c330a-f066-41c1-891c-7760edbfc82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:43.993748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9781731-800b-4e0d-9b4e-868bcf058dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:43.994584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9781731-800b-4e0d-9b4e-868bcf058dae admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:43.996425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9781731-800b-4e0d-9b4e-868bcf058dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:43.996971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9781731-800b-4e0d-9b4e-868bcf058dae admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:43.999979 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9781731-800b-4e0d-9b4e-868bcf058dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:44.008993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9781731-800b-4e0d-9b4e-868bcf058dae admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:44.019997 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c330a-f066-41c1-891c-7760edbfc82b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:44.032184 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384bb39-97ce-4fd6-976e-b62a0504a453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:44.035071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384bb39-97ce-4fd6-976e-b62a0504a453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:44.035500 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384bb39-97ce-4fd6-976e-b62a0504a453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:44.035914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384bb39-97ce-4fd6-976e-b62a0504a453 admin admin] PATH_INFO: `/v3/users/fc0bed9775be4a6bac89e8c34930bd69` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:44.039687 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384bb39-97ce-4fd6-976e-b62a0504a453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc0bed9775be4a6bac89e8c34930bd69)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:44.056946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: WARNING py.warnings [None req-2384bb39-97ce-4fd6-976e-b62a0504a453 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:40:44.056946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: warnings.warn(msg) Jul 18 10:40:44.056946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: Jul 18 10:40:44.061104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384bb39-97ce-4fd6-976e-b62a0504a453 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:44.210411 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 827/1681] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:43 2022] POST /identity/v3/projects => generated 405 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:44.216394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9781731-800b-4e0d-9b4e-868bcf058dae admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:44.421790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2384bb39-97ce-4fd6-976e-b62a0504a453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc0bed9775be4a6bac89e8c34930bd69'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:44.463777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9781731-800b-4e0d-9b4e-868bcf058dae admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:44.470561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345760e-6937-4428-81dc-806af4548eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:44.472324 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345760e-6937-4428-81dc-806af4548eeb admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:44.473830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345760e-6937-4428-81dc-806af4548eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:44.474534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345760e-6937-4428-81dc-806af4548eeb admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:44.481334 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345760e-6937-4428-81dc-806af4548eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:44.481334 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345760e-6937-4428-81dc-806af4548eeb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:44.504813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2384bb39-97ce-4fd6-976e-b62a0504a453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc0bed9775be4a6bac89e8c34930bd69'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:44.535043 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:44.542243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2384bb39-97ce-4fd6-976e-b62a0504a453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc0bed9775be4a6bac89e8c34930bd69'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:44.550855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2384bb39-97ce-4fd6-976e-b62a0504a453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc0bed9775be4a6bac89e8c34930bd69'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:44.588232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2384bb39-97ce-4fd6-976e-b62a0504a453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc0bed9775be4a6bac89e8c34930bd69'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:44.606110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 855/1682] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:40:43 2022] DELETE /identity/v3/users/fc0bed9775be4a6bac89e8c34930bd69 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:44.608219 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935937e7-e977-48e6-898a-e7f5c30a73e3 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:44.608684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935937e7-e977-48e6-898a-e7f5c30a73e3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:44.609102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935937e7-e977-48e6-898a-e7f5c30a73e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:44.631517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 828/1683] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:44 2022] POST /identity/v3/users => generated 309 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:44.633055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345760e-6937-4428-81dc-806af4548eeb admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:44.660002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c345760e-6937-4428-81dc-806af4548eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:44.691140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-935937e7-e977-48e6-898a-e7f5c30a73e3 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:44.692411 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-935937e7-e977-48e6-898a-e7f5c30a73e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:44.697508 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345760e-6937-4428-81dc-806af4548eeb admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:44.849564 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c26958-b704-4508-85f2-03334ef58c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:44.850699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c26958-b704-4508-85f2-03334ef58c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:44.850699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c26958-b704-4508-85f2-03334ef58c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:44.850970 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c26958-b704-4508-85f2-03334ef58c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:44.851567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c26958-b704-4508-85f2-03334ef58c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:44.854270 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c26958-b704-4508-85f2-03334ef58c80 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:44.861886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 856/1684] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:44.876402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935937e7-e977-48e6-898a-e7f5c30a73e3 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:44.878075 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-935937e7-e977-48e6-898a-e7f5c30a73e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:44.908587 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935937e7-e977-48e6-898a-e7f5c30a73e3 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:44.914722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 829/1685] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:44.922975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c26958-b704-4508-85f2-03334ef58c80 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:44.923854 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895e468-73bf-4913-809f-d4c9e4a95a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:44.925124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895e468-73bf-4913-809f-d4c9e4a95a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:44.928312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895e468-73bf-4913-809f-d4c9e4a95a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:44.928869 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895e468-73bf-4913-809f-d4c9e4a95a9a admin admin] PATH_INFO: `/v3/users/9e3bf1a14a424ccba70736a43cd888e1` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:44.931398 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895e468-73bf-4913-809f-d4c9e4a95a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e3bf1a14a424ccba70736a43cd888e1)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:44.934220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895e468-73bf-4913-809f-d4c9e4a95a9a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:45.027546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c26958-b704-4508-85f2-03334ef58c80 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:45.057024 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec3d7a-f5e3-47d4-a9c5-10d3681b2314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:45.057991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec3d7a-f5e3-47d4-a9c5-10d3681b2314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:45.058568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec3d7a-f5e3-47d4-a9c5-10d3681b2314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:45.058568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec3d7a-f5e3-47d4-a9c5-10d3681b2314 admin admin] PATH_INFO: `/v3/projects/81ee583328be46fa83e89b5383174ea6/users/840ab240b66e4872b86940192e3ddc28/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:45.112823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec3d7a-f5e3-47d4-a9c5-10d3681b2314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ee583328be46fa83e89b5383174ea6, user_id=840ab240b66e4872b86940192e3ddc28, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:45.116645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec3d7a-f5e3-47d4-a9c5-10d3681b2314 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:45.253295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 830/1686] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:44 2022] PUT /identity/v3/projects/81ee583328be46fa83e89b5383174ea6/users/840ab240b66e4872b86940192e3ddc28/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:45.254254 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec3d7a-f5e3-47d4-a9c5-10d3681b2314 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:45.259022 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-58ec3d7a-f5e3-47d4-a9c5-10d3681b2314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:45.277830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1895e468-73bf-4913-809f-d4c9e4a95a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3bf1a14a424ccba70736a43cd888e1'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:45.380144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1895e468-73bf-4913-809f-d4c9e4a95a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3bf1a14a424ccba70736a43cd888e1'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:45.396190 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1895e468-73bf-4913-809f-d4c9e4a95a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3bf1a14a424ccba70736a43cd888e1'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:45.397381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1895e468-73bf-4913-809f-d4c9e4a95a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3bf1a14a424ccba70736a43cd888e1'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:45.430249 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1895e468-73bf-4913-809f-d4c9e4a95a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3bf1a14a424ccba70736a43cd888e1'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:45.451783 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 857/1687] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:40:44 2022] DELETE /identity/v3/users/9e3bf1a14a424ccba70736a43cd888e1 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:45.452780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895e468-73bf-4913-809f-d4c9e4a95a9a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:45.452975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec3d7a-f5e3-47d4-a9c5-10d3681b2314 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:45.454161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1895e468-73bf-4913-809f-d4c9e4a95a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:45.611032 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61743e4f-fb36-46d6-ab80-e0f654694016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:45.617334 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61743e4f-fb36-46d6-ab80-e0f654694016 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:45.617624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61743e4f-fb36-46d6-ab80-e0f654694016 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:45.617904 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61743e4f-fb36-46d6-ab80-e0f654694016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:45.621076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-61743e4f-fb36-46d6-ab80-e0f654694016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:45.637054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:45.780439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895e468-73bf-4913-809f-d4c9e4a95a9a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:45.800214 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ea003-c4d1-448f-8a6e-3fffd8b5fc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:45.800917 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ea003-c4d1-448f-8a6e-3fffd8b5fc85 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:45.801746 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ea003-c4d1-448f-8a6e-3fffd8b5fc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:45.802039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ea003-c4d1-448f-8a6e-3fffd8b5fc85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:45.802824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ea003-c4d1-448f-8a6e-3fffd8b5fc85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:45.804925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ea003-c4d1-448f-8a6e-3fffd8b5fc85 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:45.836576 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61743e4f-fb36-46d6-ab80-e0f654694016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:45.842048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61743e4f-fb36-46d6-ab80-e0f654694016 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:45.851640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 858/1688] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:45.854611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed3893-648b-451d-b1ca-71d033e47f40 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:45.859055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed3893-648b-451d-b1ca-71d033e47f40 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:45.863939 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed3893-648b-451d-b1ca-71d033e47f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:45.876212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 831/1689] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:45.879179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf7427-9b2b-477d-96d0-881b77461a27 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:45.881235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf7427-9b2b-477d-96d0-881b77461a27 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:45.881685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf7427-9b2b-477d-96d0-881b77461a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:45.899964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-84ed3893-648b-451d-b1ca-71d033e47f40 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:45.905235 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-84ed3893-648b-451d-b1ca-71d033e47f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:45.923481 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 859/1690] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:45.924347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed3893-648b-451d-b1ca-71d033e47f40 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:45.963006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed3893-648b-451d-b1ca-71d033e47f40 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:45.967876 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-96bf7427-9b2b-477d-96d0-881b77461a27 None None] MFA Rules not processed for user `649b66b27ef44ad5b218f6e8bb790963`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:45.970848 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-96bf7427-9b2b-477d-96d0-881b77461a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:45.976451 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa25ea-fbed-4035-ae0a-0edac58c8f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:45.979953 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa25ea-fbed-4035-ae0a-0edac58c8f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:45.983075 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa25ea-fbed-4035-ae0a-0edac58c8f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:45.983843 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa25ea-fbed-4035-ae0a-0edac58c8f25 admin admin] PATH_INFO: `/v3/projects/81ee583328be46fa83e89b5383174ea6/users/840ab240b66e4872b86940192e3ddc28/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:45.991824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa25ea-fbed-4035-ae0a-0edac58c8f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ee583328be46fa83e89b5383174ea6, user_id=840ab240b66e4872b86940192e3ddc28, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:45.996140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa25ea-fbed-4035-ae0a-0edac58c8f25 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:46.055339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 860/1691] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:45 2022] PUT /identity/v3/projects/81ee583328be46fa83e89b5383174ea6/users/840ab240b66e4872b86940192e3ddc28/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:46.068008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa25ea-fbed-4035-ae0a-0edac58c8f25 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:46.087290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c5fa25ea-fbed-4035-ae0a-0edac58c8f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:46.089922 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 832/1692] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:46.105978 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf7427-9b2b-477d-96d0-881b77461a27 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:46.107659 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-96bf7427-9b2b-477d-96d0-881b77461a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:46.300881 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa25ea-fbed-4035-ae0a-0edac58c8f25 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:46.315486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc252c-1e4a-440c-8e63-9346657edfe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:46.322253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc252c-1e4a-440c-8e63-9346657edfe9 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:46.322253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc252c-1e4a-440c-8e63-9346657edfe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:46.322253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc252c-1e4a-440c-8e63-9346657edfe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:46.324213 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf7427-9b2b-477d-96d0-881b77461a27 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:46.439364 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262ea59-6549-467c-9f84-5c6f4877e090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:46.440393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262ea59-6549-467c-9f84-5c6f4877e090 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:46.440866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262ea59-6549-467c-9f84-5c6f4877e090 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:46.441340 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262ea59-6549-467c-9f84-5c6f4877e090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:46.534743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc252c-1e4a-440c-8e63-9346657edfe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:46.539724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc252c-1e4a-440c-8e63-9346657edfe9 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:46.572707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 861/1693] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:46.575334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc252c-1e4a-440c-8e63-9346657edfe9 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:46.580789 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d3bc252c-1e4a-440c-8e63-9346657edfe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:46.594218 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262ea59-6549-467c-9f84-5c6f4877e090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:46.602481 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262ea59-6549-467c-9f84-5c6f4877e090 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:46.604137 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc252c-1e4a-440c-8e63-9346657edfe9 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:46.609527 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e6b21-f9d1-41f1-82a3-f97fdb7b2b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:46.610508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e6b21-f9d1-41f1-82a3-f97fdb7b2b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:46.610798 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e6b21-f9d1-41f1-82a3-f97fdb7b2b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:46.611076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e6b21-f9d1-41f1-82a3-f97fdb7b2b8e admin admin] PATH_INFO: `/v3/projects/dfa294e3d24f4560b4dec757ee0d86a8` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:46.612508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e6b21-f9d1-41f1-82a3-f97fdb7b2b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa294e3d24f4560b4dec757ee0d86a8)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:46.616241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e6b21-f9d1-41f1-82a3-f97fdb7b2b8e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:46.624643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 833/1694] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:40:46.898688 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c15e6b21-f9d1-41f1-82a3-f97fdb7b2b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa294e3d24f4560b4dec757ee0d86a8', 'request_id': 'req-c15e6b21-f9d1-41f1-82a3-f97fdb7b2b8e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:46.919347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c15e6b21-f9d1-41f1-82a3-f97fdb7b2b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa294e3d24f4560b4dec757ee0d86a8', 'request_id': 'req-c15e6b21-f9d1-41f1-82a3-f97fdb7b2b8e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:46.937674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c15e6b21-f9d1-41f1-82a3-f97fdb7b2b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa294e3d24f4560b4dec757ee0d86a8', 'request_id': 'req-c15e6b21-f9d1-41f1-82a3-f97fdb7b2b8e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:47.059268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c15e6b21-f9d1-41f1-82a3-f97fdb7b2b8e admin admin] The token cache is being invalidate because project dfa294e3d24f4560b4dec757ee0d86a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:40:47.059874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c15e6b21-f9d1-41f1-82a3-f97fdb7b2b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:47.061565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c15e6b21-f9d1-41f1-82a3-f97fdb7b2b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:47.069495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 862/1695] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:40:46 2022] DELETE /identity/v3/projects/dfa294e3d24f4560b4dec757ee0d86a8 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:47.074861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0e382-0a67-4d95-ae2a-0c8585102ec2 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:47.075854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0e382-0a67-4d95-ae2a-0c8585102ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:47.076445 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0e382-0a67-4d95-ae2a-0c8585102ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:47.144055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-43b0e382-0a67-4d95-ae2a-0c8585102ec2 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:47.147144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-43b0e382-0a67-4d95-ae2a-0c8585102ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:47.298379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:47.320262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 834/1696] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:47.328398 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637a95f-abf0-42ad-aa2b-51a568abf0a1 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:47.328689 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637a95f-abf0-42ad-aa2b-51a568abf0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:47.328966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637a95f-abf0-42ad-aa2b-51a568abf0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:47.365321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a637a95f-abf0-42ad-aa2b-51a568abf0a1 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:47.375694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a637a95f-abf0-42ad-aa2b-51a568abf0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:47.404909 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 863/1697] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:47.411501 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0e382-0a67-4d95-ae2a-0c8585102ec2 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:47.429428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0e382-0a67-4d95-ae2a-0c8585102ec2 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:47.455311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03d073-6465-47d6-9129-b3095a74a856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:47.461661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03d073-6465-47d6-9129-b3095a74a856 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:47.461661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03d073-6465-47d6-9129-b3095a74a856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:47.461661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03d073-6465-47d6-9129-b3095a74a856 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:47.461661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03d073-6465-47d6-9129-b3095a74a856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:40:47.461661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03d073-6465-47d6-9129-b3095a74a856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:47.465832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03d073-6465-47d6-9129-b3095a74a856 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:47.504987 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 835/1698] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:40:47.512411 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637a95f-abf0-42ad-aa2b-51a568abf0a1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:47.534061 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637a95f-abf0-42ad-aa2b-51a568abf0a1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:47.542211 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af6f29-19cd-43ea-bbfa-144b418efd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:47.552937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af6f29-19cd-43ea-bbfa-144b418efd09 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:47.552937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af6f29-19cd-43ea-bbfa-144b418efd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:47.552937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af6f29-19cd-43ea-bbfa-144b418efd09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:47.552937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af6f29-19cd-43ea-bbfa-144b418efd09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:47.552937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af6f29-19cd-43ea-bbfa-144b418efd09 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:47.610117 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03d073-6465-47d6-9129-b3095a74a856 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:47.610117 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1d03d073-6465-47d6-9129-b3095a74a856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:47.623280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03d073-6465-47d6-9129-b3095a74a856 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:47.649976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:47.650927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:47.651215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:47.651495 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] PATH_INFO: `/v3/projects/82a82fb4b6414d1788830f8bdb20204a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:47.658225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82a82fb4b6414d1788830f8bdb20204a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:47.658534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: WARNING py.warnings [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:40:47.658534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: warnings.warn(msg) Jul 18 10:40:47.658534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: Jul 18 10:40:47.669831 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:47.889032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 864/1699] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:47 2022] POST /identity/v3/projects => generated 363 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:47.893932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af6f29-19cd-43ea-bbfa-144b418efd09 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:48.051497 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a82fb4b6414d1788830f8bdb20204a', 'request_id': 'req-f2777c0a-be7b-4a83-bc95-a72a114daa36'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:48.072000 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a82fb4b6414d1788830f8bdb20204a', 'request_id': 'req-f2777c0a-be7b-4a83-bc95-a72a114daa36'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:48.075553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af6f29-19cd-43ea-bbfa-144b418efd09 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:48.097897 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a82fb4b6414d1788830f8bdb20204a', 'request_id': 'req-f2777c0a-be7b-4a83-bc95-a72a114daa36'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:48.238101 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c3f7b-cb17-4693-a491-129c6b530a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:48.239072 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c3f7b-cb17-4693-a491-129c6b530a1f admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:48.239565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c3f7b-cb17-4693-a491-129c6b530a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:48.239951 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c3f7b-cb17-4693-a491-129c6b530a1f admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:48.240793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c3f7b-cb17-4693-a491-129c6b530a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:48.245795 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c3f7b-cb17-4693-a491-129c6b530a1f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:48.247911 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] The token cache is being invalidate because project 82a82fb4b6414d1788830f8bdb20204a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:40:48.249134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:48.252596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:48.261054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 836/1700] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:40:47 2022] DELETE /identity/v3/projects/82a82fb4b6414d1788830f8bdb20204a => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:40:48.270472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:48.274740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:48.320289 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2777c0a-be7b-4a83-bc95-a72a114daa36 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:48.335954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9bbc81-6875-47f0-a636-a96d70500bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:48.338056 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bbc81-6875-47f0-a636-a96d70500bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:48.338485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bbc81-6875-47f0-a636-a96d70500bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:48.341057 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bbc81-6875-47f0-a636-a96d70500bcc admin admin] PATH_INFO: `/v3/projects/a062a166125e4d0c9086fc16d8215615` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:48.342952 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9bbc81-6875-47f0-a636-a96d70500bcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a062a166125e4d0c9086fc16d8215615)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:48.347309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9bbc81-6875-47f0-a636-a96d70500bcc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:48.404920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 865/1701] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:47 2022] POST /identity/v3/users => generated 282 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:40:48.407647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c3f7b-cb17-4693-a491-129c6b530a1f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:48.422299 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-460c3f7b-cb17-4693-a491-129c6b530a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:48.505871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c3f7b-cb17-4693-a491-129c6b530a1f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:48.526082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c768b2e-be65-435a-be61-cd3aff49608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:48.533391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c768b2e-be65-435a-be61-cd3aff49608d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:48.534132 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c768b2e-be65-435a-be61-cd3aff49608d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:48.534824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c768b2e-be65-435a-be61-cd3aff49608d admin admin] PATH_INFO: `/v3/users/6a58584176e94db59ec78b8885473cdf` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:48.541312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c768b2e-be65-435a-be61-cd3aff49608d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a58584176e94db59ec78b8885473cdf)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:48.549721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c768b2e-be65-435a-be61-cd3aff49608d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:48.558310 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ca9bbc81-6875-47f0-a636-a96d70500bcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a062a166125e4d0c9086fc16d8215615', 'request_id': 'req-ca9bbc81-6875-47f0-a636-a96d70500bcc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:48.579833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ca9bbc81-6875-47f0-a636-a96d70500bcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a062a166125e4d0c9086fc16d8215615', 'request_id': 'req-ca9bbc81-6875-47f0-a636-a96d70500bcc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:48.595423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ca9bbc81-6875-47f0-a636-a96d70500bcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a062a166125e4d0c9086fc16d8215615', 'request_id': 'req-ca9bbc81-6875-47f0-a636-a96d70500bcc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:48.680738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ca9bbc81-6875-47f0-a636-a96d70500bcc admin admin] The token cache is being invalidate because project a062a166125e4d0c9086fc16d8215615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:40:48.681034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ca9bbc81-6875-47f0-a636-a96d70500bcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:48.681726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ca9bbc81-6875-47f0-a636-a96d70500bcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:48.684288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 837/1702] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:40:48 2022] DELETE /identity/v3/projects/a062a166125e4d0c9086fc16d8215615 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:48.685282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9bbc81-6875-47f0-a636-a96d70500bcc admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:48.695584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ca9bbc81-6875-47f0-a636-a96d70500bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:48.827337 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:48.842938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9bbc81-6875-47f0-a636-a96d70500bcc admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:48.850726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fa97a-0631-42bd-a388-e7248d97ce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:48.851698 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fa97a-0631-42bd-a388-e7248d97ce9f admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:48.852160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fa97a-0631-42bd-a388-e7248d97ce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:48.852670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fa97a-0631-42bd-a388-e7248d97ce9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:48.852779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6c768b2e-be65-435a-be61-cd3aff49608d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a58584176e94db59ec78b8885473cdf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:48.853697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fa97a-0631-42bd-a388-e7248d97ce9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:48.856989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fa97a-0631-42bd-a388-e7248d97ce9f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:48.873993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 838/1703] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:48.875791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fa97a-0631-42bd-a388-e7248d97ce9f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:48.878181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8c7fa97a-0631-42bd-a388-e7248d97ce9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:48.901413 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fa97a-0631-42bd-a388-e7248d97ce9f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:48.912586 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86197b5-b0cc-431b-9b6f-3e94e6a63202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:48.913719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86197b5-b0cc-431b-9b6f-3e94e6a63202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:48.914198 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86197b5-b0cc-431b-9b6f-3e94e6a63202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:48.914643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86197b5-b0cc-431b-9b6f-3e94e6a63202 admin admin] PATH_INFO: `/v3/users/eca5bf96e11640c8ae848d324bb9a0f1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:48.916958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86197b5-b0cc-431b-9b6f-3e94e6a63202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eca5bf96e11640c8ae848d324bb9a0f1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:48.920550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86197b5-b0cc-431b-9b6f-3e94e6a63202 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:48.934121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6c768b2e-be65-435a-be61-cd3aff49608d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a58584176e94db59ec78b8885473cdf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:48.951578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6c768b2e-be65-435a-be61-cd3aff49608d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a58584176e94db59ec78b8885473cdf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:48.954643 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6c768b2e-be65-435a-be61-cd3aff49608d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a58584176e94db59ec78b8885473cdf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:48.987082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6c768b2e-be65-435a-be61-cd3aff49608d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a58584176e94db59ec78b8885473cdf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:49.000603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 866/1704] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:40:48 2022] DELETE /identity/v3/users/6a58584176e94db59ec78b8885473cdf => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:49.001539 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c768b2e-be65-435a-be61-cd3aff49608d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:49.007630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6c768b2e-be65-435a-be61-cd3aff49608d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:49.115796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c768b2e-be65-435a-be61-cd3aff49608d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:49.132138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbe7ee-8c83-4676-b23a-586baae2ec37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:49.137115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbe7ee-8c83-4676-b23a-586baae2ec37 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:49.137115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbe7ee-8c83-4676-b23a-586baae2ec37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:49.137431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbe7ee-8c83-4676-b23a-586baae2ec37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:49.139211 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbe7ee-8c83-4676-b23a-586baae2ec37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:49.142641 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbe7ee-8c83-4676-b23a-586baae2ec37 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:49.168719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 867/1705] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:49.179747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbe7ee-8c83-4676-b23a-586baae2ec37 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:49.201710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbe7ee-8c83-4676-b23a-586baae2ec37 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:49.216097 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d86197b5-b0cc-431b-9b6f-3e94e6a63202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eca5bf96e11640c8ae848d324bb9a0f1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:49.218439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54884a5f-dfbe-4f73-8845-e712e4bd9672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:49.221147 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54884a5f-dfbe-4f73-8845-e712e4bd9672 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:49.222014 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54884a5f-dfbe-4f73-8845-e712e4bd9672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:49.223339 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54884a5f-dfbe-4f73-8845-e712e4bd9672 admin admin] PATH_INFO: `/v3/projects/adeafaeffc1d4bf1b40bdb65a432d632/users/76421d46410b4b898c4df6fce85e63d2/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:49.266817 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54884a5f-dfbe-4f73-8845-e712e4bd9672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adeafaeffc1d4bf1b40bdb65a432d632, user_id=76421d46410b4b898c4df6fce85e63d2, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:49.279969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54884a5f-dfbe-4f73-8845-e712e4bd9672 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:49.303926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d86197b5-b0cc-431b-9b6f-3e94e6a63202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eca5bf96e11640c8ae848d324bb9a0f1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:49.315099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d86197b5-b0cc-431b-9b6f-3e94e6a63202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eca5bf96e11640c8ae848d324bb9a0f1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:49.316396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d86197b5-b0cc-431b-9b6f-3e94e6a63202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eca5bf96e11640c8ae848d324bb9a0f1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:49.348854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d86197b5-b0cc-431b-9b6f-3e94e6a63202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eca5bf96e11640c8ae848d324bb9a0f1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:49.359259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 839/1706] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:40:48 2022] DELETE /identity/v3/users/eca5bf96e11640c8ae848d324bb9a0f1 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:49.361501 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d238347-cbe3-45bf-b969-7c7da27d0a4c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:49.361976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d238347-cbe3-45bf-b969-7c7da27d0a4c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:49.362405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d238347-cbe3-45bf-b969-7c7da27d0a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:49.410551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9d238347-cbe3-45bf-b969-7c7da27d0a4c None None] MFA Rules not processed for user `43b46c9179024f6b89c579db0d570cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:49.414585 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9d238347-cbe3-45bf-b969-7c7da27d0a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:49.429997 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 868/1707] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:49 2022] PUT /identity/v3/projects/adeafaeffc1d4bf1b40bdb65a432d632/users/76421d46410b4b898c4df6fce85e63d2/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:40:49.444591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3d94e-16bc-4f6a-8b7a-f38a1d9af80b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:49.445161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3d94e-16bc-4f6a-8b7a-f38a1d9af80b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:49.445515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3d94e-16bc-4f6a-8b7a-f38a1d9af80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:49.544436 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-acd3d94e-16bc-4f6a-8b7a-f38a1d9af80b None None] MFA Rules not processed for user `76421d46410b4b898c4df6fce85e63d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:49.546425 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-acd3d94e-16bc-4f6a-8b7a-f38a1d9af80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:49.633031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 840/1708] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:49.641619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d238347-cbe3-45bf-b969-7c7da27d0a4c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:49.643537 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9d238347-cbe3-45bf-b969-7c7da27d0a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:49.741111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 869/1709] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:40:49.742008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3d94e-16bc-4f6a-8b7a-f38a1d9af80b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:49.743605 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-acd3d94e-16bc-4f6a-8b7a-f38a1d9af80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:49.870861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d238347-cbe3-45bf-b969-7c7da27d0a4c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:49.881178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3d94e-16bc-4f6a-8b7a-f38a1d9af80b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:49.886369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa3e27-02e6-4403-8dca-0789ac64180a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:49.887046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbcebb-06c8-4f22-b237-ef655c9634c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:49.887189 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3e27-02e6-4403-8dca-0789ac64180a service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:49.887403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3e27-02e6-4403-8dca-0789ac64180a service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:49.887716 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3e27-02e6-4403-8dca-0789ac64180a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:49.889710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbcebb-06c8-4f22-b237-ef655c9634c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:49.890294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbcebb-06c8-4f22-b237-ef655c9634c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:49.896485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbcebb-06c8-4f22-b237-ef655c9634c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:49.896485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbcebb-06c8-4f22-b237-ef655c9634c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:49.896485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbcebb-06c8-4f22-b237-ef655c9634c6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:49.910707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa3e27-02e6-4403-8dca-0789ac64180a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:49.916307 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa3e27-02e6-4403-8dca-0789ac64180a service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:49.951209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 841/1710] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:49.995594 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 870/1711] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:49 2022] POST /identity/v3/projects => generated 365 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:49.996410 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa3e27-02e6-4403-8dca-0789ac64180a service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:50.021063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa3e27-02e6-4403-8dca-0789ac64180a service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:50.219424 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05568a-bc54-4f30-9000-a09c699a3468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:50.221171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05568a-bc54-4f30-9000-a09c699a3468 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:50.266436 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05568a-bc54-4f30-9000-a09c699a3468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:50.267074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05568a-bc54-4f30-9000-a09c699a3468 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:50.274034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05568a-bc54-4f30-9000-a09c699a3468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:50.290287 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05568a-bc54-4f30-9000-a09c699a3468 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:50.382847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce76cc-a4c1-4c4e-8405-5739bd6994b6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:50.383678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce76cc-a4c1-4c4e-8405-5739bd6994b6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:50.383678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce76cc-a4c1-4c4e-8405-5739bd6994b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:50.444023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a3ce76cc-a4c1-4c4e-8405-5739bd6994b6 None None] MFA Rules not processed for user `840ab240b66e4872b86940192e3ddc28`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:50.445281 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a3ce76cc-a4c1-4c4e-8405-5739bd6994b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:50.474436 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 842/1712] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:49 2022] POST /identity/v3/users => generated 289 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:40:50.478991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05568a-bc54-4f30-9000-a09c699a3468 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:50.496140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:50.525076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05568a-bc54-4f30-9000-a09c699a3468 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:50.535933 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9c07a-00f7-4bde-8e97-829517e67bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:50.539241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9c07a-00f7-4bde-8e97-829517e67bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:50.540208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9c07a-00f7-4bde-8e97-829517e67bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:50.541178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9c07a-00f7-4bde-8e97-829517e67bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:50.545180 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9c07a-00f7-4bde-8e97-829517e67bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:50.550596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9c07a-00f7-4bde-8e97-829517e67bfa admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:50.578165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 843/1713] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:50.594715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9c07a-00f7-4bde-8e97-829517e67bfa admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:50.623842 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 871/1714] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:50.625466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9c07a-00f7-4bde-8e97-829517e67bfa admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:50.656235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0243a4-1d4c-4a47-927a-e113ecfdf555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:50.659409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0243a4-1d4c-4a47-927a-e113ecfdf555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:50.659918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0243a4-1d4c-4a47-927a-e113ecfdf555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:50.660527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0243a4-1d4c-4a47-927a-e113ecfdf555 admin admin] PATH_INFO: `/v3/projects/60363e2f9509449f8e70132ae049b9b8/users/778692082f804911af0138c31e4c4026/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:50.710350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0243a4-1d4c-4a47-927a-e113ecfdf555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60363e2f9509449f8e70132ae049b9b8, user_id=778692082f804911af0138c31e4c4026, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:50.724891 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0243a4-1d4c-4a47-927a-e113ecfdf555 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:50.768799 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce76cc-a4c1-4c4e-8405-5739bd6994b6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:50.771560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a3ce76cc-a4c1-4c4e-8405-5739bd6994b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:50.800614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce76cc-a4c1-4c4e-8405-5739bd6994b6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:50.816591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44835dcb-4329-4121-b621-89e3508e76c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:50.817515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44835dcb-4329-4121-b621-89e3508e76c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:50.817834 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44835dcb-4329-4121-b621-89e3508e76c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:50.818134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44835dcb-4329-4121-b621-89e3508e76c9 admin admin] PATH_INFO: `/v3/projects/4a827591dac64ae0bb19d76944d95f48` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:50.821129 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44835dcb-4329-4121-b621-89e3508e76c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a827591dac64ae0bb19d76944d95f48)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:50.823564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44835dcb-4329-4121-b621-89e3508e76c9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:50.838517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 844/1715] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:50 2022] PUT /identity/v3/projects/60363e2f9509449f8e70132ae049b9b8/users/778692082f804911af0138c31e4c4026/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:50.843514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0243a4-1d4c-4a47-927a-e113ecfdf555 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:51.025217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-44835dcb-4329-4121-b621-89e3508e76c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a827591dac64ae0bb19d76944d95f48', 'request_id': 'req-44835dcb-4329-4121-b621-89e3508e76c9'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:51.037198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-44835dcb-4329-4121-b621-89e3508e76c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a827591dac64ae0bb19d76944d95f48', 'request_id': 'req-44835dcb-4329-4121-b621-89e3508e76c9'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:51.053900 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-44835dcb-4329-4121-b621-89e3508e76c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a827591dac64ae0bb19d76944d95f48', 'request_id': 'req-44835dcb-4329-4121-b621-89e3508e76c9'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:51.069681 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0243a4-1d4c-4a47-927a-e113ecfdf555 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:51.248485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1405d4-d574-42bc-93a8-589605effcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:51.250021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1405d4-d574-42bc-93a8-589605effcaa admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:51.250527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1405d4-d574-42bc-93a8-589605effcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:51.251550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1405d4-d574-42bc-93a8-589605effcaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:51.252534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1405d4-d574-42bc-93a8-589605effcaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:51.256198 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1405d4-d574-42bc-93a8-589605effcaa admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:51.272585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-44835dcb-4329-4121-b621-89e3508e76c9 admin admin] The token cache is being invalidate because project 4a827591dac64ae0bb19d76944d95f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:40:51.276039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-44835dcb-4329-4121-b621-89e3508e76c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:51.276177 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 845/1716] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:40:51.276177 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1405d4-d574-42bc-93a8-589605effcaa admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:51.278439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-44835dcb-4329-4121-b621-89e3508e76c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:51.279640 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ee1405d4-d574-42bc-93a8-589605effcaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:51.286726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 872/1717] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:40:50 2022] DELETE /identity/v3/projects/4a827591dac64ae0bb19d76944d95f48 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:51.287978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44835dcb-4329-4121-b621-89e3508e76c9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:51.293441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-44835dcb-4329-4121-b621-89e3508e76c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:51.305836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1405d4-d574-42bc-93a8-589605effcaa admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:51.342579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d990b7b-5a83-407b-88de-8f72faba806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:51.350301 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d990b7b-5a83-407b-88de-8f72faba806e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:51.350874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d990b7b-5a83-407b-88de-8f72faba806e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:51.351925 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d990b7b-5a83-407b-88de-8f72faba806e admin admin] PATH_INFO: `/v3/projects/bf168dcea7184503a3768fc5497cd1b6` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:51.357188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d990b7b-5a83-407b-88de-8f72faba806e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf168dcea7184503a3768fc5497cd1b6)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:51.359262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d990b7b-5a83-407b-88de-8f72faba806e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:51.361944 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44835dcb-4329-4121-b621-89e3508e76c9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:51.374600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dec690-2591-4f48-b55b-522ec2225334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:51.375801 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dec690-2591-4f48-b55b-522ec2225334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:51.376193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dec690-2591-4f48-b55b-522ec2225334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:51.376571 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dec690-2591-4f48-b55b-522ec2225334 admin admin] PATH_INFO: `/v3/projects/60363e2f9509449f8e70132ae049b9b8/users/778692082f804911af0138c31e4c4026/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:51.380816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dec690-2591-4f48-b55b-522ec2225334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60363e2f9509449f8e70132ae049b9b8, user_id=778692082f804911af0138c31e4c4026, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:51.384261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dec690-2591-4f48-b55b-522ec2225334 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:51.404076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 873/1718] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:51 2022] PUT /identity/v3/projects/60363e2f9509449f8e70132ae049b9b8/users/778692082f804911af0138c31e4c4026/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:51.405675 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e634f-e1ba-40b6-9e8c-bf2485f251c5 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:51.406296 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e634f-e1ba-40b6-9e8c-bf2485f251c5 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:51.406766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e634f-e1ba-40b6-9e8c-bf2485f251c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:51.434973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-523e634f-e1ba-40b6-9e8c-bf2485f251c5 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:51.436469 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-523e634f-e1ba-40b6-9e8c-bf2485f251c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:51.612597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5d990b7b-5a83-407b-88de-8f72faba806e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf168dcea7184503a3768fc5497cd1b6', 'request_id': 'req-5d990b7b-5a83-407b-88de-8f72faba806e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:51.635162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5d990b7b-5a83-407b-88de-8f72faba806e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf168dcea7184503a3768fc5497cd1b6', 'request_id': 'req-5d990b7b-5a83-407b-88de-8f72faba806e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:51.643604 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5d990b7b-5a83-407b-88de-8f72faba806e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf168dcea7184503a3768fc5497cd1b6', 'request_id': 'req-5d990b7b-5a83-407b-88de-8f72faba806e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:51.663055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:51.668748 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 874/1719] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:51.671888 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddccf4-c6d3-45b6-a754-0e62aa541bc1 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:51.683007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddccf4-c6d3-45b6-a754-0e62aa541bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:51.683007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddccf4-c6d3-45b6-a754-0e62aa541bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:51.727977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1fddccf4-c6d3-45b6-a754-0e62aa541bc1 None None] MFA Rules not processed for user `cac2f73bfa37460ebe4438fce527b1db`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:51.729491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1fddccf4-c6d3-45b6-a754-0e62aa541bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:51.814056 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5d990b7b-5a83-407b-88de-8f72faba806e admin admin] The token cache is being invalidate because project bf168dcea7184503a3768fc5497cd1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:40:51.814446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5d990b7b-5a83-407b-88de-8f72faba806e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:51.818890 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5d990b7b-5a83-407b-88de-8f72faba806e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:51.827396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 846/1720] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:40:51 2022] DELETE /identity/v3/projects/bf168dcea7184503a3768fc5497cd1b6 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:51.827396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb12e4-635a-4144-94cb-6c9711289b7e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:51.827396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb12e4-635a-4144-94cb-6c9711289b7e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:51.827396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb12e4-635a-4144-94cb-6c9711289b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:51.903966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 875/1721] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:51.907004 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9db32-4ff3-45b0-bd85-dd435a3145ff None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:51.912502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9db32-4ff3-45b0-bd85-dd435a3145ff None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:51.912502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9db32-4ff3-45b0-bd85-dd435a3145ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:51.958372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-40fb12e4-635a-4144-94cb-6c9711289b7e None None] MFA Rules not processed for user `778692082f804911af0138c31e4c4026`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:51.962410 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-40fb12e4-635a-4144-94cb-6c9711289b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:51.995205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-63d9db32-4ff3-45b0-bd85-dd435a3145ff None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:51.996465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-63d9db32-4ff3-45b0-bd85-dd435a3145ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:52.276760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 876/1722] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:52.281832 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f308669-c159-46c7-accb-dce1983bafcf None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:52.287968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f308669-c159-46c7-accb-dce1983bafcf None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:52.287968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f308669-c159-46c7-accb-dce1983bafcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:52.288263 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 847/1723] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:52.288263 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87552c-67f9-4750-8180-75ff26969279 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:52.291485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87552c-67f9-4750-8180-75ff26969279 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:52.292133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87552c-67f9-4750-8180-75ff26969279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:52.353668 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ce87552c-67f9-4750-8180-75ff26969279 None None] MFA Rules not processed for user `cac2f73bfa37460ebe4438fce527b1db`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:52.355380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ce87552c-67f9-4750-8180-75ff26969279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:52.358546 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3f308669-c159-46c7-accb-dce1983bafcf None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:52.366418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3f308669-c159-46c7-accb-dce1983bafcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:52.368198 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 848/1724] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:52.375081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87552c-67f9-4750-8180-75ff26969279 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:52.391631 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87552c-67f9-4750-8180-75ff26969279 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:52.407764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 877/1725] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:52.409431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f308669-c159-46c7-accb-dce1983bafcf None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:52.412307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3f308669-c159-46c7-accb-dce1983bafcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:52.416485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed45943-d984-44ef-9969-71faf3dfe295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:52.417176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed45943-d984-44ef-9969-71faf3dfe295 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:52.417459 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed45943-d984-44ef-9969-71faf3dfe295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:52.417776 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed45943-d984-44ef-9969-71faf3dfe295 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:52.418547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed45943-d984-44ef-9969-71faf3dfe295 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:40:52.418984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed45943-d984-44ef-9969-71faf3dfe295 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:52.428652 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed45943-d984-44ef-9969-71faf3dfe295 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:52.459264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 849/1726] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:40:52.460194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed45943-d984-44ef-9969-71faf3dfe295 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:52.466342 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-eed45943-d984-44ef-9969-71faf3dfe295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:52.558751 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f308669-c159-46c7-accb-dce1983bafcf None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:52.565714 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd01cb-6878-4cf2-83a7-ed312d44ca5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:52.570124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd01cb-6878-4cf2-83a7-ed312d44ca5a service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:52.570124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd01cb-6878-4cf2-83a7-ed312d44ca5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:52.570124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd01cb-6878-4cf2-83a7-ed312d44ca5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:52.601040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd01cb-6878-4cf2-83a7-ed312d44ca5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:52.605241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd01cb-6878-4cf2-83a7-ed312d44ca5a service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:52.626038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 878/1727] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:52.628230 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6c959-f7b8-443f-83b7-6c40b30895b6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:52.628716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6c959-f7b8-443f-83b7-6c40b30895b6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:52.630289 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6c959-f7b8-443f-83b7-6c40b30895b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:52.668402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed45943-d984-44ef-9969-71faf3dfe295 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:52.673003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:52.684847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a4d6c959-f7b8-443f-83b7-6c40b30895b6 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:52.686311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dceef-c71b-4fc7-a53c-b1e2a1fc40c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:52.688946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a4d6c959-f7b8-443f-83b7-6c40b30895b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:52.693886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dceef-c71b-4fc7-a53c-b1e2a1fc40c2 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:52.694232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dceef-c71b-4fc7-a53c-b1e2a1fc40c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:52.694616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dceef-c71b-4fc7-a53c-b1e2a1fc40c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:52.704665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46dceef-c71b-4fc7-a53c-b1e2a1fc40c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:52.706436 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46dceef-c71b-4fc7-a53c-b1e2a1fc40c2 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:52.715257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 879/1728] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:52.718256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6c959-f7b8-443f-83b7-6c40b30895b6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:52.722288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 850/1729] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:52.724772 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dceef-c71b-4fc7-a53c-b1e2a1fc40c2 service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:52.745850 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dceef-c71b-4fc7-a53c-b1e2a1fc40c2 service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:52.750640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6c959-f7b8-443f-83b7-6c40b30895b6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:52.755380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0845a4-4051-4bb3-9142-467fd854b36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:52.756182 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0845a4-4051-4bb3-9142-467fd854b36e admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:52.756466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0845a4-4051-4bb3-9142-467fd854b36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:52.756752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0845a4-4051-4bb3-9142-467fd854b36e admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:52.757533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0845a4-4051-4bb3-9142-467fd854b36e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:40:52.757840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0845a4-4051-4bb3-9142-467fd854b36e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:52.760482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0845a4-4051-4bb3-9142-467fd854b36e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:52.766096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c0a6d-18eb-4abb-a045-be7d34750081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:52.767156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c0a6d-18eb-4abb-a045-be7d34750081 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:52.767448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c0a6d-18eb-4abb-a045-be7d34750081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:52.767728 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c0a6d-18eb-4abb-a045-be7d34750081 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:52.768507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c0a6d-18eb-4abb-a045-be7d34750081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:52.772258 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c0a6d-18eb-4abb-a045-be7d34750081 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:52.803236 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 851/1730] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:40:52.806715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0845a4-4051-4bb3-9142-467fd854b36e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:52.838669 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0845a4-4051-4bb3-9142-467fd854b36e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:52.845414 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefddb9e-b4c5-4199-b2d8-24518b3e01b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:52.845701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefddb9e-b4c5-4199-b2d8-24518b3e01b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:52.845957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefddb9e-b4c5-4199-b2d8-24518b3e01b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:52.846234 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefddb9e-b4c5-4199-b2d8-24518b3e01b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:52.847309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefddb9e-b4c5-4199-b2d8-24518b3e01b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:52.850544 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefddb9e-b4c5-4199-b2d8-24518b3e01b0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:52.944428 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 880/1731] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:52 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:52.945280 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c0a6d-18eb-4abb-a045-be7d34750081 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:53.015008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 852/1732] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:52 2022] POST /identity/v3/projects => generated 387 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:53.022696 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefddb9e-b4c5-4199-b2d8-24518b3e01b0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:53.124728 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c0a6d-18eb-4abb-a045-be7d34750081 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:53.217422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefddb9e-b4c5-4199-b2d8-24518b3e01b0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:53.232079 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d7cea-8aa9-4fd5-9e07-b2f60f8c97b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:53.233056 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d7cea-8aa9-4fd5-9e07-b2f60f8c97b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:53.233496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d7cea-8aa9-4fd5-9e07-b2f60f8c97b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:53.233926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d7cea-8aa9-4fd5-9e07-b2f60f8c97b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:53.235042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d7cea-8aa9-4fd5-9e07-b2f60f8c97b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:53.237357 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d7cea-8aa9-4fd5-9e07-b2f60f8c97b4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:53.277919 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c64281-9468-4d14-90ba-db3c2942d923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:53.278822 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c64281-9468-4d14-90ba-db3c2942d923 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:53.279227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c64281-9468-4d14-90ba-db3c2942d923 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:53.279602 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c64281-9468-4d14-90ba-db3c2942d923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:53.286760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e8c64281-9468-4d14-90ba-db3c2942d923 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:53.320819 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 853/1733] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:53 2022] POST /identity/v3/users => generated 290 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:53.324345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d7cea-8aa9-4fd5-9e07-b2f60f8c97b4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:53.349548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d7cea-8aa9-4fd5-9e07-b2f60f8c97b4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:53.357713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da9d5c-49f4-4d25-8dee-5b70d0db51d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:53.358714 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da9d5c-49f4-4d25-8dee-5b70d0db51d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:53.359313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da9d5c-49f4-4d25-8dee-5b70d0db51d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:53.359829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da9d5c-49f4-4d25-8dee-5b70d0db51d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:53.360908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da9d5c-49f4-4d25-8dee-5b70d0db51d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:53.367056 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da9d5c-49f4-4d25-8dee-5b70d0db51d9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:53.467195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 854/1734] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:53 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:53.470517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ea1f0-eb85-42aa-814b-0deda1cbf68b None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:53.471078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ea1f0-eb85-42aa-814b-0deda1cbf68b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:53.478076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ea1f0-eb85-42aa-814b-0deda1cbf68b None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:53.478316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c64281-9468-4d14-90ba-db3c2942d923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:53.478832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:53.479101 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c64281-9468-4d14-90ba-db3c2942d923 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:53.480630 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 855/1735] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 18 10:40:53 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:40:53.481626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ea1f0-eb85-42aa-814b-0deda1cbf68b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:53.522824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 881/1736] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:53.523870 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c64281-9468-4d14-90ba-db3c2942d923 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:53.548274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ea1f0-eb85-42aa-814b-0deda1cbf68b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:53.548274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23adff7-239f-4e58-a0c6-f899ba618efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:53.548274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23adff7-239f-4e58-a0c6-f899ba618efc admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:53.548274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23adff7-239f-4e58-a0c6-f899ba618efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:53.548722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23adff7-239f-4e58-a0c6-f899ba618efc admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:53.548722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23adff7-239f-4e58-a0c6-f899ba618efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:53.548722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23adff7-239f-4e58-a0c6-f899ba618efc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:53.573253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c64281-9468-4d14-90ba-db3c2942d923 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:53.591337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 856/1737] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:53.592616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23adff7-239f-4e58-a0c6-f899ba618efc admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:53.600781 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe2644-0319-4159-a679-e0fc63c99cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:53.601541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe2644-0319-4159-a679-e0fc63c99cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:53.603463 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe2644-0319-4159-a679-e0fc63c99cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:53.603744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe2644-0319-4159-a679-e0fc63c99cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:53.604613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe2644-0319-4159-a679-e0fc63c99cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:53.606295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe2644-0319-4159-a679-e0fc63c99cf9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:53.633347 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23adff7-239f-4e58-a0c6-f899ba618efc admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:53.648670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386a9ec-d148-4425-93d0-23c338fc24fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:53.653072 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 882/1738] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:53.654667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386a9ec-d148-4425-93d0-23c338fc24fb admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:53.656705 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff208ee-f6f2-4917-a479-d303b7c43e3e None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:53.656960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff208ee-f6f2-4917-a479-d303b7c43e3e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:53.657284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386a9ec-d148-4425-93d0-23c338fc24fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:53.657385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff208ee-f6f2-4917-a479-d303b7c43e3e None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:53.657898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386a9ec-d148-4425-93d0-23c338fc24fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:53.659195 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 883/1739] 10.222.0.16 () {54 vars in 912 bytes} [Mon Jul 18 10:40:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:40:53.660029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff208ee-f6f2-4917-a479-d303b7c43e3e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:53.660178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386a9ec-d148-4425-93d0-23c338fc24fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:53.665171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386a9ec-d148-4425-93d0-23c338fc24fb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:53.676744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff208ee-f6f2-4917-a479-d303b7c43e3e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:53.683281 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53acda-3aad-4d1c-9cda-29749757981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:53.683539 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53acda-3aad-4d1c-9cda-29749757981f admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:53.683710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53acda-3aad-4d1c-9cda-29749757981f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:53.683943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53acda-3aad-4d1c-9cda-29749757981f admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:53.684681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53acda-3aad-4d1c-9cda-29749757981f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:53.686607 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53acda-3aad-4d1c-9cda-29749757981f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:53.703042 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 884/1740] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:53.708098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e480bf-25a8-466f-85a3-ff70c71c7ed8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:53.708444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e480bf-25a8-466f-85a3-ff70c71c7ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:53.708726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e480bf-25a8-466f-85a3-ff70c71c7ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:53.716106 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 857/1741] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:53.720508 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386a9ec-d148-4425-93d0-23c338fc24fb admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:53.756886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386a9ec-d148-4425-93d0-23c338fc24fb admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:53.766229 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a17cf0-9436-4d52-b1c8-5dbefaf00d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:53.767532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a17cf0-9436-4d52-b1c8-5dbefaf00d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:53.767972 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a17cf0-9436-4d52-b1c8-5dbefaf00d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:53.768264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a17cf0-9436-4d52-b1c8-5dbefaf00d69 admin admin] PATH_INFO: `/v3/projects/d154e6ae8b654283ac52e7a8acb51524/users/6697cbbdce3d4f6eaa925b99d3db9137/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:53.793494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-51e480bf-25a8-466f-85a3-ff70c71c7ed8 None None] MFA Rules not processed for user `3f9385dec85a4e0cba21c2a840124f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:53.804410 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a17cf0-9436-4d52-b1c8-5dbefaf00d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d154e6ae8b654283ac52e7a8acb51524, user_id=6697cbbdce3d4f6eaa925b99d3db9137, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:53.808811 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a17cf0-9436-4d52-b1c8-5dbefaf00d69 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:53.811419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-51e480bf-25a8-466f-85a3-ff70c71c7ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:53.893911 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 858/1742] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:53 2022] PUT /identity/v3/projects/d154e6ae8b654283ac52e7a8acb51524/users/6697cbbdce3d4f6eaa925b99d3db9137/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:53.896234 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a17cf0-9436-4d52-b1c8-5dbefaf00d69 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:53.981714 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 885/1743] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 18 10:40:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:53.981714 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2cb8e-4269-4156-8a11-5d6245c33315 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:53.981714 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2cb8e-4269-4156-8a11-5d6245c33315 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:53.981949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2cb8e-4269-4156-8a11-5d6245c33315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:54.033765 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-06d2cb8e-4269-4156-8a11-5d6245c33315 None None] MFA Rules not processed for user `b8fd088faaba4d5c9745638c14f1a7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:54.033765 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-06d2cb8e-4269-4156-8a11-5d6245c33315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:54.043864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a17cf0-9436-4d52-b1c8-5dbefaf00d69 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:54.055023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4533f-1411-48ee-a54a-b4023f19c4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:54.056957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4533f-1411-48ee-a54a-b4023f19c4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:54.057785 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4533f-1411-48ee-a54a-b4023f19c4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:54.058593 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4533f-1411-48ee-a54a-b4023f19c4ef admin admin] PATH_INFO: `/v3/projects/b9776b808aaf4f7abb91bafc6d408b51/users/ddd206adcade4c0bbe2fdd11d7f57a7f/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:54.090068 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4533f-1411-48ee-a54a-b4023f19c4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9776b808aaf4f7abb91bafc6d408b51, user_id=ddd206adcade4c0bbe2fdd11d7f57a7f, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:54.106280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4533f-1411-48ee-a54a-b4023f19c4ef admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:54.221224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 886/1744] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 18 10:40:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:54.227722 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad273336-19fb-4923-9914-4089e67d88ec None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:54.237258 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad273336-19fb-4923-9914-4089e67d88ec None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:54.237258 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad273336-19fb-4923-9914-4089e67d88ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:54.266235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 859/1745] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:53 2022] PUT /identity/v3/projects/b9776b808aaf4f7abb91bafc6d408b51/users/ddd206adcade4c0bbe2fdd11d7f57a7f/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:54.266235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4533f-1411-48ee-a54a-b4023f19c4ef admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:54.276953 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-72b4533f-1411-48ee-a54a-b4023f19c4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:54.303580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ad273336-19fb-4923-9914-4089e67d88ec None None] MFA Rules not processed for user `6697cbbdce3d4f6eaa925b99d3db9137`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:54.306780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ad273336-19fb-4923-9914-4089e67d88ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:54.398140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4533f-1411-48ee-a54a-b4023f19c4ef admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:54.402457 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7637859-de1c-451b-ac70-1f2b495e2c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:54.403222 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7637859-de1c-451b-ac70-1f2b495e2c12 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:54.403576 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7637859-de1c-451b-ac70-1f2b495e2c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:54.404061 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7637859-de1c-451b-ac70-1f2b495e2c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:54.418656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7637859-de1c-451b-ac70-1f2b495e2c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:54.420490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7637859-de1c-451b-ac70-1f2b495e2c12 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:54.424770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:54.432233 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 860/1746] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:54.433808 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5c75a-50cc-4b53-adc1-9b02817ee3c4 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:54.434083 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5c75a-50cc-4b53-adc1-9b02817ee3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:54.434577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5c75a-50cc-4b53-adc1-9b02817ee3c4 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:54.436777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 861/1747] 10.222.0.16 () {54 vars in 961 bytes} [Mon Jul 18 10:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:40:54.438206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656022a2-04e8-4544-9818-16e762754112 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:54.438604 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656022a2-04e8-4544-9818-16e762754112 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:54.439008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656022a2-04e8-4544-9818-16e762754112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:54.489290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-656022a2-04e8-4544-9818-16e762754112 None None] MFA Rules not processed for user `ddd206adcade4c0bbe2fdd11d7f57a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:54.490816 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-656022a2-04e8-4544-9818-16e762754112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:54.493929 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 887/1748] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:54.495530 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108914ec-b3de-46fe-a378-28a95c56b687 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:54.496263 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108914ec-b3de-46fe-a378-28a95c56b687 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:54.496582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108914ec-b3de-46fe-a378-28a95c56b687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:54.547073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-108914ec-b3de-46fe-a378-28a95c56b687 None None] MFA Rules not processed for user `b8fd088faaba4d5c9745638c14f1a7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:54.548302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-108914ec-b3de-46fe-a378-28a95c56b687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:54.740494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 862/1749] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:54.745074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656022a2-04e8-4544-9818-16e762754112 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:54.849346 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 888/1750] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Jul 18 10:40:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:54.852038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108914ec-b3de-46fe-a378-28a95c56b687 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:55.007049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656022a2-04e8-4544-9818-16e762754112 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:55.036358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4faf92-87f0-4d80-9746-4b655824cbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:55.037230 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4faf92-87f0-4d80-9746-4b655824cbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:55.037513 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4faf92-87f0-4d80-9746-4b655824cbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:55.037790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4faf92-87f0-4d80-9746-4b655824cbf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:55.048550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4faf92-87f0-4d80-9746-4b655824cbf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:55.050938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4faf92-87f0-4d80-9746-4b655824cbf8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:55.079012 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108914ec-b3de-46fe-a378-28a95c56b687 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:55.089855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375ab6d-3759-479b-b594-dc8ecea3653e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:55.091295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375ab6d-3759-479b-b594-dc8ecea3653e admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:55.091935 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375ab6d-3759-479b-b594-dc8ecea3653e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:55.092456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375ab6d-3759-479b-b594-dc8ecea3653e admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:55.093853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375ab6d-3759-479b-b594-dc8ecea3653e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:55.098473 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375ab6d-3759-479b-b594-dc8ecea3653e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:55.196156 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 863/1751] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:54 2022] POST /identity/v3/projects => generated 385 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:55.197193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4faf92-87f0-4d80-9746-4b655824cbf8 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:55.294669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 889/1752] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:40:54 2022] POST /identity/v3/projects => generated 381 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:55.299512 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375ab6d-3759-479b-b594-dc8ecea3653e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:55.413751 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4faf92-87f0-4d80-9746-4b655824cbf8 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:55.536919 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375ab6d-3759-479b-b594-dc8ecea3653e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:55.555862 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fa177-0799-42f1-814b-0a2bff42b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:55.557105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fa177-0799-42f1-814b-0a2bff42b945 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:55.559681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fa177-0799-42f1-814b-0a2bff42b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:55.560180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fa177-0799-42f1-814b-0a2bff42b945 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:55.561392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fa177-0799-42f1-814b-0a2bff42b945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:55.569653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fa177-0799-42f1-814b-0a2bff42b945 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:55.643318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf57a3-0186-4cb6-a696-121d2eeddff0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fd088faaba4d5c9745638c14f1a7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:55.644960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf57a3-0186-4cb6-a696-121d2eeddff0 service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:55.645789 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf57a3-0186-4cb6-a696-121d2eeddff0 service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:55.646637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf57a3-0186-4cb6-a696-121d2eeddff0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:55.703105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf57a3-0186-4cb6-a696-121d2eeddff0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:55.705222 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf57a3-0186-4cb6-a696-121d2eeddff0 service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:55.716845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 890/1753] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:55 2022] POST /identity/v3/users => generated 299 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:55.718150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fa177-0799-42f1-814b-0a2bff42b945 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:55.732765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 864/1754] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:55.734019 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf57a3-0186-4cb6-a696-121d2eeddff0 service placement] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:55.748642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fa177-0799-42f1-814b-0a2bff42b945 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:55.751094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf57a3-0186-4cb6-a696-121d2eeddff0 service placement] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:55.761648 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31faf4-ba47-47e8-b6c4-f711f8ad01bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:55.762674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31faf4-ba47-47e8-b6c4-f711f8ad01bd admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:55.763127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31faf4-ba47-47e8-b6c4-f711f8ad01bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:55.763561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31faf4-ba47-47e8-b6c4-f711f8ad01bd admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:55.764531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31faf4-ba47-47e8-b6c4-f711f8ad01bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:55.766268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561df47-6630-4e49-8bb3-8af0f75d8e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:55.768879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561df47-6630-4e49-8bb3-8af0f75d8e7b admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:55.768879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561df47-6630-4e49-8bb3-8af0f75d8e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:55.770934 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31faf4-ba47-47e8-b6c4-f711f8ad01bd admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:55.780117 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561df47-6630-4e49-8bb3-8af0f75d8e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:55.781131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561df47-6630-4e49-8bb3-8af0f75d8e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:55.788322 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561df47-6630-4e49-8bb3-8af0f75d8e7b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:55.865221 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 865/1755] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:55.870663 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561df47-6630-4e49-8bb3-8af0f75d8e7b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:55.895487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 891/1756] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:40:55 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:40:55.895487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff56888-2864-433b-87a4-0bfd02c374e1 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:55.895487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff56888-2864-433b-87a4-0bfd02c374e1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:55.895487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff56888-2864-433b-87a4-0bfd02c374e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:55.900809 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561df47-6630-4e49-8bb3-8af0f75d8e7b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:55.905593 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:55.915338 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedb875-22b6-4d5c-a47b-cff76c4d4576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:55.915851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedb875-22b6-4d5c-a47b-cff76c4d4576 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:55.916483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedb875-22b6-4d5c-a47b-cff76c4d4576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:55.916646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedb875-22b6-4d5c-a47b-cff76c4d4576 admin admin] PATH_INFO: `/v3/projects/ee9587507dce4519adf64c0eabedd082/users/577223bb4b0f4ab393c2ae641bfccb7a/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:55.939243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eedb875-22b6-4d5c-a47b-cff76c4d4576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9587507dce4519adf64c0eabedd082, user_id=577223bb4b0f4ab393c2ae641bfccb7a, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:55.943831 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eedb875-22b6-4d5c-a47b-cff76c4d4576 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:55.986094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-cff56888-2864-433b-87a4-0bfd02c374e1 None None] MFA Rules not processed for user `649b66b27ef44ad5b218f6e8bb790963`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:55.986094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-cff56888-2864-433b-87a4-0bfd02c374e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:56.071510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 866/1757] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:55 2022] PUT /identity/v3/projects/ee9587507dce4519adf64c0eabedd082/users/577223bb4b0f4ab393c2ae641bfccb7a/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:56.072530 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedb875-22b6-4d5c-a47b-cff76c4d4576 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:56.140274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 892/1758] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:56.141644 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff56888-2864-433b-87a4-0bfd02c374e1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:56.147826 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-cff56888-2864-433b-87a4-0bfd02c374e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:56.199413 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff56888-2864-433b-87a4-0bfd02c374e1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:56.297120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedb875-22b6-4d5c-a47b-cff76c4d4576 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:56.310054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e27c4-6a79-4ecf-8787-9264c504e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:56.310766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e27c4-6a79-4ecf-8787-9264c504e435 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:56.311208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e27c4-6a79-4ecf-8787-9264c504e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:56.311564 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e27c4-6a79-4ecf-8787-9264c504e435 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:56.312383 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e27c4-6a79-4ecf-8787-9264c504e435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:56.314243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e27c4-6a79-4ecf-8787-9264c504e435 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:56.345092 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 867/1759] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:56.345092 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e27c4-6a79-4ecf-8787-9264c504e435 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:56.369304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e27c4-6a79-4ecf-8787-9264c504e435 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:56.381836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0552e05-cb3a-47ec-ae06-eaca423c6c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:56.382572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0552e05-cb3a-47ec-ae06-eaca423c6c4b admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:56.382850 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0552e05-cb3a-47ec-ae06-eaca423c6c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:56.383188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0552e05-cb3a-47ec-ae06-eaca423c6c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:56.384053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0552e05-cb3a-47ec-ae06-eaca423c6c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:56.385729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0552e05-cb3a-47ec-ae06-eaca423c6c4b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:56.415047 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 868/1760] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:56.418990 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0552e05-cb3a-47ec-ae06-eaca423c6c4b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:56.443712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0552e05-cb3a-47ec-ae06-eaca423c6c4b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:56.452189 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74eb9b-ee97-455a-ac91-d21ad16c2c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:56.456331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74eb9b-ee97-455a-ac91-d21ad16c2c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:56.456331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74eb9b-ee97-455a-ac91-d21ad16c2c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:56.456331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74eb9b-ee97-455a-ac91-d21ad16c2c9d admin admin] PATH_INFO: `/v3/users/8515c0beaca74b0386ec86f4ab21dd0c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:56.464171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b5490-a038-47d2-96f4-e0459580f653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:56.465224 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b5490-a038-47d2-96f4-e0459580f653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:56.465588 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b5490-a038-47d2-96f4-e0459580f653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:56.465874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b5490-a038-47d2-96f4-e0459580f653 admin admin] PATH_INFO: `/v3/projects/fe71c0930ba7457cbcd28312a1be7112/users/8d43480ec190439ea19b4b7035905de9/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:56.472141 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74eb9b-ee97-455a-ac91-d21ad16c2c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8515c0beaca74b0386ec86f4ab21dd0c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:56.474878 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74eb9b-ee97-455a-ac91-d21ad16c2c9d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:56.588790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b5490-a038-47d2-96f4-e0459580f653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe71c0930ba7457cbcd28312a1be7112, user_id=8d43480ec190439ea19b4b7035905de9, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:56.603190 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b5490-a038-47d2-96f4-e0459580f653 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:56.697275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 869/1761] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:56 2022] PUT /identity/v3/projects/fe71c0930ba7457cbcd28312a1be7112/users/8d43480ec190439ea19b4b7035905de9/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:56.698665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b5490-a038-47d2-96f4-e0459580f653 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:56.770638 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1c74eb9b-ee97-455a-ac91-d21ad16c2c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8515c0beaca74b0386ec86f4ab21dd0c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:56.803274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:56.810519 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b5490-a038-47d2-96f4-e0459580f653 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:56.817511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2e3a2-ccca-4d2d-b271-3406da1a9bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:56.818898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2e3a2-ccca-4d2d-b271-3406da1a9bca admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:56.819188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2e3a2-ccca-4d2d-b271-3406da1a9bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:56.819475 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2e3a2-ccca-4d2d-b271-3406da1a9bca admin admin] PATH_INFO: `/v3/projects/ee9587507dce4519adf64c0eabedd082/users/577223bb4b0f4ab393c2ae641bfccb7a/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:56.823156 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2e3a2-ccca-4d2d-b271-3406da1a9bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9587507dce4519adf64c0eabedd082, user_id=577223bb4b0f4ab393c2ae641bfccb7a, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:56.829278 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2e3a2-ccca-4d2d-b271-3406da1a9bca admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:56.848220 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 870/1762] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:56 2022] PUT /identity/v3/projects/ee9587507dce4519adf64c0eabedd082/users/577223bb4b0f4ab393c2ae641bfccb7a/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:56.865052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2e3a2-ccca-4d2d-b271-3406da1a9bca admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:56.866248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1c74eb9b-ee97-455a-ac91-d21ad16c2c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8515c0beaca74b0386ec86f4ab21dd0c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:56.895327 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1c74eb9b-ee97-455a-ac91-d21ad16c2c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8515c0beaca74b0386ec86f4ab21dd0c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:56.905830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1c74eb9b-ee97-455a-ac91-d21ad16c2c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8515c0beaca74b0386ec86f4ab21dd0c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:56.932155 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1c74eb9b-ee97-455a-ac91-d21ad16c2c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8515c0beaca74b0386ec86f4ab21dd0c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:56.964567 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 893/1763] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:40:56 2022] DELETE /identity/v3/users/8515c0beaca74b0386ec86f4ab21dd0c => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:56.965936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74eb9b-ee97-455a-ac91-d21ad16c2c9d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:56.967881 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1c74eb9b-ee97-455a-ac91-d21ad16c2c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:57.019080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2e3a2-ccca-4d2d-b271-3406da1a9bca admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:57.108196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74eb9b-ee97-455a-ac91-d21ad16c2c9d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:57.116165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36dc2d-d4b1-4b06-a531-5a4b0f74b21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:57.117270 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36dc2d-d4b1-4b06-a531-5a4b0f74b21f admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:57.117786 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36dc2d-d4b1-4b06-a531-5a4b0f74b21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:57.118424 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36dc2d-d4b1-4b06-a531-5a4b0f74b21f admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:57.119455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36dc2d-d4b1-4b06-a531-5a4b0f74b21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:57.130887 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36dc2d-d4b1-4b06-a531-5a4b0f74b21f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:57.145557 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 894/1764] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:40:57.147569 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3621d-3cdb-4cd8-97b9-c0bc3c1ce603 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:57.147948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3621d-3cdb-4cd8-97b9-c0bc3c1ce603 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:57.148704 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3621d-3cdb-4cd8-97b9-c0bc3c1ce603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:57.149865 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b41bc-1a8e-4f2f-aa98-78a18899ffab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fd088faaba4d5c9745638c14f1a7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:57.150844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b41bc-1a8e-4f2f-aa98-78a18899ffab service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:57.151175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b41bc-1a8e-4f2f-aa98-78a18899ffab service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:57.151427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b41bc-1a8e-4f2f-aa98-78a18899ffab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:57.153888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5c7b41bc-1a8e-4f2f-aa98-78a18899ffab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:57.183975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b41bc-1a8e-4f2f-aa98-78a18899ffab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:57.187130 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b41bc-1a8e-4f2f-aa98-78a18899ffab service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:57.187815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-72c3621d-3cdb-4cd8-97b9-c0bc3c1ce603 None None] MFA Rules not processed for user `577223bb4b0f4ab393c2ae641bfccb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:57.189304 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-72c3621d-3cdb-4cd8-97b9-c0bc3c1ce603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:57.224523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 871/1765] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:57.227057 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b41bc-1a8e-4f2f-aa98-78a18899ffab service placement] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:57.252553 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b41bc-1a8e-4f2f-aa98-78a18899ffab service placement] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:57.261846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c2e78-77fc-4683-a3fa-0e1e5f91f3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:57.263266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c2e78-77fc-4683-a3fa-0e1e5f91f3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:57.263650 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c2e78-77fc-4683-a3fa-0e1e5f91f3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:57.264171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c2e78-77fc-4683-a3fa-0e1e5f91f3d0 admin admin] PATH_INFO: `/v3/projects/fe71c0930ba7457cbcd28312a1be7112/users/8d43480ec190439ea19b4b7035905de9/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:57.269050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c2e78-77fc-4683-a3fa-0e1e5f91f3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe71c0930ba7457cbcd28312a1be7112, user_id=8d43480ec190439ea19b4b7035905de9, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:57.272588 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c2e78-77fc-4683-a3fa-0e1e5f91f3d0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:57.301782 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 872/1766] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:40:57 2022] PUT /identity/v3/projects/fe71c0930ba7457cbcd28312a1be7112/users/8d43480ec190439ea19b4b7035905de9/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:57.305200 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c1b0-7411-49f1-81d2-01d495ad2ce7 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:57.305588 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c1b0-7411-49f1-81d2-01d495ad2ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:57.305748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c1b0-7411-49f1-81d2-01d495ad2ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:57.368596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-16d9c1b0-7411-49f1-81d2-01d495ad2ce7 None None] MFA Rules not processed for user `8d43480ec190439ea19b4b7035905de9`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:57.374370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-16d9c1b0-7411-49f1-81d2-01d495ad2ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:57.389701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 895/1767] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:57.389701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b197276-bf0d-4c54-a660-fb19fce1df48 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:57.389701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b197276-bf0d-4c54-a660-fb19fce1df48 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:57.389701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b197276-bf0d-4c54-a660-fb19fce1df48 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:57.389701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 896/1768] 10.222.0.16 () {54 vars in 912 bytes} [Mon Jul 18 10:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:40:57.398931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc4169-f746-46a6-94ff-5b80742f3496 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:57.399291 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc4169-f746-46a6-94ff-5b80742f3496 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:57.399563 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc4169-f746-46a6-94ff-5b80742f3496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:57.465656 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-19cc4169-f746-46a6-94ff-5b80742f3496 None None] MFA Rules not processed for user `3f9385dec85a4e0cba21c2a840124f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:57.472571 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-19cc4169-f746-46a6-94ff-5b80742f3496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:57.548313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 873/1769] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:57.549395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9c1b0-7411-49f1-81d2-01d495ad2ce7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:57.557069 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-16d9c1b0-7411-49f1-81d2-01d495ad2ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:57.659026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 897/1770] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 18 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:57.666682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc4169-f746-46a6-94ff-5b80742f3496 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:57.672467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-19cc4169-f746-46a6-94ff-5b80742f3496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:57.706846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9c1b0-7411-49f1-81d2-01d495ad2ce7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:57.711835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8430b-b716-4578-87f0-ca75d110a31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:57.712815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8430b-b716-4578-87f0-ca75d110a31d service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:57.713171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8430b-b716-4578-87f0-ca75d110a31d service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:57.713597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8430b-b716-4578-87f0-ca75d110a31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:57.785970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc4169-f746-46a6-94ff-5b80742f3496 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:57.790738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94e8b5-6e0c-4ca7-876c-4f00a9b81a97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:57.791419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94e8b5-6e0c-4ca7-876c-4f00a9b81a97 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:57.792046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94e8b5-6e0c-4ca7-876c-4f00a9b81a97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:57.792337 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94e8b5-6e0c-4ca7-876c-4f00a9b81a97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:57.806423 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94e8b5-6e0c-4ca7-876c-4f00a9b81a97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:57.810254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94e8b5-6e0c-4ca7-876c-4f00a9b81a97 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:57.822658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 898/1771] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:57.823987 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94e8b5-6e0c-4ca7-876c-4f00a9b81a97 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:57.826392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3b94e8b5-6e0c-4ca7-876c-4f00a9b81a97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:57.848625 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94e8b5-6e0c-4ca7-876c-4f00a9b81a97 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:57.851143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8430b-b716-4578-87f0-ca75d110a31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:57.855480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8430b-b716-4578-87f0-ca75d110a31d service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:57.870692 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf8ae5-a53d-45ce-b207-98a0e0e2f80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:57.875836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 874/1772] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:57.876419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf8ae5-a53d-45ce-b207-98a0e0e2f80c service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:57.876881 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf8ae5-a53d-45ce-b207-98a0e0e2f80c service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:57.877491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf8ae5-a53d-45ce-b207-98a0e0e2f80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:57.888786 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf8ae5-a53d-45ce-b207-98a0e0e2f80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:57.891004 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf8ae5-a53d-45ce-b207-98a0e0e2f80c service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:57.895915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8430b-b716-4578-87f0-ca75d110a31d service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:57.902955 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-bec8430b-b716-4578-87f0-ca75d110a31d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:57.919186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 899/1773] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:57.977668 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c55ae-ab5b-4c0f-a7f8-f571fd9a1095 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:57.977959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c55ae-ab5b-4c0f-a7f8-f571fd9a1095 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:57.979565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c55ae-ab5b-4c0f-a7f8-f571fd9a1095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:58.036211 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-425c55ae-ab5b-4c0f-a7f8-f571fd9a1095 None None] MFA Rules not processed for user `43b46c9179024f6b89c579db0d570cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:58.036211 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-425c55ae-ab5b-4c0f-a7f8-f571fd9a1095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:58.151790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8430b-b716-4578-87f0-ca75d110a31d service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:58.171432 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55a183-aa45-4bdc-b96c-143f4fe43615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:58.172739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55a183-aa45-4bdc-b96c-143f4fe43615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:58.172951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55a183-aa45-4bdc-b96c-143f4fe43615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:58.173326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55a183-aa45-4bdc-b96c-143f4fe43615 admin admin] PATH_INFO: `/v3/projects/aac48eec80c9497cb56743547a708d06` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:58.178515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55a183-aa45-4bdc-b96c-143f4fe43615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac48eec80c9497cb56743547a708d06)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:58.180466 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 900/1774] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:40:58.181156 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55a183-aa45-4bdc-b96c-143f4fe43615 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:58.181603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c55ae-ab5b-4c0f-a7f8-f571fd9a1095 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:58.183991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-425c55ae-ab5b-4c0f-a7f8-f571fd9a1095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:58.202103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c55ae-ab5b-4c0f-a7f8-f571fd9a1095 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:58.212003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1ba0f-e5c1-47ac-82ac-329802e287e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:58.221681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1ba0f-e5c1-47ac-82ac-329802e287e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:58.223461 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1ba0f-e5c1-47ac-82ac-329802e287e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:58.223919 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1ba0f-e5c1-47ac-82ac-329802e287e0 admin admin] PATH_INFO: `/v3/users/6697cbbdce3d4f6eaa925b99d3db9137` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:58.226008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1ba0f-e5c1-47ac-82ac-329802e287e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6697cbbdce3d4f6eaa925b99d3db9137)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:58.228756 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1ba0f-e5c1-47ac-82ac-329802e287e0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:58.374173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a55a183-aa45-4bdc-b96c-143f4fe43615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac48eec80c9497cb56743547a708d06', 'request_id': 'req-7a55a183-aa45-4bdc-b96c-143f4fe43615'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:58.384688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a55a183-aa45-4bdc-b96c-143f4fe43615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac48eec80c9497cb56743547a708d06', 'request_id': 'req-7a55a183-aa45-4bdc-b96c-143f4fe43615'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:58.400172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a55a183-aa45-4bdc-b96c-143f4fe43615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac48eec80c9497cb56743547a708d06', 'request_id': 'req-7a55a183-aa45-4bdc-b96c-143f4fe43615'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:58.511524 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a55a183-aa45-4bdc-b96c-143f4fe43615 admin admin] The token cache is being invalidate because project aac48eec80c9497cb56743547a708d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:40:58.511816 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a55a183-aa45-4bdc-b96c-143f4fe43615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:58.513043 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a55a183-aa45-4bdc-b96c-143f4fe43615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:58.515852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 875/1775] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:40:57 2022] DELETE /identity/v3/projects/aac48eec80c9497cb56743547a708d06 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:58.523542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55a183-aa45-4bdc-b96c-143f4fe43615 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:58.526691 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7a55a183-aa45-4bdc-b96c-143f4fe43615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:58.540393 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-73d1ba0f-e5c1-47ac-82ac-329802e287e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6697cbbdce3d4f6eaa925b99d3db9137'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:58.650297 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-73d1ba0f-e5c1-47ac-82ac-329802e287e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6697cbbdce3d4f6eaa925b99d3db9137'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:58.668255 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-73d1ba0f-e5c1-47ac-82ac-329802e287e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6697cbbdce3d4f6eaa925b99d3db9137'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:58.675014 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-73d1ba0f-e5c1-47ac-82ac-329802e287e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6697cbbdce3d4f6eaa925b99d3db9137'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:58.707694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-73d1ba0f-e5c1-47ac-82ac-329802e287e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6697cbbdce3d4f6eaa925b99d3db9137'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:58.720448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 901/1776] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:40:58 2022] DELETE /identity/v3/users/6697cbbdce3d4f6eaa925b99d3db9137 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:58.725091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55a183-aa45-4bdc-b96c-143f4fe43615 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:58.727359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7819b-129c-4ae3-a84f-fffbacd1488e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:58.727657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7819b-129c-4ae3-a84f-fffbacd1488e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:58.728090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7819b-129c-4ae3-a84f-fffbacd1488e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:58.785782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-dbe7819b-129c-4ae3-a84f-fffbacd1488e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:58.787086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dbe7819b-129c-4ae3-a84f-fffbacd1488e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:58.834785 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aee5d9-f237-4c84-8589-da4237281e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:58.835854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aee5d9-f237-4c84-8589-da4237281e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:58.836138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aee5d9-f237-4c84-8589-da4237281e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:58.837681 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aee5d9-f237-4c84-8589-da4237281e5d admin admin] PATH_INFO: `/v3/users/840ab240b66e4872b86940192e3ddc28` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:58.839225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aee5d9-f237-4c84-8589-da4237281e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=840ab240b66e4872b86940192e3ddc28)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:58.841561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aee5d9-f237-4c84-8589-da4237281e5d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:58.888422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:58.893486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 902/1777] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:58.907177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7819b-129c-4ae3-a84f-fffbacd1488e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:58.908670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dbe7819b-129c-4ae3-a84f-fffbacd1488e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:59.029217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7819b-129c-4ae3-a84f-fffbacd1488e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:59.034198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19690f81-d73c-4a48-9a50-0415673bfe7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:59.035618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19690f81-d73c-4a48-9a50-0415673bfe7f service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:59.036132 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19690f81-d73c-4a48-9a50-0415673bfe7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:59.036600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19690f81-d73c-4a48-9a50-0415673bfe7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:59.053085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19690f81-d73c-4a48-9a50-0415673bfe7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:59.055362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19690f81-d73c-4a48-9a50-0415673bfe7f service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:59.082841 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 903/1778] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:40:59.175913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-05aee5d9-f237-4c84-8589-da4237281e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840ab240b66e4872b86940192e3ddc28'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:59.346815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-05aee5d9-f237-4c84-8589-da4237281e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840ab240b66e4872b86940192e3ddc28'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:59.369562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-05aee5d9-f237-4c84-8589-da4237281e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840ab240b66e4872b86940192e3ddc28'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:59.369562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-05aee5d9-f237-4c84-8589-da4237281e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840ab240b66e4872b86940192e3ddc28'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:59.392009 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-05aee5d9-f237-4c84-8589-da4237281e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840ab240b66e4872b86940192e3ddc28'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:40:59.400346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 876/1779] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:40:58 2022] DELETE /identity/v3/users/840ab240b66e4872b86940192e3ddc28 => generated 0 bytes in 877 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:40:59.862499 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19690f81-d73c-4a48-9a50-0415673bfe7f service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:59.866155 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-19690f81-d73c-4a48-9a50-0415673bfe7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:59.897148 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19690f81-d73c-4a48-9a50-0415673bfe7f service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:59.918512 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aee5d9-f237-4c84-8589-da4237281e5d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:59.925965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-05aee5d9-f237-4c84-8589-da4237281e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:00.084185 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:00.085903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca2e72-a3dd-4474-8be4-3a836bad6d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:00.086937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca2e72-a3dd-4474-8be4-3a836bad6d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:00.087964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca2e72-a3dd-4474-8be4-3a836bad6d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:00.087964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca2e72-a3dd-4474-8be4-3a836bad6d49 admin admin] PATH_INFO: `/v3/projects/d154e6ae8b654283ac52e7a8acb51524` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:00.090085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca2e72-a3dd-4474-8be4-3a836bad6d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d154e6ae8b654283ac52e7a8acb51524)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:00.093435 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca2e72-a3dd-4474-8be4-3a836bad6d49 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:00.102198 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aee5d9-f237-4c84-8589-da4237281e5d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:00.110165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:00.111276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:00.111661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:00.112082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1 admin admin] PATH_INFO: `/v3/projects/81ee583328be46fa83e89b5383174ea6` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:00.114571 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ee583328be46fa83e89b5383174ea6)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:00.117449 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:00.326219 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8dca2e72-a3dd-4474-8be4-3a836bad6d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd154e6ae8b654283ac52e7a8acb51524', 'request_id': 'req-8dca2e72-a3dd-4474-8be4-3a836bad6d49'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:00.358565 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ee583328be46fa83e89b5383174ea6', 'request_id': 'req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:00.366610 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ee583328be46fa83e89b5383174ea6', 'request_id': 'req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:00.372180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8dca2e72-a3dd-4474-8be4-3a836bad6d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd154e6ae8b654283ac52e7a8acb51524', 'request_id': 'req-8dca2e72-a3dd-4474-8be4-3a836bad6d49'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:00.390877 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8dca2e72-a3dd-4474-8be4-3a836bad6d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd154e6ae8b654283ac52e7a8acb51524', 'request_id': 'req-8dca2e72-a3dd-4474-8be4-3a836bad6d49'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:00.398048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ee583328be46fa83e89b5383174ea6', 'request_id': 'req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:00.486010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1 admin admin] The token cache is being invalidate because project 81ee583328be46fa83e89b5383174ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:00.486919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:00.489984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:00.494080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 877/1780] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:40:59 2022] DELETE /identity/v3/projects/81ee583328be46fa83e89b5383174ea6 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:00.495894 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:00.499082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:00.559272 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8dca2e72-a3dd-4474-8be4-3a836bad6d49 admin admin] The token cache is being invalidate because project d154e6ae8b654283ac52e7a8acb51524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:00.559755 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8dca2e72-a3dd-4474-8be4-3a836bad6d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:00.560823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8dca2e72-a3dd-4474-8be4-3a836bad6d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:00.568775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 904/1781] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:40:59 2022] DELETE /identity/v3/projects/d154e6ae8b654283ac52e7a8acb51524 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:00.568775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cac94-4ee1-4c6d-a8b9-ddab4e5d182d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:00.568775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cac94-4ee1-4c6d-a8b9-ddab4e5d182d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:00.568775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cac94-4ee1-4c6d-a8b9-ddab4e5d182d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:00.594420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-523cac94-4ee1-4c6d-a8b9-ddab4e5d182d None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:00.596332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-523cac94-4ee1-4c6d-a8b9-ddab4e5d182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:00.604430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec88e1-34eb-4eb1-a0f2-78a11a7792a1 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:00.609786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6ab49-b32e-46e7-91d3-a07363add1a2 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d43480ec190439ea19b4b7035905de9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe71c0930ba7457cbcd28312a1be7112', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:00.610506 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6ab49-b32e-46e7-91d3-a07363add1a2 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:00.610844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6ab49-b32e-46e7-91d3-a07363add1a2 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:00.611308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6ab49-b32e-46e7-91d3-a07363add1a2 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:00.612209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6ab49-b32e-46e7-91d3-a07363add1a2 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:00.613238 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6ab49-b32e-46e7-91d3-a07363add1a2 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:00.615108 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6ab49-b32e-46e7-91d3-a07363add1a2 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:00.631458 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 878/1782] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:00.633774 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6ab49-b32e-46e7-91d3-a07363add1a2 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:00.637630 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f6a6ab49-b32e-46e7-91d3-a07363add1a2 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:00.727998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6ab49-b32e-46e7-91d3-a07363add1a2 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:00.733072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4fb29-3ef7-4fb0-a46a-a0e68035956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:00.734027 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4fb29-3ef7-4fb0-a46a-a0e68035956a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:00.734314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4fb29-3ef7-4fb0-a46a-a0e68035956a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:00.734622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4fb29-3ef7-4fb0-a46a-a0e68035956a admin admin] PATH_INFO: `/v3/users/577223bb4b0f4ab393c2ae641bfccb7a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:00.735917 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4fb29-3ef7-4fb0-a46a-a0e68035956a admin admin] RBAC: Authorizing `identity:delete_user(user_id=577223bb4b0f4ab393c2ae641bfccb7a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:00.738629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4fb29-3ef7-4fb0-a46a-a0e68035956a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:00.798249 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 905/1783] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:00.799904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cac94-4ee1-4c6d-a8b9-ddab4e5d182d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:00.801910 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-523cac94-4ee1-4c6d-a8b9-ddab4e5d182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:00.822054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cac94-4ee1-4c6d-a8b9-ddab4e5d182d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:00.833737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9cfc8-8779-40d7-9017-a3c6428c41ca tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d43480ec190439ea19b4b7035905de9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe71c0930ba7457cbcd28312a1be7112', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:00.841750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9cfc8-8779-40d7-9017-a3c6428c41ca tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:00.841750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9cfc8-8779-40d7-9017-a3c6428c41ca tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:00.841750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9cfc8-8779-40d7-9017-a3c6428c41ca tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:00.841750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9cfc8-8779-40d7-9017-a3c6428c41ca tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:00.841750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9cfc8-8779-40d7-9017-a3c6428c41ca tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:00.962182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 906/1784] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:00 2022] POST /identity/v3/projects => generated 353 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:00.965496 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70b803-9d3c-4c40-add0-6ba53f96dccb None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:00.965849 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70b803-9d3c-4c40-add0-6ba53f96dccb None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:00.966130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70b803-9d3c-4c40-add0-6ba53f96dccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:00.990619 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-cd70b803-9d3c-4c40-add0-6ba53f96dccb None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:00.992457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-cd70b803-9d3c-4c40-add0-6ba53f96dccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:00.996956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-92c4fb29-3ef7-4fb0-a46a-a0e68035956a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577223bb4b0f4ab393c2ae641bfccb7a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:01.071093 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 907/1785] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:01.071963 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70b803-9d3c-4c40-add0-6ba53f96dccb None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:01.075284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-92c4fb29-3ef7-4fb0-a46a-a0e68035956a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577223bb4b0f4ab393c2ae641bfccb7a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:01.086981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-92c4fb29-3ef7-4fb0-a46a-a0e68035956a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577223bb4b0f4ab393c2ae641bfccb7a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:01.090026 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-92c4fb29-3ef7-4fb0-a46a-a0e68035956a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577223bb4b0f4ab393c2ae641bfccb7a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:01.102861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-92c4fb29-3ef7-4fb0-a46a-a0e68035956a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577223bb4b0f4ab393c2ae641bfccb7a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:01.110150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 879/1786] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:00 2022] DELETE /identity/v3/users/577223bb4b0f4ab393c2ae641bfccb7a => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:01.118779 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4fb29-3ef7-4fb0-a46a-a0e68035956a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:01.118779 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-92c4fb29-3ef7-4fb0-a46a-a0e68035956a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:01.163451 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70b803-9d3c-4c40-add0-6ba53f96dccb None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:01.267127 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4fb29-3ef7-4fb0-a46a-a0e68035956a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:01.268756 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fb715-eca4-46a2-8628-21c96dd8576a tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d43480ec190439ea19b4b7035905de9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe71c0930ba7457cbcd28312a1be7112', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:01.271162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fb715-eca4-46a2-8628-21c96dd8576a tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:01.271450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fb715-eca4-46a2-8628-21c96dd8576a tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:01.271889 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fb715-eca4-46a2-8628-21c96dd8576a tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:01.272684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fb715-eca4-46a2-8628-21c96dd8576a tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:01.272983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:01.273088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fb715-eca4-46a2-8628-21c96dd8576a tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:01.276311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fb715-eca4-46a2-8628-21c96dd8576a tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:01.280705 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384aa579-ac3d-4691-9801-89221f317ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:01.281725 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aa579-ac3d-4691-9801-89221f317ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:01.283143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aa579-ac3d-4691-9801-89221f317ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:01.283854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aa579-ac3d-4691-9801-89221f317ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:01.284997 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384aa579-ac3d-4691-9801-89221f317ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:01.285308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384aa579-ac3d-4691-9801-89221f317ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:01.287619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384aa579-ac3d-4691-9801-89221f317ad6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:01.291627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 908/1787] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:01.316717 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 880/1788] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:01.324053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fb715-eca4-46a2-8628-21c96dd8576a tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:01.340451 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fb715-eca4-46a2-8628-21c96dd8576a tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:01.347118 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bff28-e5c7-4c93-bbcf-65b26ed5334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:01.348334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bff28-e5c7-4c93-bbcf-65b26ed5334b admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:01.349099 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bff28-e5c7-4c93-bbcf-65b26ed5334b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:01.349384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bff28-e5c7-4c93-bbcf-65b26ed5334b admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:01.350252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bff28-e5c7-4c93-bbcf-65b26ed5334b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:01.359855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bff28-e5c7-4c93-bbcf-65b26ed5334b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:01.360000 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384aa579-ac3d-4691-9801-89221f317ad6 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:01.361853 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-384aa579-ac3d-4691-9801-89221f317ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:01.383178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384aa579-ac3d-4691-9801-89221f317ad6 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:01.388344 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d43480ec190439ea19b4b7035905de9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe71c0930ba7457cbcd28312a1be7112', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:01.389013 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:01.389317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:01.389771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] PATH_INFO: `/v3/projects/5da2ea85259a47aca732eec8531c7816` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:01.391193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5da2ea85259a47aca732eec8531c7816)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:01.393197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:01.475270 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 909/1789] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:01 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:41:01.476238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bff28-e5c7-4c93-bbcf-65b26ed5334b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:01.517797 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da2ea85259a47aca732eec8531c7816', 'request_id': 'req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:01.524073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da2ea85259a47aca732eec8531c7816', 'request_id': 'req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:01.531354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da2ea85259a47aca732eec8531c7816', 'request_id': 'req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:01.543289 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bff28-e5c7-4c93-bbcf-65b26ed5334b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:01.628067 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18974bb2-f1e6-4861-ac63-cf2bf76e99dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:01.628067 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18974bb2-f1e6-4861-ac63-cf2bf76e99dc admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:01.628067 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18974bb2-f1e6-4861-ac63-cf2bf76e99dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:01.628067 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18974bb2-f1e6-4861-ac63-cf2bf76e99dc admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:01.628852 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18974bb2-f1e6-4861-ac63-cf2bf76e99dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:01.628852 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18974bb2-f1e6-4861-ac63-cf2bf76e99dc admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:01.664145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] The token cache is being invalidate because project 5da2ea85259a47aca732eec8531c7816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:01.664613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:01.665442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:01.671084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 881/1790] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:01 2022] DELETE /identity/v3/projects/5da2ea85259a47aca732eec8531c7816 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:01.806306 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 910/1791] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:01 2022] POST /identity/v3/users => generated 294 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:01.810210 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:01.811729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:01.833982 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90ecbe-7a6c-47dc-9b73-bbaad769f124 tempest-VolumeQuotaClassesTest-1993794983 tempest-VolumeQuotaClassesTest-1993794983-project-admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:01.842770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8858f1-c780-4080-bbd5-e9b4659a491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:01.844317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8858f1-c780-4080-bbd5-e9b4659a491f admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:01.844767 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8858f1-c780-4080-bbd5-e9b4659a491f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:01.845216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8858f1-c780-4080-bbd5-e9b4659a491f admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:01.846743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8858f1-c780-4080-bbd5-e9b4659a491f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:01.850720 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8858f1-c780-4080-bbd5-e9b4659a491f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:01.872784 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 882/1792] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:01.876592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18974bb2-f1e6-4861-ac63-cf2bf76e99dc admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:01.891889 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18974bb2-f1e6-4861-ac63-cf2bf76e99dc admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:01.899131 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf88f2-be2c-46e2-8a98-d27077a1f75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:01.899866 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf88f2-be2c-46e2-8a98-d27077a1f75a admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:01.900150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf88f2-be2c-46e2-8a98-d27077a1f75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:01.900480 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf88f2-be2c-46e2-8a98-d27077a1f75a admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:01.901352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf88f2-be2c-46e2-8a98-d27077a1f75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:01.903382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf88f2-be2c-46e2-8a98-d27077a1f75a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:01.916363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8858f1-c780-4080-bbd5-e9b4659a491f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:01.918485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1e8858f1-c780-4080-bbd5-e9b4659a491f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:01.943711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8858f1-c780-4080-bbd5-e9b4659a491f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:01.944468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 911/1793] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:41:01.945986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf88f2-be2c-46e2-8a98-d27077a1f75a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:01.955464 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086d3b2-4144-4983-bb47-6896bf0e324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:01.956903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086d3b2-4144-4983-bb47-6896bf0e324d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:01.958729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086d3b2-4144-4983-bb47-6896bf0e324d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:01.959993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086d3b2-4144-4983-bb47-6896bf0e324d admin admin] PATH_INFO: `/v3/projects/ee9587507dce4519adf64c0eabedd082` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:01.962866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086d3b2-4144-4983-bb47-6896bf0e324d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9587507dce4519adf64c0eabedd082)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:01.967187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf88f2-be2c-46e2-8a98-d27077a1f75a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:01.969959 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086d3b2-4144-4983-bb47-6896bf0e324d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:01.983072 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9184a3-ea9d-4698-bc5a-9bb736c5d123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:01.985054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9184a3-ea9d-4698-bc5a-9bb736c5d123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:01.985054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9184a3-ea9d-4698-bc5a-9bb736c5d123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:01.986302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9184a3-ea9d-4698-bc5a-9bb736c5d123 admin admin] PATH_INFO: `/v3/projects/083d226e2a8e4d28a8fd2e51258d16a4/users/504dbb76cdd947b88ac2d6f2296cd7eb/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:02.017975 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9184a3-ea9d-4698-bc5a-9bb736c5d123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083d226e2a8e4d28a8fd2e51258d16a4, user_id=504dbb76cdd947b88ac2d6f2296cd7eb, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:02.023495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9184a3-ea9d-4698-bc5a-9bb736c5d123 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:02.221092 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 912/1794] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:01 2022] PUT /identity/v3/projects/083d226e2a8e4d28a8fd2e51258d16a4/users/504dbb76cdd947b88ac2d6f2296cd7eb/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:02.234655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b78a05-6ed4-4cd0-8b99-c8edd2e1b1aa None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:02.235375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b78a05-6ed4-4cd0-8b99-c8edd2e1b1aa None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:02.236510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b78a05-6ed4-4cd0-8b99-c8edd2e1b1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:02.269848 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7086d3b2-4144-4983-bb47-6896bf0e324d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9587507dce4519adf64c0eabedd082', 'request_id': 'req-7086d3b2-4144-4983-bb47-6896bf0e324d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:02.272722 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e7b78a05-6ed4-4cd0-8b99-c8edd2e1b1aa None None] MFA Rules not processed for user `504dbb76cdd947b88ac2d6f2296cd7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:02.274438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e7b78a05-6ed4-4cd0-8b99-c8edd2e1b1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:02.278005 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7086d3b2-4144-4983-bb47-6896bf0e324d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9587507dce4519adf64c0eabedd082', 'request_id': 'req-7086d3b2-4144-4983-bb47-6896bf0e324d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:02.283681 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7086d3b2-4144-4983-bb47-6896bf0e324d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9587507dce4519adf64c0eabedd082', 'request_id': 'req-7086d3b2-4144-4983-bb47-6896bf0e324d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:02.369341 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7086d3b2-4144-4983-bb47-6896bf0e324d admin admin] The token cache is being invalidate because project ee9587507dce4519adf64c0eabedd082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:02.369635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7086d3b2-4144-4983-bb47-6896bf0e324d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:02.370698 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7086d3b2-4144-4983-bb47-6896bf0e324d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:02.384207 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 883/1795] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:01 2022] DELETE /identity/v3/projects/ee9587507dce4519adf64c0eabedd082 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:02.391860 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b17286-dfac-4b34-b032-20e3bc3b8dc8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:02.392647 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b17286-dfac-4b34-b032-20e3bc3b8dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:02.392934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b17286-dfac-4b34-b032-20e3bc3b8dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:02.421878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-25b17286-dfac-4b34-b032-20e3bc3b8dc8 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:02.423955 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-25b17286-dfac-4b34-b032-20e3bc3b8dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:02.447414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 913/1796] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:02.452753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b78a05-6ed4-4cd0-8b99-c8edd2e1b1aa None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:02.456280 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e7b78a05-6ed4-4cd0-8b99-c8edd2e1b1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:02.538440 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 884/1797] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:02.543810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aba68-5831-49bd-864a-5aa66c6c6dde None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:02.544379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aba68-5831-49bd-864a-5aa66c6c6dde None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:02.545474 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aba68-5831-49bd-864a-5aa66c6c6dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:02.569063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b78a05-6ed4-4cd0-8b99-c8edd2e1b1aa None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:02.571674 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-566aba68-5831-49bd-864a-5aa66c6c6dde None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:02.575277 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-566aba68-5831-49bd-864a-5aa66c6c6dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:02.579053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4154d18-1a48-442a-9d82-c49cbf29275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:02.579852 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4154d18-1a48-442a-9d82-c49cbf29275f admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:02.580314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4154d18-1a48-442a-9d82-c49cbf29275f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:02.580522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4154d18-1a48-442a-9d82-c49cbf29275f admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:02.581245 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4154d18-1a48-442a-9d82-c49cbf29275f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:02.586367 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 885/1798] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:02.589694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566aba68-5831-49bd-864a-5aa66c6c6dde None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:02.591167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4154d18-1a48-442a-9d82-c49cbf29275f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:02.604866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566aba68-5831-49bd-864a-5aa66c6c6dde None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:02.617261 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95197696-668f-47c0-9e4d-d3a7c29680c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:02.618027 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197696-668f-47c0-9e4d-d3a7c29680c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:02.618350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197696-668f-47c0-9e4d-d3a7c29680c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:02.618808 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197696-668f-47c0-9e4d-d3a7c29680c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:02.622694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95197696-668f-47c0-9e4d-d3a7c29680c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:02.622694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95197696-668f-47c0-9e4d-d3a7c29680c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:02.622694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95197696-668f-47c0-9e4d-d3a7c29680c2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:02.667908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 886/1799] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:41:02.667908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95197696-668f-47c0-9e4d-d3a7c29680c2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:02.682542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95197696-668f-47c0-9e4d-d3a7c29680c2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:02.702928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925040f-bf29-4aec-841a-57ff4e8561b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:02.702928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925040f-bf29-4aec-841a-57ff4e8561b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:02.702928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925040f-bf29-4aec-841a-57ff4e8561b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:02.702928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925040f-bf29-4aec-841a-57ff4e8561b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:02.703903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925040f-bf29-4aec-841a-57ff4e8561b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:02.703903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925040f-bf29-4aec-841a-57ff4e8561b0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:02.768020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 914/1800] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:02 2022] POST /identity/v3/projects => generated 385 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:41:02.768020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4154d18-1a48-442a-9d82-c49cbf29275f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:02.768020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c4154d18-1a48-442a-9d82-c49cbf29275f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:02.851885 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4154d18-1a48-442a-9d82-c49cbf29275f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:02.857308 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a00520-759d-4195-bf22-dba823a9d3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:02.867072 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a00520-759d-4195-bf22-dba823a9d3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:02.872489 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 887/1801] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:02 2022] POST /identity/v3/projects => generated 379 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:02.873462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925040f-bf29-4aec-841a-57ff4e8561b0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:02.873918 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a00520-759d-4195-bf22-dba823a9d3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:02.874759 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a00520-759d-4195-bf22-dba823a9d3b4 admin admin] PATH_INFO: `/v3/users/ddd206adcade4c0bbe2fdd11d7f57a7f` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:02.876907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a00520-759d-4195-bf22-dba823a9d3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd206adcade4c0bbe2fdd11d7f57a7f)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:02.881055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a00520-759d-4195-bf22-dba823a9d3b4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:03.031844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925040f-bf29-4aec-841a-57ff4e8561b0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:03.037323 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf425d-f264-4005-adc6-234031578835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:03.038154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf425d-f264-4005-adc6-234031578835 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:03.038611 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf425d-f264-4005-adc6-234031578835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:03.038972 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf425d-f264-4005-adc6-234031578835 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:03.039781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf425d-f264-4005-adc6-234031578835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:03.042053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf425d-f264-4005-adc6-234031578835 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:03.189425 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02a00520-759d-4195-bf22-dba823a9d3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd206adcade4c0bbe2fdd11d7f57a7f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:03.307113 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 888/1802] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:02 2022] POST /identity/v3/users => generated 299 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:03.307863 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf425d-f264-4005-adc6-234031578835 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:03.322889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf425d-f264-4005-adc6-234031578835 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:03.329164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cce02-7c06-48b7-a976-fac5eebe8bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:03.329948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cce02-7c06-48b7-a976-fac5eebe8bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:03.330426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cce02-7c06-48b7-a976-fac5eebe8bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:03.330841 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cce02-7c06-48b7-a976-fac5eebe8bbe admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:03.332188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cce02-7c06-48b7-a976-fac5eebe8bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:03.334657 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cce02-7c06-48b7-a976-fac5eebe8bbe admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:03.353260 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02a00520-759d-4195-bf22-dba823a9d3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd206adcade4c0bbe2fdd11d7f57a7f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:03.363658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02a00520-759d-4195-bf22-dba823a9d3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd206adcade4c0bbe2fdd11d7f57a7f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:03.365567 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02a00520-759d-4195-bf22-dba823a9d3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd206adcade4c0bbe2fdd11d7f57a7f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:03.386942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02a00520-759d-4195-bf22-dba823a9d3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd206adcade4c0bbe2fdd11d7f57a7f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:03.398598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 915/1803] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:02 2022] DELETE /identity/v3/users/ddd206adcade4c0bbe2fdd11d7f57a7f => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:03.398598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5a0e2-6823-4899-9d74-2b0102e0974d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:03.398598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5a0e2-6823-4899-9d74-2b0102e0974d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:03.398598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5a0e2-6823-4899-9d74-2b0102e0974d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:03.460658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 889/1804] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:03 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:03.460658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cce02-7c06-48b7-a976-fac5eebe8bbe admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:03.463082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-da5cce02-7c06-48b7-a976-fac5eebe8bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:03.474255 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-95c5a0e2-6823-4899-9d74-2b0102e0974d None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:03.475862 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-95c5a0e2-6823-4899-9d74-2b0102e0974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:03.480195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cce02-7c06-48b7-a976-fac5eebe8bbe admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:03.564074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140e508-f142-4a6c-8dd6-3f71512a53ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:03.565124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140e508-f142-4a6c-8dd6-3f71512a53ec admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:03.570608 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140e508-f142-4a6c-8dd6-3f71512a53ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:03.570608 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140e508-f142-4a6c-8dd6-3f71512a53ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:03.570608 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140e508-f142-4a6c-8dd6-3f71512a53ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:03.570608 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140e508-f142-4a6c-8dd6-3f71512a53ec admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:03.584097 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 890/1805] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:03.585658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769825e-a9db-490a-8311-9b26c1afc240 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:03.586032 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769825e-a9db-490a-8311-9b26c1afc240 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:03.586406 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769825e-a9db-490a-8311-9b26c1afc240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:03.598879 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 916/1806] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 18 10:41:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:03.599936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5a0e2-6823-4899-9d74-2b0102e0974d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:03.601419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-95c5a0e2-6823-4899-9d74-2b0102e0974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:03.608082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d769825e-a9db-490a-8311-9b26c1afc240 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:03.609365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d769825e-a9db-490a-8311-9b26c1afc240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:03.619897 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 891/1807] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:03.620615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769825e-a9db-490a-8311-9b26c1afc240 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:03.626726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5a0e2-6823-4899-9d74-2b0102e0974d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:03.633064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769825e-a9db-490a-8311-9b26c1afc240 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:03.634937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230aa8c-7caa-440c-ae57-d2c3a5fe5940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:03.636057 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230aa8c-7caa-440c-ae57-d2c3a5fe5940 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:03.636663 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230aa8c-7caa-440c-ae57-d2c3a5fe5940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:03.637036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230aa8c-7caa-440c-ae57-d2c3a5fe5940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:03.638066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230aa8c-7caa-440c-ae57-d2c3a5fe5940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:03.638567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672132c-79ab-4d40-a232-5f22bf0a9c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:03.639994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672132c-79ab-4d40-a232-5f22bf0a9c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:03.640138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230aa8c-7caa-440c-ae57-d2c3a5fe5940 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:03.640230 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672132c-79ab-4d40-a232-5f22bf0a9c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:03.640230 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672132c-79ab-4d40-a232-5f22bf0a9c0d admin admin] PATH_INFO: `/v3/projects/603dd991de8a42cc8d10c6855b546c4d/users/c1a92c25a72a4b8b8567dae186d002f8/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:03.655620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 917/1808] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:03.657827 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230aa8c-7caa-440c-ae57-d2c3a5fe5940 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:03.658218 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672132c-79ab-4d40-a232-5f22bf0a9c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=603dd991de8a42cc8d10c6855b546c4d, user_id=c1a92c25a72a4b8b8567dae186d002f8, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:03.659749 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b230aa8c-7caa-440c-ae57-d2c3a5fe5940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:03.664693 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672132c-79ab-4d40-a232-5f22bf0a9c0d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:03.761847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230aa8c-7caa-440c-ae57-d2c3a5fe5940 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:03.766295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f23f9-43e9-48ea-9566-1902bb8b18f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:03.767228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f23f9-43e9-48ea-9566-1902bb8b18f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:03.767664 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f23f9-43e9-48ea-9566-1902bb8b18f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:03.768128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f23f9-43e9-48ea-9566-1902bb8b18f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:03.785935 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f23f9-43e9-48ea-9566-1902bb8b18f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:03.788199 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f23f9-43e9-48ea-9566-1902bb8b18f8 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:03.810495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:03.812560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 918/1809] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:03.815043 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f23f9-43e9-48ea-9566-1902bb8b18f8 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:03.821943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 892/1810] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:03 2022] PUT /identity/v3/projects/603dd991de8a42cc8d10c6855b546c4d/users/c1a92c25a72a4b8b8567dae186d002f8/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:03.830162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672132c-79ab-4d40-a232-5f22bf0a9c0d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:03.842180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f23f9-43e9-48ea-9566-1902bb8b18f8 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:03.994403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727971cc-e440-4af6-a7a7-72effeb5b2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:03.995990 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727971cc-e440-4af6-a7a7-72effeb5b2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:04.001051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727971cc-e440-4af6-a7a7-72effeb5b2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:04.001457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727971cc-e440-4af6-a7a7-72effeb5b2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:04.008648 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727971cc-e440-4af6-a7a7-72effeb5b2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:04.013587 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727971cc-e440-4af6-a7a7-72effeb5b2a1 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:04.031934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672132c-79ab-4d40-a232-5f22bf0a9c0d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:04.054292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b540fa-0262-49b4-b00c-7ec5d70985ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:04.055290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b540fa-0262-49b4-b00c-7ec5d70985ba admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:04.056136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b540fa-0262-49b4-b00c-7ec5d70985ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:04.057546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b540fa-0262-49b4-b00c-7ec5d70985ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:04.059192 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b540fa-0262-49b4-b00c-7ec5d70985ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:04.060298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 919/1811] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:04.065532 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727971cc-e440-4af6-a7a7-72effeb5b2a1 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:04.073900 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b540fa-0262-49b4-b00c-7ec5d70985ba admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:04.094854 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727971cc-e440-4af6-a7a7-72effeb5b2a1 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:04.101922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141aa36-c76f-4f27-ae32-5e9cdb8c6a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:04.103232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141aa36-c76f-4f27-ae32-5e9cdb8c6a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:04.107115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141aa36-c76f-4f27-ae32-5e9cdb8c6a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:04.107115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141aa36-c76f-4f27-ae32-5e9cdb8c6a5c admin admin] PATH_INFO: `/v3/projects/f04687e722054da199be74f701960951/users/f1f96e368506424aba353613976cc44b/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:04.107406 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 893/1812] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:04.109875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b540fa-0262-49b4-b00c-7ec5d70985ba admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:04.136371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b540fa-0262-49b4-b00c-7ec5d70985ba admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:04.136643 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141aa36-c76f-4f27-ae32-5e9cdb8c6a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04687e722054da199be74f701960951, user_id=f1f96e368506424aba353613976cc44b, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:04.139971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141aa36-c76f-4f27-ae32-5e9cdb8c6a5c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:04.146012 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8149d-bb3a-4c58-83e0-410db15f9636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:04.157823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8149d-bb3a-4c58-83e0-410db15f9636 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:04.157823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8149d-bb3a-4c58-83e0-410db15f9636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:04.157823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8149d-bb3a-4c58-83e0-410db15f9636 admin admin] PATH_INFO: `/v3/projects/603dd991de8a42cc8d10c6855b546c4d/users/c1a92c25a72a4b8b8567dae186d002f8/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:04.157823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8149d-bb3a-4c58-83e0-410db15f9636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603dd991de8a42cc8d10c6855b546c4d, user_id=c1a92c25a72a4b8b8567dae186d002f8, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:04.157823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8149d-bb3a-4c58-83e0-410db15f9636 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:04.182184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 894/1813] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:04 2022] PUT /identity/v3/projects/603dd991de8a42cc8d10c6855b546c4d/users/c1a92c25a72a4b8b8567dae186d002f8/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:04.186523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4b3d2-b7aa-49c3-902c-8ceab40bbca0 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:04.186812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4b3d2-b7aa-49c3-902c-8ceab40bbca0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:04.187089 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4b3d2-b7aa-49c3-902c-8ceab40bbca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:04.229692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-77c4b3d2-b7aa-49c3-902c-8ceab40bbca0 None None] MFA Rules not processed for user `c1a92c25a72a4b8b8567dae186d002f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:04.231203 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-77c4b3d2-b7aa-49c3-902c-8ceab40bbca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:04.323770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 920/1814] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:04 2022] PUT /identity/v3/projects/f04687e722054da199be74f701960951/users/f1f96e368506424aba353613976cc44b/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:04.324805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141aa36-c76f-4f27-ae32-5e9cdb8c6a5c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:04.328192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0141aa36-c76f-4f27-ae32-5e9cdb8c6a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:04.390945 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 895/1815] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:04.393273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf2fbd-29f8-4a33-acaa-945ca1b51927 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:04.393768 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf2fbd-29f8-4a33-acaa-945ca1b51927 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:04.394316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf2fbd-29f8-4a33-acaa-945ca1b51927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:04.501042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-30cf2fbd-29f8-4a33-acaa-945ca1b51927 None None] MFA Rules not processed for user `f1f96e368506424aba353613976cc44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:04.504831 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-30cf2fbd-29f8-4a33-acaa-945ca1b51927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:04.567420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141aa36-c76f-4f27-ae32-5e9cdb8c6a5c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:04.578081 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c6775-c83b-4ee4-bfc9-6412dea1f094 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:04.579518 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c6775-c83b-4ee4-bfc9-6412dea1f094 service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:04.580246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c6775-c83b-4ee4-bfc9-6412dea1f094 service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:04.580786 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c6775-c83b-4ee4-bfc9-6412dea1f094 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:04.617879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:04.697279 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 896/1816] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:04.699103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05871f-bbba-4abd-a464-73017297d895 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:04.699624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05871f-bbba-4abd-a464-73017297d895 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:04.700041 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05871f-bbba-4abd-a464-73017297d895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:04.727198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:04.733566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3c05871f-bbba-4abd-a464-73017297d895 None None] MFA Rules not processed for user `3f9385dec85a4e0cba21c2a840124f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:04.733566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3c05871f-bbba-4abd-a464-73017297d895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:04.760458 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c6775-c83b-4ee4-bfc9-6412dea1f094 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:04.764778 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c6775-c83b-4ee4-bfc9-6412dea1f094 service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:04.793130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 921/1817] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:41:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:41:04.797278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c6775-c83b-4ee4-bfc9-6412dea1f094 service swift] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:04.799752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e42c6775-c83b-4ee4-bfc9-6412dea1f094 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:04.822146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 897/1818] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Jul 18 10:41:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:04.822146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05871f-bbba-4abd-a464-73017297d895 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:05.087278 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05871f-bbba-4abd-a464-73017297d895 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:05.090907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c6775-c83b-4ee4-bfc9-6412dea1f094 service swift] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:05.096124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b046abc-f22c-4fcd-879f-d99e57ca383f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:05.098178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b046abc-f22c-4fcd-879f-d99e57ca383f service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:05.100345 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b046abc-f22c-4fcd-879f-d99e57ca383f service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:05.100883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b046abc-f22c-4fcd-879f-d99e57ca383f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:05.111651 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e4ce5-ef45-4c23-9cf0-a0d47fdeab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:05.112355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e4ce5-ef45-4c23-9cf0-a0d47fdeab3d admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:05.114610 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e4ce5-ef45-4c23-9cf0-a0d47fdeab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:05.114948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e4ce5-ef45-4c23-9cf0-a0d47fdeab3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:05.115783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e4ce5-ef45-4c23-9cf0-a0d47fdeab3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:05.117906 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e4ce5-ef45-4c23-9cf0-a0d47fdeab3d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:05.336534 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b046abc-f22c-4fcd-879f-d99e57ca383f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:05.345701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b046abc-f22c-4fcd-879f-d99e57ca383f service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:05.386267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 922/1819] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:05.390165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b046abc-f22c-4fcd-879f-d99e57ca383f service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:05.393204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5b046abc-f22c-4fcd-879f-d99e57ca383f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:05.425274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 898/1820] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:04 2022] POST /identity/v3/projects => generated 379 bytes in 601 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:05.425274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e4ce5-ef45-4c23-9cf0-a0d47fdeab3d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:05.438295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d25e4ce5-ef45-4c23-9cf0-a0d47fdeab3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:05.519619 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b046abc-f22c-4fcd-879f-d99e57ca383f service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:05.592552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e4ce5-ef45-4c23-9cf0-a0d47fdeab3d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:05.611186 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd41b7-4344-4838-8de5-5122a8514bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:05.614355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd41b7-4344-4838-8de5-5122a8514bcb service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:05.616479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd41b7-4344-4838-8de5-5122a8514bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:05.616479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd41b7-4344-4838-8de5-5122a8514bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:05.650052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd41b7-4344-4838-8de5-5122a8514bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:05.656694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd41b7-4344-4838-8de5-5122a8514bcb service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:05.674120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 899/1821] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:05.675665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd41b7-4344-4838-8de5-5122a8514bcb service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:05.677144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c5cd41b7-4344-4838-8de5-5122a8514bcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:05.756228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa38da-e9e9-441a-a12a-a879f9c8eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:05.757931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa38da-e9e9-441a-a12a-a879f9c8eba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:05.758505 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa38da-e9e9-441a-a12a-a879f9c8eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:05.759012 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa38da-e9e9-441a-a12a-a879f9c8eba2 admin admin] PATH_INFO: `/v3/users/be79776c4c204f6eb3f34963bb34a09f` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:05.764454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa38da-e9e9-441a-a12a-a879f9c8eba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be79776c4c204f6eb3f34963bb34a09f)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:05.793153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa38da-e9e9-441a-a12a-a879f9c8eba2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:05.913153 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd41b7-4344-4838-8de5-5122a8514bcb service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:05.924455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1aedd-ab77-4ecc-9645-81e668c17ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:05.926183 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1aedd-ab77-4ecc-9645-81e668c17ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:05.926344 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1aedd-ab77-4ecc-9645-81e668c17ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:05.928269 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1aedd-ab77-4ecc-9645-81e668c17ee0 admin admin] PATH_INFO: `/v3/projects/b9776b808aaf4f7abb91bafc6d408b51` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:05.932302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1aedd-ab77-4ecc-9645-81e668c17ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9776b808aaf4f7abb91bafc6d408b51)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:05.934118 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1aedd-ab77-4ecc-9645-81e668c17ee0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:06.089704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-46f1aedd-ab77-4ecc-9645-81e668c17ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9776b808aaf4f7abb91bafc6d408b51', 'request_id': 'req-46f1aedd-ab77-4ecc-9645-81e668c17ee0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:06.100547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-46f1aedd-ab77-4ecc-9645-81e668c17ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9776b808aaf4f7abb91bafc6d408b51', 'request_id': 'req-46f1aedd-ab77-4ecc-9645-81e668c17ee0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:06.114628 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-46f1aedd-ab77-4ecc-9645-81e668c17ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9776b808aaf4f7abb91bafc6d408b51', 'request_id': 'req-46f1aedd-ab77-4ecc-9645-81e668c17ee0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:06.114728 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a2fa38da-e9e9-441a-a12a-a879f9c8eba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be79776c4c204f6eb3f34963bb34a09f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:06.231485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-46f1aedd-ab77-4ecc-9645-81e668c17ee0 admin admin] The token cache is being invalidate because project b9776b808aaf4f7abb91bafc6d408b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:06.232106 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-46f1aedd-ab77-4ecc-9645-81e668c17ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:06.233540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-46f1aedd-ab77-4ecc-9645-81e668c17ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:06.239028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 900/1822] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:05 2022] DELETE /identity/v3/projects/b9776b808aaf4f7abb91bafc6d408b51 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:06.241522 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1aedd-ab77-4ecc-9645-81e668c17ee0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:06.245625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-46f1aedd-ab77-4ecc-9645-81e668c17ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:06.338663 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a2fa38da-e9e9-441a-a12a-a879f9c8eba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be79776c4c204f6eb3f34963bb34a09f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:06.350547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a2fa38da-e9e9-441a-a12a-a879f9c8eba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be79776c4c204f6eb3f34963bb34a09f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:06.352628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a2fa38da-e9e9-441a-a12a-a879f9c8eba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be79776c4c204f6eb3f34963bb34a09f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:06.410976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1aedd-ab77-4ecc-9645-81e668c17ee0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:06.426367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a2fa38da-e9e9-441a-a12a-a879f9c8eba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be79776c4c204f6eb3f34963bb34a09f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:06.433368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586ab5f-a998-465f-9f25-eeee5dfc9da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:06.434692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586ab5f-a998-465f-9f25-eeee5dfc9da4 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:06.435473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586ab5f-a998-465f-9f25-eeee5dfc9da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:06.436028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586ab5f-a998-465f-9f25-eeee5dfc9da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:06.449257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4586ab5f-a998-465f-9f25-eeee5dfc9da4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:06.463193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 923/1823] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:05 2022] DELETE /identity/v3/users/be79776c4c204f6eb3f34963bb34a09f => generated 0 bytes in 1076 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:06.469007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa38da-e9e9-441a-a12a-a879f9c8eba2 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:06.481162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a2fa38da-e9e9-441a-a12a-a879f9c8eba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:06.505299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586ab5f-a998-465f-9f25-eeee5dfc9da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:06.509733 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586ab5f-a998-465f-9f25-eeee5dfc9da4 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:06.535560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 901/1824] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:06.537417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586ab5f-a998-465f-9f25-eeee5dfc9da4 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:06.543048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:06.544171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4586ab5f-a998-465f-9f25-eeee5dfc9da4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:06.593629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:06.674008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa38da-e9e9-441a-a12a-a879f9c8eba2 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:06.683962 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586ab5f-a998-465f-9f25-eeee5dfc9da4 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:06.690223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa99cbd-f4f3-4beb-bc74-b00faf88d8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:06.692147 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa99cbd-f4f3-4beb-bc74-b00faf88d8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:06.692449 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa99cbd-f4f3-4beb-bc74-b00faf88d8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:06.692731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa99cbd-f4f3-4beb-bc74-b00faf88d8a8 admin admin] PATH_INFO: `/v3/users/504dbb76cdd947b88ac2d6f2296cd7eb` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:06.694702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa99cbd-f4f3-4beb-bc74-b00faf88d8a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=504dbb76cdd947b88ac2d6f2296cd7eb)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:06.696704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa99cbd-f4f3-4beb-bc74-b00faf88d8a8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:06.922222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeafa74-c6ca-4da1-acad-43c1b7435d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:06.922222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeafa74-c6ca-4da1-acad-43c1b7435d4f admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:06.922222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeafa74-c6ca-4da1-acad-43c1b7435d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:06.922222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeafa74-c6ca-4da1-acad-43c1b7435d4f admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:06.923504 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeafa74-c6ca-4da1-acad-43c1b7435d4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:06.923504 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeafa74-c6ca-4da1-acad-43c1b7435d4f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:07.141195 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 924/1825] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:06 2022] POST /identity/v3/users => generated 296 bytes in 677 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:07.146471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeafa74-c6ca-4da1-acad-43c1b7435d4f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:07.149281 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7eeafa74-c6ca-4da1-acad-43c1b7435d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:07.191912 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeafa74-c6ca-4da1-acad-43c1b7435d4f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:07.193160 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce7496-d569-4c5d-a6b3-ccbcd2a334a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:07.195541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce7496-d569-4c5d-a6b3-ccbcd2a334a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:07.196169 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce7496-d569-4c5d-a6b3-ccbcd2a334a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:07.197345 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce7496-d569-4c5d-a6b3-ccbcd2a334a2 admin admin] PATH_INFO: `/v3/users/76421d46410b4b898c4df6fce85e63d2` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:07.201162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce7496-d569-4c5d-a6b3-ccbcd2a334a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76421d46410b4b898c4df6fce85e63d2)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:07.204814 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce7496-d569-4c5d-a6b3-ccbcd2a334a2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:07.239610 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9fa99cbd-f4f3-4beb-bc74-b00faf88d8a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '504dbb76cdd947b88ac2d6f2296cd7eb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:07.648137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9fa99cbd-f4f3-4beb-bc74-b00faf88d8a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '504dbb76cdd947b88ac2d6f2296cd7eb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:07.660492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9fa99cbd-f4f3-4beb-bc74-b00faf88d8a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '504dbb76cdd947b88ac2d6f2296cd7eb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:07.672540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9fa99cbd-f4f3-4beb-bc74-b00faf88d8a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '504dbb76cdd947b88ac2d6f2296cd7eb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:07.703098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9fa99cbd-f4f3-4beb-bc74-b00faf88d8a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '504dbb76cdd947b88ac2d6f2296cd7eb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:07.725915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 902/1826] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:06 2022] DELETE /identity/v3/users/504dbb76cdd947b88ac2d6f2296cd7eb => generated 0 bytes in 1186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:07.727242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa99cbd-f4f3-4beb-bc74-b00faf88d8a8 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:07.733983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9fa99cbd-f4f3-4beb-bc74-b00faf88d8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:07.937160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa99cbd-f4f3-4beb-bc74-b00faf88d8a8 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:07.948374 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85c624-f091-472c-a166-fc369d1a2a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:07.949494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c624-f091-472c-a166-fc369d1a2a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:07.949793 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c624-f091-472c-a166-fc369d1a2a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:07.950094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c624-f091-472c-a166-fc369d1a2a42 admin admin] PATH_INFO: `/v3/users/8d43480ec190439ea19b4b7035905de9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:07.957622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85c624-f091-472c-a166-fc369d1a2a42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d43480ec190439ea19b4b7035905de9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:07.959988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85c624-f091-472c-a166-fc369d1a2a42 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:08.083290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6dce7496-d569-4c5d-a6b3-ccbcd2a334a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76421d46410b4b898c4df6fce85e63d2'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:08.184952 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:08.218695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6dce7496-d569-4c5d-a6b3-ccbcd2a334a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76421d46410b4b898c4df6fce85e63d2'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:08.270190 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6dce7496-d569-4c5d-a6b3-ccbcd2a334a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76421d46410b4b898c4df6fce85e63d2'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:08.271262 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6dce7496-d569-4c5d-a6b3-ccbcd2a334a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76421d46410b4b898c4df6fce85e63d2'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:08.307899 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9f85c624-f091-472c-a166-fc369d1a2a42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d43480ec190439ea19b4b7035905de9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:08.321071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6dce7496-d569-4c5d-a6b3-ccbcd2a334a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76421d46410b4b898c4df6fce85e63d2'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:08.335744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 925/1827] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:07 2022] DELETE /identity/v3/users/76421d46410b4b898c4df6fce85e63d2 => generated 0 bytes in 1194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:08.338294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb0ed7-b5ca-4fe8-a852-68c146aa3a63 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:08.338942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb0ed7-b5ca-4fe8-a852-68c146aa3a63 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:08.339480 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb0ed7-b5ca-4fe8-a852-68c146aa3a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:08.452084 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-72bb0ed7-b5ca-4fe8-a852-68c146aa3a63 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:08.457794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-72bb0ed7-b5ca-4fe8-a852-68c146aa3a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:08.516400 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9f85c624-f091-472c-a166-fc369d1a2a42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d43480ec190439ea19b4b7035905de9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:08.531478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9f85c624-f091-472c-a166-fc369d1a2a42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d43480ec190439ea19b4b7035905de9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:08.531745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9f85c624-f091-472c-a166-fc369d1a2a42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d43480ec190439ea19b4b7035905de9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:08.566155 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9f85c624-f091-472c-a166-fc369d1a2a42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d43480ec190439ea19b4b7035905de9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:08.582144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 903/1828] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:07 2022] DELETE /identity/v3/users/8d43480ec190439ea19b4b7035905de9 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:08.583042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85c624-f091-472c-a166-fc369d1a2a42 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:08.590042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9f85c624-f091-472c-a166-fc369d1a2a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:08.687028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 926/1829] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:08.690856 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d800d-315f-4733-9453-e1b038d7d5e6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:08.692128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d800d-315f-4733-9453-e1b038d7d5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:08.692631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d800d-315f-4733-9453-e1b038d7d5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:08.808514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85c624-f091-472c-a166-fc369d1a2a42 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:08.810426 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-bd4d800d-315f-4733-9453-e1b038d7d5e6 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:08.810426 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-bd4d800d-315f-4733-9453-e1b038d7d5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:08.811023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57545b-7a54-46ee-9e81-588583ed87b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:08.811023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57545b-7a54-46ee-9e81-588583ed87b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:08.811023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57545b-7a54-46ee-9e81-588583ed87b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:08.811023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57545b-7a54-46ee-9e81-588583ed87b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:08.811315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57545b-7a54-46ee-9e81-588583ed87b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:08.811315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57545b-7a54-46ee-9e81-588583ed87b4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:08.811315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 904/1830] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:08.811315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6969b-fe51-4d82-b4c7-eabba65ccfed None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:08.811315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6969b-fe51-4d82-b4c7-eabba65ccfed None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:08.811315 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6969b-fe51-4d82-b4c7-eabba65ccfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:08.811713 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 927/1831] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:08.811713 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d800d-315f-4733-9453-e1b038d7d5e6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:08.838266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d3b6969b-fe51-4d82-b4c7-eabba65ccfed None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:08.839546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d3b6969b-fe51-4d82-b4c7-eabba65ccfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:08.849462 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d800d-315f-4733-9453-e1b038d7d5e6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:08.860897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539d35f-fe73-467d-8b6e-15df3714fc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:08.869047 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 905/1832] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:08.870175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6969b-fe51-4d82-b4c7-eabba65ccfed None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:08.872139 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d3b6969b-fe51-4d82-b4c7-eabba65ccfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:08.897338 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539d35f-fe73-467d-8b6e-15df3714fc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:08.897690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539d35f-fe73-467d-8b6e-15df3714fc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:08.897934 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539d35f-fe73-467d-8b6e-15df3714fc5d admin admin] PATH_INFO: `/v3/projects/be8e046d17964233aa8555ee30d4d66e/users/6222083bcef74ba4a443444a688cceb3/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:08.966253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539d35f-fe73-467d-8b6e-15df3714fc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8e046d17964233aa8555ee30d4d66e, user_id=6222083bcef74ba4a443444a688cceb3, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:08.968991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539d35f-fe73-467d-8b6e-15df3714fc5d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:09.016361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:09.048148 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6969b-fe51-4d82-b4c7-eabba65ccfed None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:09.094469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fece651-2c41-40f0-b72f-dbe057240a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:09.094469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fece651-2c41-40f0-b72f-dbe057240a7b service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:09.094469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fece651-2c41-40f0-b72f-dbe057240a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:09.094469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fece651-2c41-40f0-b72f-dbe057240a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:09.119256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fece651-2c41-40f0-b72f-dbe057240a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:09.120754 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fece651-2c41-40f0-b72f-dbe057240a7b service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:09.144989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 906/1833] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:09.154882 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25dcfb-fc3a-426a-b981-ddcb8fb6e303 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:09.155181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25dcfb-fc3a-426a-b981-ddcb8fb6e303 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:09.155961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25dcfb-fc3a-426a-b981-ddcb8fb6e303 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:09.157471 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 907/1834] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 18 10:41:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:41:09.158446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25dcfb-fc3a-426a-b981-ddcb8fb6e303 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:09.183881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25dcfb-fc3a-426a-b981-ddcb8fb6e303 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:09.201742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27eed5-e60e-420a-bc49-dad98604b67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:09.202790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27eed5-e60e-420a-bc49-dad98604b67d service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:09.203313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27eed5-e60e-420a-bc49-dad98604b67d service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:09.203753 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27eed5-e60e-420a-bc49-dad98604b67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:09.209352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 928/1835] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:08 2022] PUT /identity/v3/projects/be8e046d17964233aa8555ee30d4d66e/users/6222083bcef74ba4a443444a688cceb3/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:09.211438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539d35f-fe73-467d-8b6e-15df3714fc5d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:09.216090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e539d35f-fe73-467d-8b6e-15df3714fc5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:09.229658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27eed5-e60e-420a-bc49-dad98604b67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:09.235445 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27eed5-e60e-420a-bc49-dad98604b67d service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:09.263382 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 908/1836] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:09.269701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472786e-5a2b-43e0-b335-abcdb9c858a5 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:09.269701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472786e-5a2b-43e0-b335-abcdb9c858a5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:09.269701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472786e-5a2b-43e0-b335-abcdb9c858a5 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:09.269701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 909/1837] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 18 10:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:41:09.270824 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472786e-5a2b-43e0-b335-abcdb9c858a5 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:09.389339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472786e-5a2b-43e0-b335-abcdb9c858a5 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:09.397247 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c96d81-4d12-41ec-92b2-3ffe13958706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:09.401841 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c96d81-4d12-41ec-92b2-3ffe13958706 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:09.401841 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c96d81-4d12-41ec-92b2-3ffe13958706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:09.401841 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c96d81-4d12-41ec-92b2-3ffe13958706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:09.401841 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c96d81-4d12-41ec-92b2-3ffe13958706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:09.402366 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c96d81-4d12-41ec-92b2-3ffe13958706 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:09.429223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 910/1838] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:09.435037 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c96d81-4d12-41ec-92b2-3ffe13958706 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:09.456899 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c96d81-4d12-41ec-92b2-3ffe13958706 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:09.467357 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8923dea-376e-4206-9b82-990b327790bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:09.470423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8923dea-376e-4206-9b82-990b327790bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:09.470423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8923dea-376e-4206-9b82-990b327790bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:09.470423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8923dea-376e-4206-9b82-990b327790bf admin admin] PATH_INFO: `/v3/projects/be8e046d17964233aa8555ee30d4d66e/users/6222083bcef74ba4a443444a688cceb3/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:09.472313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8923dea-376e-4206-9b82-990b327790bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8e046d17964233aa8555ee30d4d66e, user_id=6222083bcef74ba4a443444a688cceb3, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:09.478393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8923dea-376e-4206-9b82-990b327790bf admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:09.478589 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539d35f-fe73-467d-8b6e-15df3714fc5d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:09.498317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 911/1839] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:09 2022] PUT /identity/v3/projects/be8e046d17964233aa8555ee30d4d66e/users/6222083bcef74ba4a443444a688cceb3/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:09.500666 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78b880-f787-4a8c-8c3b-17c307d18dff None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:09.501312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78b880-f787-4a8c-8c3b-17c307d18dff None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:09.501731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78b880-f787-4a8c-8c3b-17c307d18dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:09.513824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6431d-7d4e-4ae9-85a3-f3f7b3627cbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:09.515399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6431d-7d4e-4ae9-85a3-f3f7b3627cbb service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:09.515399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6431d-7d4e-4ae9-85a3-f3f7b3627cbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:09.515399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6431d-7d4e-4ae9-85a3-f3f7b3627cbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:09.528224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6431d-7d4e-4ae9-85a3-f3f7b3627cbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:09.534063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6431d-7d4e-4ae9-85a3-f3f7b3627cbb service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:09.541888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-cc78b880-f787-4a8c-8c3b-17c307d18dff None None] MFA Rules not processed for user `f7abf6b71ac3454ca547a750cef9220a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:09.544260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cc78b880-f787-4a8c-8c3b-17c307d18dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:09.546635 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 929/1840] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:09.555973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30961f-73ec-43c2-92ac-0a652e6349da None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:09.559503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30961f-73ec-43c2-92ac-0a652e6349da None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:09.559503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30961f-73ec-43c2-92ac-0a652e6349da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:09.609135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:09.616917 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8c30961f-73ec-43c2-92ac-0a652e6349da None None] MFA Rules not processed for user `6222083bcef74ba4a443444a688cceb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:09.616917 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8c30961f-73ec-43c2-92ac-0a652e6349da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:09.800409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 912/1841] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 18 10:41:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:09.802366 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f952f-903d-4315-b6ba-0d8f9bf9626a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:09.802847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f952f-903d-4315-b6ba-0d8f9bf9626a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:09.803295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f952f-903d-4315-b6ba-0d8f9bf9626a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:09.832621 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 930/1842] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:09.847329 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ca5f952f-903d-4315-b6ba-0d8f9bf9626a None None] MFA Rules not processed for user `f7abf6b71ac3454ca547a750cef9220a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:09.848569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ca5f952f-903d-4315-b6ba-0d8f9bf9626a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:09.868126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 913/1843] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 18 10:41:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:09.878515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30961f-73ec-43c2-92ac-0a652e6349da None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:09.883420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8c30961f-73ec-43c2-92ac-0a652e6349da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:09.899367 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f952f-903d-4315-b6ba-0d8f9bf9626a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:09.901718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ca5f952f-903d-4315-b6ba-0d8f9bf9626a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:09.945426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f952f-903d-4315-b6ba-0d8f9bf9626a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:09.964482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e29b0-7554-4df1-a7c1-b5407fc24e15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:09.967413 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e29b0-7554-4df1-a7c1-b5407fc24e15 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:09.968382 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e29b0-7554-4df1-a7c1-b5407fc24e15 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:09.970373 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e29b0-7554-4df1-a7c1-b5407fc24e15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:09.996000 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e29b0-7554-4df1-a7c1-b5407fc24e15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:10.007485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e29b0-7554-4df1-a7c1-b5407fc24e15 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:10.044349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 914/1844] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:10.085077 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30961f-73ec-43c2-92ac-0a652e6349da None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:10.098479 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2a89e-e6f0-45eb-a3bc-71870bfc2c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:10.105285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2a89e-e6f0-45eb-a3bc-71870bfc2c43 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:10.105285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2a89e-e6f0-45eb-a3bc-71870bfc2c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:10.105285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2a89e-e6f0-45eb-a3bc-71870bfc2c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:10.117082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2a89e-e6f0-45eb-a3bc-71870bfc2c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:10.119475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2a89e-e6f0-45eb-a3bc-71870bfc2c43 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:10.150156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 931/1845] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:10.189865 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:11.071741 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e29b0-7554-4df1-a7c1-b5407fc24e15 service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:11.090183 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e29b0-7554-4df1-a7c1-b5407fc24e15 service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:11.122980 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fc53c-7c04-40e6-91c3-bb986b79b81c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:11.124259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fc53c-7c04-40e6-91c3-bb986b79b81c service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:11.124563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fc53c-7c04-40e6-91c3-bb986b79b81c service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:11.124848 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fc53c-7c04-40e6-91c3-bb986b79b81c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:11.147291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fc53c-7c04-40e6-91c3-bb986b79b81c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:11.149035 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fc53c-7c04-40e6-91c3-bb986b79b81c service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:11.189267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2a89e-e6f0-45eb-a3bc-71870bfc2c43 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:11.197428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 915/1846] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:11.286262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fc53c-7c04-40e6-91c3-bb986b79b81c service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:11.288039 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-063fc53c-7c04-40e6-91c3-bb986b79b81c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:11.389444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2a89e-e6f0-45eb-a3bc-71870bfc2c43 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:11.413834 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98f6bd-9d18-42bc-8b38-6290849ce9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:11.417719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98f6bd-9d18-42bc-8b38-6290849ce9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:11.418722 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98f6bd-9d18-42bc-8b38-6290849ce9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:11.419191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98f6bd-9d18-42bc-8b38-6290849ce9d5 admin admin] PATH_INFO: `/v3/users/f1f96e368506424aba353613976cc44b` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:11.422536 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98f6bd-9d18-42bc-8b38-6290849ce9d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f96e368506424aba353613976cc44b)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:11.428059 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98f6bd-9d18-42bc-8b38-6290849ce9d5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:11.464446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fc53c-7c04-40e6-91c3-bb986b79b81c service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:11.478808 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:11.481119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:11.481965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:11.482874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3 admin admin] PATH_INFO: `/v3/projects/c1923310487d4925a9f7e1cf0b993a7c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:11.489823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1923310487d4925a9f7e1cf0b993a7c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:11.500554 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:11.917034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1923310487d4925a9f7e1cf0b993a7c', 'request_id': 'req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:11.942508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5b98f6bd-9d18-42bc-8b38-6290849ce9d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f96e368506424aba353613976cc44b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:11.958153 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1923310487d4925a9f7e1cf0b993a7c', 'request_id': 'req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:11.979930 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1923310487d4925a9f7e1cf0b993a7c', 'request_id': 'req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:12.064574 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5b98f6bd-9d18-42bc-8b38-6290849ce9d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f96e368506424aba353613976cc44b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:12.094857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5b98f6bd-9d18-42bc-8b38-6290849ce9d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f96e368506424aba353613976cc44b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:12.098940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5b98f6bd-9d18-42bc-8b38-6290849ce9d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f96e368506424aba353613976cc44b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:12.139716 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3 admin admin] The token cache is being invalidate because project c1923310487d4925a9f7e1cf0b993a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:12.140707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:12.141357 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:12.149996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 916/1847] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:11 2022] DELETE /identity/v3/projects/c1923310487d4925a9f7e1cf0b993a7c => generated 0 bytes in 860 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:12.149996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:12.152655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:12.205080 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5b98f6bd-9d18-42bc-8b38-6290849ce9d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f96e368506424aba353613976cc44b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:12.225704 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 932/1848] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:11 2022] DELETE /identity/v3/users/f1f96e368506424aba353613976cc44b => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:12.229799 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98f6bd-9d18-42bc-8b38-6290849ce9d5 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:12.235223 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5b98f6bd-9d18-42bc-8b38-6290849ce9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:12.476618 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ab2b5-e0aa-42ea-b41a-1095d78f81d3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:12.549049 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98f6bd-9d18-42bc-8b38-6290849ce9d5 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:12.568141 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935ae99-3eae-420c-a759-6b55c2b3e7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:12.569257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935ae99-3eae-420c-a759-6b55c2b3e7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:12.569527 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935ae99-3eae-420c-a759-6b55c2b3e7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:12.569910 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935ae99-3eae-420c-a759-6b55c2b3e7a6 admin admin] PATH_INFO: `/v3/projects/fe71c0930ba7457cbcd28312a1be7112` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:12.571632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935ae99-3eae-420c-a759-6b55c2b3e7a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe71c0930ba7457cbcd28312a1be7112)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:12.574283 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935ae99-3eae-420c-a759-6b55c2b3e7a6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:12.602935 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:12.604563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:12.605119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:12.606020 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3 admin admin] PATH_INFO: `/v3/projects/083d226e2a8e4d28a8fd2e51258d16a4` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:12.608676 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=083d226e2a8e4d28a8fd2e51258d16a4)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:12.614300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:12.772223 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f935ae99-3eae-420c-a759-6b55c2b3e7a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe71c0930ba7457cbcd28312a1be7112', 'request_id': 'req-f935ae99-3eae-420c-a759-6b55c2b3e7a6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:12.790006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f935ae99-3eae-420c-a759-6b55c2b3e7a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe71c0930ba7457cbcd28312a1be7112', 'request_id': 'req-f935ae99-3eae-420c-a759-6b55c2b3e7a6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:12.819327 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f935ae99-3eae-420c-a759-6b55c2b3e7a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe71c0930ba7457cbcd28312a1be7112', 'request_id': 'req-f935ae99-3eae-420c-a759-6b55c2b3e7a6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:12.830413 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083d226e2a8e4d28a8fd2e51258d16a4', 'request_id': 'req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:12.889883 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083d226e2a8e4d28a8fd2e51258d16a4', 'request_id': 'req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:12.905160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083d226e2a8e4d28a8fd2e51258d16a4', 'request_id': 'req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:13.185451 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f935ae99-3eae-420c-a759-6b55c2b3e7a6 admin admin] The token cache is being invalidate because project fe71c0930ba7457cbcd28312a1be7112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:13.185866 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f935ae99-3eae-420c-a759-6b55c2b3e7a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:13.186691 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f935ae99-3eae-420c-a759-6b55c2b3e7a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:13.189032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 933/1849] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:12 2022] DELETE /identity/v3/projects/fe71c0930ba7457cbcd28312a1be7112 => generated 0 bytes in 962 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:13.191212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935ae99-3eae-420c-a759-6b55c2b3e7a6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:13.193688 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f935ae99-3eae-420c-a759-6b55c2b3e7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:13.277745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3 admin admin] The token cache is being invalidate because project 083d226e2a8e4d28a8fd2e51258d16a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:13.279540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:13.279540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:13.281003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 917/1850] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:12 2022] DELETE /identity/v3/projects/083d226e2a8e4d28a8fd2e51258d16a4 => generated 0 bytes in 1135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:13.281951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:13.287750 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:13.327800 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:13.331566 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935ae99-3eae-420c-a759-6b55c2b3e7a6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:13.447076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfb790-ca62-4b94-8e4f-6bcc890fc7c3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:13.472051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabba8ce-b891-4eb6-a14a-404da3fc5e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:13.480028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabba8ce-b891-4eb6-a14a-404da3fc5e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:13.480311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02832ee6-9f79-46f8-b033-017e00fd1252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:13.480521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabba8ce-b891-4eb6-a14a-404da3fc5e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:13.480689 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832ee6-9f79-46f8-b033-017e00fd1252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:13.480849 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabba8ce-b891-4eb6-a14a-404da3fc5e3b admin admin] PATH_INFO: `/v3/users/bf403388dd9240b1966259b4095046d9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:13.481009 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832ee6-9f79-46f8-b033-017e00fd1252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:13.481009 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832ee6-9f79-46f8-b033-017e00fd1252 admin admin] PATH_INFO: `/v3/projects/adeafaeffc1d4bf1b40bdb65a432d632` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:13.481009 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02832ee6-9f79-46f8-b033-017e00fd1252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adeafaeffc1d4bf1b40bdb65a432d632)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:13.481414 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabba8ce-b891-4eb6-a14a-404da3fc5e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf403388dd9240b1966259b4095046d9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:13.481566 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02832ee6-9f79-46f8-b033-017e00fd1252 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:13.486141 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabba8ce-b891-4eb6-a14a-404da3fc5e3b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:13.562200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:13.946492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02832ee6-9f79-46f8-b033-017e00fd1252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adeafaeffc1d4bf1b40bdb65a432d632', 'request_id': 'req-02832ee6-9f79-46f8-b033-017e00fd1252'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:13.964211 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02832ee6-9f79-46f8-b033-017e00fd1252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adeafaeffc1d4bf1b40bdb65a432d632', 'request_id': 'req-02832ee6-9f79-46f8-b033-017e00fd1252'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:13.979276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02832ee6-9f79-46f8-b033-017e00fd1252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adeafaeffc1d4bf1b40bdb65a432d632', 'request_id': 'req-02832ee6-9f79-46f8-b033-017e00fd1252'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:14.080279 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02832ee6-9f79-46f8-b033-017e00fd1252 admin admin] The token cache is being invalidate because project adeafaeffc1d4bf1b40bdb65a432d632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:14.080279 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02832ee6-9f79-46f8-b033-017e00fd1252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:14.081502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02832ee6-9f79-46f8-b033-017e00fd1252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:14.083508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 934/1851] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:13 2022] DELETE /identity/v3/projects/adeafaeffc1d4bf1b40bdb65a432d632 => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:14.084874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec8573-08bd-4306-8ef6-9e5dcab9da4d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:14.085158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec8573-08bd-4306-8ef6-9e5dcab9da4d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:14.085465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec8573-08bd-4306-8ef6-9e5dcab9da4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:14.117262 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0cec8573-08bd-4306-8ef6-9e5dcab9da4d None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:14.118876 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0cec8573-08bd-4306-8ef6-9e5dcab9da4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:14.120600 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aabba8ce-b891-4eb6-a14a-404da3fc5e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf403388dd9240b1966259b4095046d9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:14.215022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 935/1852] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:14.216857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c7323-9593-4f4b-be6d-30192b586bd3 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:14.217371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c7323-9593-4f4b-be6d-30192b586bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:14.217882 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c7323-9593-4f4b-be6d-30192b586bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:14.261938 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d23c7323-9593-4f4b-be6d-30192b586bd3 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:14.270582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d23c7323-9593-4f4b-be6d-30192b586bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:14.281264 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 936/1853] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:14.282073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c7323-9593-4f4b-be6d-30192b586bd3 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:14.296903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d23c7323-9593-4f4b-be6d-30192b586bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:14.305847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c7323-9593-4f4b-be6d-30192b586bd3 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:14.320501 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e657e7d-efe9-43b3-9ba3-af9703da57ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:14.321705 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e657e7d-efe9-43b3-9ba3-af9703da57ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:14.322072 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e657e7d-efe9-43b3-9ba3-af9703da57ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:14.322490 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e657e7d-efe9-43b3-9ba3-af9703da57ef admin admin] PATH_INFO: `/v3/users/c1a92c25a72a4b8b8567dae186d002f8` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:14.324375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e657e7d-efe9-43b3-9ba3-af9703da57ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a92c25a72a4b8b8567dae186d002f8)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:14.326656 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e657e7d-efe9-43b3-9ba3-af9703da57ef admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:14.447792 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aabba8ce-b891-4eb6-a14a-404da3fc5e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf403388dd9240b1966259b4095046d9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:14.471055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aabba8ce-b891-4eb6-a14a-404da3fc5e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf403388dd9240b1966259b4095046d9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:14.474039 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aabba8ce-b891-4eb6-a14a-404da3fc5e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf403388dd9240b1966259b4095046d9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:14.498988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aabba8ce-b891-4eb6-a14a-404da3fc5e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf403388dd9240b1966259b4095046d9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:14.518998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 918/1854] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:13 2022] DELETE /identity/v3/users/bf403388dd9240b1966259b4095046d9 => generated 0 bytes in 1225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:14.518998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabba8ce-b891-4eb6-a14a-404da3fc5e3b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:14.518998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-aabba8ce-b891-4eb6-a14a-404da3fc5e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:14.638596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabba8ce-b891-4eb6-a14a-404da3fc5e3b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:14.642580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda50337-df4a-4b89-b6f2-13e3ce3dc7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:14.643719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda50337-df4a-4b89-b6f2-13e3ce3dc7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:14.651371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda50337-df4a-4b89-b6f2-13e3ce3dc7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:14.651687 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda50337-df4a-4b89-b6f2-13e3ce3dc7d5 admin admin] PATH_INFO: `/v3/users/778692082f804911af0138c31e4c4026` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:14.653786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda50337-df4a-4b89-b6f2-13e3ce3dc7d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=778692082f804911af0138c31e4c4026)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:14.659487 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda50337-df4a-4b89-b6f2-13e3ce3dc7d5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:14.787524 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6e657e7d-efe9-43b3-9ba3-af9703da57ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a92c25a72a4b8b8567dae186d002f8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:14.869885 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6e657e7d-efe9-43b3-9ba3-af9703da57ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a92c25a72a4b8b8567dae186d002f8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:14.890762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6e657e7d-efe9-43b3-9ba3-af9703da57ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a92c25a72a4b8b8567dae186d002f8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:14.892163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6e657e7d-efe9-43b3-9ba3-af9703da57ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a92c25a72a4b8b8567dae186d002f8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:14.931753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6e657e7d-efe9-43b3-9ba3-af9703da57ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a92c25a72a4b8b8567dae186d002f8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:14.962366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 937/1855] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:14 2022] DELETE /identity/v3/users/c1a92c25a72a4b8b8567dae186d002f8 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:14.964593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e657e7d-efe9-43b3-9ba3-af9703da57ef admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:14.968655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6e657e7d-efe9-43b3-9ba3-af9703da57ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:14.999919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bda50337-df4a-4b89-b6f2-13e3ce3dc7d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '778692082f804911af0138c31e4c4026'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:15.089875 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e657e7d-efe9-43b3-9ba3-af9703da57ef admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:15.097526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fd463-b04a-4b8f-88ae-6dd1db704eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:15.099262 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fd463-b04a-4b8f-88ae-6dd1db704eeb service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:15.099968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fd463-b04a-4b8f-88ae-6dd1db704eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:15.101015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fd463-b04a-4b8f-88ae-6dd1db704eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:15.105626 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0e8fd463-b04a-4b8f-88ae-6dd1db704eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:15.156040 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bda50337-df4a-4b89-b6f2-13e3ce3dc7d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '778692082f804911af0138c31e4c4026'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:15.168192 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bda50337-df4a-4b89-b6f2-13e3ce3dc7d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '778692082f804911af0138c31e4c4026'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:15.180119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bda50337-df4a-4b89-b6f2-13e3ce3dc7d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '778692082f804911af0138c31e4c4026'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:15.188608 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bda50337-df4a-4b89-b6f2-13e3ce3dc7d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '778692082f804911af0138c31e4c4026'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:15.199785 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 919/1856] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:14 2022] DELETE /identity/v3/users/778692082f804911af0138c31e4c4026 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:15.201950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9934210-dbf7-406d-8932-814753ff0ad8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:15.202452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9934210-dbf7-406d-8932-814753ff0ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:15.202891 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9934210-dbf7-406d-8932-814753ff0ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:15.241005 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b9934210-dbf7-406d-8932-814753ff0ad8 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:15.241243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fd463-b04a-4b8f-88ae-6dd1db704eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:15.241415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b9934210-dbf7-406d-8932-814753ff0ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:15.254030 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fd463-b04a-4b8f-88ae-6dd1db704eeb service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:15.283007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 938/1857] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:15.538526 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 920/1858] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:15.540092 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fd463-b04a-4b8f-88ae-6dd1db704eeb service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:15.543396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0e8fd463-b04a-4b8f-88ae-6dd1db704eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:15.572120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fd463-b04a-4b8f-88ae-6dd1db704eeb service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:15.579852 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e566a51-7161-46de-a2e4-65e65e4c7516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:15.589313 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e566a51-7161-46de-a2e4-65e65e4c7516 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:15.589313 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e566a51-7161-46de-a2e4-65e65e4c7516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:15.589313 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e566a51-7161-46de-a2e4-65e65e4c7516 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:15.589313 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e566a51-7161-46de-a2e4-65e65e4c7516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:15.589313 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e566a51-7161-46de-a2e4-65e65e4c7516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:15.589313 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e566a51-7161-46de-a2e4-65e65e4c7516 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:15.592284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9934210-dbf7-406d-8932-814753ff0ad8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:15.594741 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b9934210-dbf7-406d-8932-814753ff0ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:15.611654 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 939/1859] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:41:15.614155 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e566a51-7161-46de-a2e4-65e65e4c7516 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:15.625394 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:15.628445 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9934210-dbf7-406d-8932-814753ff0ad8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:15.643632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e566a51-7161-46de-a2e4-65e65e4c7516 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:15.649336 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add967-30eb-413e-baf2-95d4e80619f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:15.650028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add967-30eb-413e-baf2-95d4e80619f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:15.650311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add967-30eb-413e-baf2-95d4e80619f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:15.650847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add967-30eb-413e-baf2-95d4e80619f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:15.653018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85add967-30eb-413e-baf2-95d4e80619f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:15.654365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b295e-9dd2-4821-bb51-fcb640c72d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:15.655730 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85add967-30eb-413e-baf2-95d4e80619f7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:15.657639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b295e-9dd2-4821-bb51-fcb640c72d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:15.659617 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b295e-9dd2-4821-bb51-fcb640c72d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:15.659978 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b295e-9dd2-4821-bb51-fcb640c72d89 admin admin] PATH_INFO: `/v3/projects/2f1765b16d5449b8ba7b4090833f5ee5` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:15.663794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b295e-9dd2-4821-bb51-fcb640c72d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1765b16d5449b8ba7b4090833f5ee5)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:15.671222 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b295e-9dd2-4821-bb51-fcb640c72d89 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:16.124250 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 940/1860] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:15 2022] POST /identity/v3/projects => generated 397 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:16.131615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add967-30eb-413e-baf2-95d4e80619f7 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:16.217971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-922b295e-9dd2-4821-bb51-fcb640c72d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1765b16d5449b8ba7b4090833f5ee5', 'request_id': 'req-922b295e-9dd2-4821-bb51-fcb640c72d89'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:16.235589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-922b295e-9dd2-4821-bb51-fcb640c72d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1765b16d5449b8ba7b4090833f5ee5', 'request_id': 'req-922b295e-9dd2-4821-bb51-fcb640c72d89'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:16.250543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-922b295e-9dd2-4821-bb51-fcb640c72d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1765b16d5449b8ba7b4090833f5ee5', 'request_id': 'req-922b295e-9dd2-4821-bb51-fcb640c72d89'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:16.310937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add967-30eb-413e-baf2-95d4e80619f7 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:16.328028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-922b295e-9dd2-4821-bb51-fcb640c72d89 admin admin] The token cache is being invalidate because project 2f1765b16d5449b8ba7b4090833f5ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:16.331448 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-922b295e-9dd2-4821-bb51-fcb640c72d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:16.331448 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-922b295e-9dd2-4821-bb51-fcb640c72d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:16.339197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 921/1861] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:15 2022] DELETE /identity/v3/projects/2f1765b16d5449b8ba7b4090833f5ee5 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:16.339197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:16.341910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd052b5-fb36-4896-a772-4fecc0f0d515 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:16.342415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd052b5-fb36-4896-a772-4fecc0f0d515 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:16.342829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd052b5-fb36-4896-a772-4fecc0f0d515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:16.387026 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1dd052b5-fb36-4896-a772-4fecc0f0d515 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:16.390172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1dd052b5-fb36-4896-a772-4fecc0f0d515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:16.435855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd18ce6-652c-4550-957f-5bf4d0049206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:16.438675 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd18ce6-652c-4550-957f-5bf4d0049206 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:16.441922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd18ce6-652c-4550-957f-5bf4d0049206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:16.445830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd18ce6-652c-4550-957f-5bf4d0049206 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:16.445830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd18ce6-652c-4550-957f-5bf4d0049206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:16.449358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd18ce6-652c-4550-957f-5bf4d0049206 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:16.568613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 922/1862] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:16.569775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd052b5-fb36-4896-a772-4fecc0f0d515 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:16.572595 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1dd052b5-fb36-4896-a772-4fecc0f0d515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:16.587678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 941/1863] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:16 2022] POST /identity/v3/users => generated 299 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:41:16.589736 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd18ce6-652c-4550-957f-5bf4d0049206 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:16.597709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd052b5-fb36-4896-a772-4fecc0f0d515 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:16.601632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9fd18ce6-652c-4550-957f-5bf4d0049206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:16.611232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206af60-1838-4d53-8fc3-13b7507c74a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:16.611232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206af60-1838-4d53-8fc3-13b7507c74a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:16.611232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206af60-1838-4d53-8fc3-13b7507c74a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:16.611232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206af60-1838-4d53-8fc3-13b7507c74a4 admin admin] PATH_INFO: `/v3/projects/603dd991de8a42cc8d10c6855b546c4d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:16.621956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206af60-1838-4d53-8fc3-13b7507c74a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=603dd991de8a42cc8d10c6855b546c4d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:16.626401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206af60-1838-4d53-8fc3-13b7507c74a4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:16.649564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd18ce6-652c-4550-957f-5bf4d0049206 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:16.666601 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855db5a-0b95-4461-86b4-bbbfa7f818af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:16.668032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855db5a-0b95-4461-86b4-bbbfa7f818af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:16.668527 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855db5a-0b95-4461-86b4-bbbfa7f818af admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:16.668958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855db5a-0b95-4461-86b4-bbbfa7f818af admin admin] PATH_INFO: `/v3/projects/f04687e722054da199be74f701960951` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:16.670806 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855db5a-0b95-4461-86b4-bbbfa7f818af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04687e722054da199be74f701960951)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:16.674033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855db5a-0b95-4461-86b4-bbbfa7f818af admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:16.856953 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9855db5a-0b95-4461-86b4-bbbfa7f818af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04687e722054da199be74f701960951', 'request_id': 'req-9855db5a-0b95-4461-86b4-bbbfa7f818af'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:16.878766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9855db5a-0b95-4461-86b4-bbbfa7f818af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04687e722054da199be74f701960951', 'request_id': 'req-9855db5a-0b95-4461-86b4-bbbfa7f818af'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:16.878766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9855db5a-0b95-4461-86b4-bbbfa7f818af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04687e722054da199be74f701960951', 'request_id': 'req-9855db5a-0b95-4461-86b4-bbbfa7f818af'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:16.887380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a206af60-1838-4d53-8fc3-13b7507c74a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '603dd991de8a42cc8d10c6855b546c4d', 'request_id': 'req-a206af60-1838-4d53-8fc3-13b7507c74a4'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:16.895759 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a206af60-1838-4d53-8fc3-13b7507c74a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '603dd991de8a42cc8d10c6855b546c4d', 'request_id': 'req-a206af60-1838-4d53-8fc3-13b7507c74a4'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:16.904099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a206af60-1838-4d53-8fc3-13b7507c74a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '603dd991de8a42cc8d10c6855b546c4d', 'request_id': 'req-a206af60-1838-4d53-8fc3-13b7507c74a4'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:16.968221 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9855db5a-0b95-4461-86b4-bbbfa7f818af admin admin] The token cache is being invalidate because project f04687e722054da199be74f701960951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:16.968807 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9855db5a-0b95-4461-86b4-bbbfa7f818af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:16.969894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9855db5a-0b95-4461-86b4-bbbfa7f818af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:16.973391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 942/1864] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:16 2022] DELETE /identity/v3/projects/f04687e722054da199be74f701960951 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:16.975562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6ad2f-7666-4c19-9da9-423a3eae7e74 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:16.976125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6ad2f-7666-4c19-9da9-423a3eae7e74 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:16.976623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6ad2f-7666-4c19-9da9-423a3eae7e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:17.017491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0ca6ad2f-7666-4c19-9da9-423a3eae7e74 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:17.019837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0ca6ad2f-7666-4c19-9da9-423a3eae7e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:17.021428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a206af60-1838-4d53-8fc3-13b7507c74a4 admin admin] The token cache is being invalidate because project 603dd991de8a42cc8d10c6855b546c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:17.022005 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a206af60-1838-4d53-8fc3-13b7507c74a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:17.025704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a206af60-1838-4d53-8fc3-13b7507c74a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:17.028547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 923/1865] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:16 2022] DELETE /identity/v3/projects/603dd991de8a42cc8d10c6855b546c4d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:17.029977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206af60-1838-4d53-8fc3-13b7507c74a4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:17.032168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a206af60-1838-4d53-8fc3-13b7507c74a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:17.076650 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:17.126102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 943/1866] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:17.126102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6ad2f-7666-4c19-9da9-423a3eae7e74 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:17.131240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0ca6ad2f-7666-4c19-9da9-423a3eae7e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:17.134487 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206af60-1838-4d53-8fc3-13b7507c74a4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:17.141801 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c6a30-51f3-432c-8fef-0389f75e0093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:17.143188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c6a30-51f3-432c-8fef-0389f75e0093 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:17.144444 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c6a30-51f3-432c-8fef-0389f75e0093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:17.145835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c6a30-51f3-432c-8fef-0389f75e0093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:17.146844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c6a30-51f3-432c-8fef-0389f75e0093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:17.148769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c6a30-51f3-432c-8fef-0389f75e0093 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:17.151558 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6ad2f-7666-4c19-9da9-423a3eae7e74 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:17.160733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dcae4-485c-4527-a928-b9eedfd74abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:17.161443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dcae4-485c-4527-a928-b9eedfd74abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:17.161933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dcae4-485c-4527-a928-b9eedfd74abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:17.162467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dcae4-485c-4527-a928-b9eedfd74abc admin admin] PATH_INFO: `/v3/projects/60363e2f9509449f8e70132ae049b9b8` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:17.163577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 924/1867] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:17.164206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c6a30-51f3-432c-8fef-0389f75e0093 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:17.166067 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f97c6a30-51f3-432c-8fef-0389f75e0093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:17.167439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dcae4-485c-4527-a928-b9eedfd74abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=60363e2f9509449f8e70132ae049b9b8)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:17.170274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dcae4-485c-4527-a928-b9eedfd74abc admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:17.181811 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c6a30-51f3-432c-8fef-0389f75e0093 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:17.188894 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752d466-fb70-43f3-98ab-1746ffbeb06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:17.192253 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752d466-fb70-43f3-98ab-1746ffbeb06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:17.195172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752d466-fb70-43f3-98ab-1746ffbeb06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:17.195172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752d466-fb70-43f3-98ab-1746ffbeb06a admin admin] PATH_INFO: `/v3/users/6222083bcef74ba4a443444a688cceb3` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:17.196168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752d466-fb70-43f3-98ab-1746ffbeb06a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6222083bcef74ba4a443444a688cceb3)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:17.200247 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752d466-fb70-43f3-98ab-1746ffbeb06a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:17.322119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ad0dcae4-485c-4527-a928-b9eedfd74abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60363e2f9509449f8e70132ae049b9b8', 'request_id': 'req-ad0dcae4-485c-4527-a928-b9eedfd74abc'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:17.330466 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ad0dcae4-485c-4527-a928-b9eedfd74abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60363e2f9509449f8e70132ae049b9b8', 'request_id': 'req-ad0dcae4-485c-4527-a928-b9eedfd74abc'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:17.339449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ad0dcae4-485c-4527-a928-b9eedfd74abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60363e2f9509449f8e70132ae049b9b8', 'request_id': 'req-ad0dcae4-485c-4527-a928-b9eedfd74abc'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:17.399285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2752d466-fb70-43f3-98ab-1746ffbeb06a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6222083bcef74ba4a443444a688cceb3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:17.425243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ad0dcae4-485c-4527-a928-b9eedfd74abc admin admin] The token cache is being invalidate because project 60363e2f9509449f8e70132ae049b9b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:17.425243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ad0dcae4-485c-4527-a928-b9eedfd74abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:17.425243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ad0dcae4-485c-4527-a928-b9eedfd74abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:17.425243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 944/1868] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:17 2022] DELETE /identity/v3/projects/60363e2f9509449f8e70132ae049b9b8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:17.425243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab80824-9c25-494e-9c2b-42bd2bdb23ed None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:17.426773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab80824-9c25-494e-9c2b-42bd2bdb23ed None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:17.426773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab80824-9c25-494e-9c2b-42bd2bdb23ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:17.452414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6ab80824-9c25-494e-9c2b-42bd2bdb23ed None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:17.453928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6ab80824-9c25-494e-9c2b-42bd2bdb23ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:17.488918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2752d466-fb70-43f3-98ab-1746ffbeb06a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6222083bcef74ba4a443444a688cceb3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:17.500281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2752d466-fb70-43f3-98ab-1746ffbeb06a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6222083bcef74ba4a443444a688cceb3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:17.501403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2752d466-fb70-43f3-98ab-1746ffbeb06a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6222083bcef74ba4a443444a688cceb3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:17.526740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2752d466-fb70-43f3-98ab-1746ffbeb06a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6222083bcef74ba4a443444a688cceb3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:17.530141 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 945/1869] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:17.531266 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab80824-9c25-494e-9c2b-42bd2bdb23ed None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:17.538569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 925/1870] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:17 2022] DELETE /identity/v3/users/6222083bcef74ba4a443444a688cceb3 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:17.544102 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752d466-fb70-43f3-98ab-1746ffbeb06a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:17.544102 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2752d466-fb70-43f3-98ab-1746ffbeb06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:17.544419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6ab80824-9c25-494e-9c2b-42bd2bdb23ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:17.561119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab80824-9c25-494e-9c2b-42bd2bdb23ed None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:17.643952 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f32859-e266-41a2-870a-8ee12407be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:17.644692 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f32859-e266-41a2-870a-8ee12407be8b admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:17.644992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f32859-e266-41a2-870a-8ee12407be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:17.645263 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f32859-e266-41a2-870a-8ee12407be8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:17.646867 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f32859-e266-41a2-870a-8ee12407be8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:17.647269 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f32859-e266-41a2-870a-8ee12407be8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:17.649799 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f32859-e266-41a2-870a-8ee12407be8b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:17.663514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 946/1871] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:17.664922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b353493-419a-4072-aea2-ecd50ae9366b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:17.665201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b353493-419a-4072-aea2-ecd50ae9366b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:17.665446 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b353493-419a-4072-aea2-ecd50ae9366b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:17.686629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752d466-fb70-43f3-98ab-1746ffbeb06a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:17.691026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0b353493-419a-4072-aea2-ecd50ae9366b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:17.691026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0b353493-419a-4072-aea2-ecd50ae9366b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:17.697131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac16f04-02c2-404a-b786-0154c793bcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:17.697890 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16f04-02c2-404a-b786-0154c793bcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:17.698171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16f04-02c2-404a-b786-0154c793bcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:17.698486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16f04-02c2-404a-b786-0154c793bcc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:17.699730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac16f04-02c2-404a-b786-0154c793bcc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:17.700226 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 947/1872] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:17.701898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abc8e6-758c-49f7-a748-dbcdd9585a3a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:17.702373 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abc8e6-758c-49f7-a748-dbcdd9585a3a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:17.702719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abc8e6-758c-49f7-a748-dbcdd9585a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:17.710909 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac16f04-02c2-404a-b786-0154c793bcc1 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:17.724893 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 926/1873] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:17.726194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac16f04-02c2-404a-b786-0154c793bcc1 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:17.728431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-02abc8e6-758c-49f7-a748-dbcdd9585a3a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:17.730000 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-02abc8e6-758c-49f7-a748-dbcdd9585a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:17.738589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac16f04-02c2-404a-b786-0154c793bcc1 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:17.744542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 948/1874] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:17.745652 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff4672-67e5-476c-b4fa-f2df7fdc01d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:17.746779 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff4672-67e5-476c-b4fa-f2df7fdc01d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:17.747636 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd339b02-eeaf-427a-9b16-ccce6abbf22d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:17.747636 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd339b02-eeaf-427a-9b16-ccce6abbf22d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:17.748217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd339b02-eeaf-427a-9b16-ccce6abbf22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:17.748442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff4672-67e5-476c-b4fa-f2df7fdc01d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:17.748996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff4672-67e5-476c-b4fa-f2df7fdc01d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:17.750191 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff4672-67e5-476c-b4fa-f2df7fdc01d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:17.753334 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff4672-67e5-476c-b4fa-f2df7fdc01d4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:17.776349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-dd339b02-eeaf-427a-9b16-ccce6abbf22d None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:17.777701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dd339b02-eeaf-427a-9b16-ccce6abbf22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:17.788169 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 949/1875] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:17.789470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd339b02-eeaf-427a-9b16-ccce6abbf22d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:17.802636 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd339b02-eeaf-427a-9b16-ccce6abbf22d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:17.809528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4158d-a81e-4094-acf6-a3482567201b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:17.811281 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4158d-a81e-4094-acf6-a3482567201b admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:17.811281 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4158d-a81e-4094-acf6-a3482567201b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:17.811281 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4158d-a81e-4094-acf6-a3482567201b admin admin] PATH_INFO: `/v3/projects/7c68da02104a4818a37a8c0a36e1f691/users/eef3811579114df494e5d3d914709e2f/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:17.840637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4158d-a81e-4094-acf6-a3482567201b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c68da02104a4818a37a8c0a36e1f691, user_id=eef3811579114df494e5d3d914709e2f, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:17.846916 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4158d-a81e-4094-acf6-a3482567201b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:17.901618 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 927/1876] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:17 2022] POST /identity/v3/projects => generated 363 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:17.903969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff4672-67e5-476c-b4fa-f2df7fdc01d4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:17.953925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 950/1877] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:17 2022] PUT /identity/v3/projects/7c68da02104a4818a37a8c0a36e1f691/users/eef3811579114df494e5d3d914709e2f/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:17.955080 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4158d-a81e-4094-acf6-a3482567201b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:18.029462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff4672-67e5-476c-b4fa-f2df7fdc01d4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:18.084095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:18.115903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4158d-a81e-4094-acf6-a3482567201b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:18.120164 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a93b8-f67e-4ff4-8e19-a20cb67c409b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:18.121585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a93b8-f67e-4ff4-8e19-a20cb67c409b admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:18.122102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a93b8-f67e-4ff4-8e19-a20cb67c409b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:18.122398 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd19fd4-8006-4661-a0dc-9d582774fd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:18.122624 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a93b8-f67e-4ff4-8e19-a20cb67c409b admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:18.123074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd19fd4-8006-4661-a0dc-9d582774fd3e admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:18.123393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd19fd4-8006-4661-a0dc-9d582774fd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:18.123670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd19fd4-8006-4661-a0dc-9d582774fd3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:18.124236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a93b8-f67e-4ff4-8e19-a20cb67c409b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:18.124413 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd19fd4-8006-4661-a0dc-9d582774fd3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:18.124712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd19fd4-8006-4661-a0dc-9d582774fd3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:18.124874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a93b8-f67e-4ff4-8e19-a20cb67c409b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:18.126579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd19fd4-8006-4661-a0dc-9d582774fd3e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:18.127962 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a93b8-f67e-4ff4-8e19-a20cb67c409b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:18.151164 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 951/1878] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:18.152702 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a93b8-f67e-4ff4-8e19-a20cb67c409b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:18.158589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 928/1879] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:18.162900 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fee84-ef05-425d-bbb8-270dc4d6574d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:18.163387 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fee84-ef05-425d-bbb8-270dc4d6574d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:18.163873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fee84-ef05-425d-bbb8-270dc4d6574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:18.170052 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a93b8-f67e-4ff4-8e19-a20cb67c409b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:18.177996 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15318383-d0be-4686-b5d4-e999e10c7f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:18.179224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15318383-d0be-4686-b5d4-e999e10c7f69 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:18.179721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15318383-d0be-4686-b5d4-e999e10c7f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:18.180232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15318383-d0be-4686-b5d4-e999e10c7f69 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:18.181579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15318383-d0be-4686-b5d4-e999e10c7f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:18.185706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15318383-d0be-4686-b5d4-e999e10c7f69 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:18.200599 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-266fee84-ef05-425d-bbb8-270dc4d6574d None None] MFA Rules not processed for user `eef3811579114df494e5d3d914709e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:18.202339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-266fee84-ef05-425d-bbb8-270dc4d6574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:18.301858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 929/1880] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:18.301858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fee84-ef05-425d-bbb8-270dc4d6574d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:18.315603 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fee84-ef05-425d-bbb8-270dc4d6574d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:18.322601 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 952/1881] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:18 2022] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:18.322601 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15318383-d0be-4686-b5d4-e999e10c7f69 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:18.323023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e82ea-a560-4446-9464-32438c91bbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:18.323023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e82ea-a560-4446-9464-32438c91bbca admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:18.323023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e82ea-a560-4446-9464-32438c91bbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:18.323023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e82ea-a560-4446-9464-32438c91bbca admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:18.323658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e82ea-a560-4446-9464-32438c91bbca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:18.325805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e82ea-a560-4446-9464-32438c91bbca admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:18.339675 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15318383-d0be-4686-b5d4-e999e10c7f69 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:18.356786 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1cdc2-b212-4357-99f2-61004bdbb4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:18.357967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1cdc2-b212-4357-99f2-61004bdbb4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:18.358556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1cdc2-b212-4357-99f2-61004bdbb4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:18.359053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1cdc2-b212-4357-99f2-61004bdbb4d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:18.360442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1cdc2-b212-4357-99f2-61004bdbb4d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:18.363713 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1cdc2-b212-4357-99f2-61004bdbb4d8 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:18.427629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 930/1882] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:18 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:18.427629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e82ea-a560-4446-9464-32438c91bbca admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:18.428235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f62e82ea-a560-4446-9464-32438c91bbca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:18.521901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 953/1883] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:18 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:18.523228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1cdc2-b212-4357-99f2-61004bdbb4d8 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:18.561663 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e82ea-a560-4446-9464-32438c91bbca admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:18.633640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1cdc2-b212-4357-99f2-61004bdbb4d8 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:18.633960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:18.647967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564ce80-fbb4-4171-b3a6-53946e4bc4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:18.649301 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564ce80-fbb4-4171-b3a6-53946e4bc4bf admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:18.649824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564ce80-fbb4-4171-b3a6-53946e4bc4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:18.650366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564ce80-fbb4-4171-b3a6-53946e4bc4bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:18.651779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564ce80-fbb4-4171-b3a6-53946e4bc4bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:18.655825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564ce80-fbb4-4171-b3a6-53946e4bc4bf admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:18.667778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945e436-5908-4224-9958-88b243bfabbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:18.668806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945e436-5908-4224-9958-88b243bfabbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:18.669777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945e436-5908-4224-9958-88b243bfabbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:18.670272 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945e436-5908-4224-9958-88b243bfabbd admin admin] PATH_INFO: `/v3/projects/be8e046d17964233aa8555ee30d4d66e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:18.672562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945e436-5908-4224-9958-88b243bfabbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8e046d17964233aa8555ee30d4d66e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:18.676404 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945e436-5908-4224-9958-88b243bfabbd admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:18.761377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 954/1884] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:18 2022] POST /identity/v3/projects => generated 401 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:18.761377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564ce80-fbb4-4171-b3a6-53946e4bc4bf admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:18.802444 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a945e436-5908-4224-9958-88b243bfabbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8e046d17964233aa8555ee30d4d66e', 'request_id': 'req-a945e436-5908-4224-9958-88b243bfabbd'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:18.810726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a945e436-5908-4224-9958-88b243bfabbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8e046d17964233aa8555ee30d4d66e', 'request_id': 'req-a945e436-5908-4224-9958-88b243bfabbd'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:18.818882 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a945e436-5908-4224-9958-88b243bfabbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8e046d17964233aa8555ee30d4d66e', 'request_id': 'req-a945e436-5908-4224-9958-88b243bfabbd'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:18.865359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564ce80-fbb4-4171-b3a6-53946e4bc4bf admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:18.932002 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f112c-64ab-4ed9-905c-22ca98c177c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:18.932831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f112c-64ab-4ed9-905c-22ca98c177c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:18.933179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f112c-64ab-4ed9-905c-22ca98c177c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:18.933542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f112c-64ab-4ed9-905c-22ca98c177c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:18.934603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f112c-64ab-4ed9-905c-22ca98c177c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:18.936657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f112c-64ab-4ed9-905c-22ca98c177c8 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:18.954767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 955/1885] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:18.954767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f112c-64ab-4ed9-905c-22ca98c177c8 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:18.974021 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f112c-64ab-4ed9-905c-22ca98c177c8 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:18.982051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd22de-bcc0-4117-ae27-746679a12614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:18.983277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd22de-bcc0-4117-ae27-746679a12614 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:18.983792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd22de-bcc0-4117-ae27-746679a12614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:18.984298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd22de-bcc0-4117-ae27-746679a12614 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:18.985613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd22de-bcc0-4117-ae27-746679a12614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:18.989930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd22de-bcc0-4117-ae27-746679a12614 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:19.026654 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a945e436-5908-4224-9958-88b243bfabbd admin admin] The token cache is being invalidate because project be8e046d17964233aa8555ee30d4d66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:19.026978 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a945e436-5908-4224-9958-88b243bfabbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:19.027949 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a945e436-5908-4224-9958-88b243bfabbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:19.029640 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 931/1886] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:18 2022] DELETE /identity/v3/projects/be8e046d17964233aa8555ee30d4d66e => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:19.030431 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945e436-5908-4224-9958-88b243bfabbd admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:19.032571 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a945e436-5908-4224-9958-88b243bfabbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:19.057466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945e436-5908-4224-9958-88b243bfabbd admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:19.065472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b60a6-a37e-4dca-8642-002ac4a12d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:19.066691 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b60a6-a37e-4dca-8642-002ac4a12d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:19.067204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b60a6-a37e-4dca-8642-002ac4a12d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:19.067770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b60a6-a37e-4dca-8642-002ac4a12d5e admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:19.069388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b60a6-a37e-4dca-8642-002ac4a12d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:19.073268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b60a6-a37e-4dca-8642-002ac4a12d5e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:19.111089 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 956/1887] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:18 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:19.113262 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd22de-bcc0-4117-ae27-746679a12614 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:19.114761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-59bd22de-bcc0-4117-ae27-746679a12614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:19.130868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd22de-bcc0-4117-ae27-746679a12614 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:19.136763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70d872-a93b-4fca-80ac-a20563b8ca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:19.137514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70d872-a93b-4fca-80ac-a20563b8ca3c admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:19.137820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70d872-a93b-4fca-80ac-a20563b8ca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:19.138306 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70d872-a93b-4fca-80ac-a20563b8ca3c admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:19.139075 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70d872-a93b-4fca-80ac-a20563b8ca3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:19.144470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70d872-a93b-4fca-80ac-a20563b8ca3c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:19.208232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 932/1888] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:19 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:19.209665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b60a6-a37e-4dca-8642-002ac4a12d5e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:19.212897 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1a1b60a6-a37e-4dca-8642-002ac4a12d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:19.234652 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 957/1889] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:19 2022] POST /identity/v3/users => generated 307 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:19.236123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66428f8c-25fb-4717-8020-732fbcee528f None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:19.236409 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66428f8c-25fb-4717-8020-732fbcee528f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:19.236676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66428f8c-25fb-4717-8020-732fbcee528f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:19.246832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b60a6-a37e-4dca-8642-002ac4a12d5e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:19.256350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df392161-ebac-4144-b6e9-161de2454e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:19.257888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df392161-ebac-4144-b6e9-161de2454e23 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:19.258479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df392161-ebac-4144-b6e9-161de2454e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:19.258999 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df392161-ebac-4144-b6e9-161de2454e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:19.260449 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df392161-ebac-4144-b6e9-161de2454e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:19.262192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-66428f8c-25fb-4717-8020-732fbcee528f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:19.263619 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-66428f8c-25fb-4717-8020-732fbcee528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:19.264013 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df392161-ebac-4144-b6e9-161de2454e23 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:19.278712 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 958/1890] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:19.280620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66428f8c-25fb-4717-8020-732fbcee528f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:19.284971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-66428f8c-25fb-4717-8020-732fbcee528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:19.294136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 933/1891] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:19.295589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df392161-ebac-4144-b6e9-161de2454e23 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:19.307731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df392161-ebac-4144-b6e9-161de2454e23 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:19.309796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66428f8c-25fb-4717-8020-732fbcee528f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:19.313300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9bcec-3955-46d9-9204-16c67039d759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:19.313985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9bcec-3955-46d9-9204-16c67039d759 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:19.314268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9bcec-3955-46d9-9204-16c67039d759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:19.314677 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9bcec-3955-46d9-9204-16c67039d759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:19.320589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9bcec-3955-46d9-9204-16c67039d759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:19.320589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9bcec-3955-46d9-9204-16c67039d759 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:19.320931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4de58-9e76-4ff0-942c-95b6fe2e0b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:19.320931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4de58-9e76-4ff0-942c-95b6fe2e0b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:19.321474 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4de58-9e76-4ff0-942c-95b6fe2e0b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:19.322423 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4de58-9e76-4ff0-942c-95b6fe2e0b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:19.324091 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4de58-9e76-4ff0-942c-95b6fe2e0b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:19.327505 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4de58-9e76-4ff0-942c-95b6fe2e0b75 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:19.339141 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 934/1892] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:19.339141 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9bcec-3955-46d9-9204-16c67039d759 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:19.356121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 959/1893] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:19.356369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9bcec-3955-46d9-9204-16c67039d759 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:19.356538 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3fdb2-53fb-4c95-9f24-0dd2ddb14a97 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:19.356538 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3fdb2-53fb-4c95-9f24-0dd2ddb14a97 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:19.356538 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3fdb2-53fb-4c95-9f24-0dd2ddb14a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:19.364731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097da602-6ee3-498e-b9aa-c971ce154847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:19.366193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097da602-6ee3-498e-b9aa-c971ce154847 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:19.366740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097da602-6ee3-498e-b9aa-c971ce154847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:19.367307 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097da602-6ee3-498e-b9aa-c971ce154847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:19.368757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097da602-6ee3-498e-b9aa-c971ce154847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:19.372382 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097da602-6ee3-498e-b9aa-c971ce154847 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:19.379824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-39f3fdb2-53fb-4c95-9f24-0dd2ddb14a97 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:19.381165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-39f3fdb2-53fb-4c95-9f24-0dd2ddb14a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:19.391399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 960/1894] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:19.392055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3fdb2-53fb-4c95-9f24-0dd2ddb14a97 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:19.398728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 935/1895] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:19.399744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097da602-6ee3-498e-b9aa-c971ce154847 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:19.405453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:19.413765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097da602-6ee3-498e-b9aa-c971ce154847 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:19.417045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3fdb2-53fb-4c95-9f24-0dd2ddb14a97 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:19.419524 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1687417-b7c9-4995-96f8-b952a5966c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:19.420363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1687417-b7c9-4995-96f8-b952a5966c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:19.420769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1687417-b7c9-4995-96f8-b952a5966c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:19.421246 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1687417-b7c9-4995-96f8-b952a5966c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:19.422154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1687417-b7c9-4995-96f8-b952a5966c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:19.422314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a971f-51d8-4a7f-a3ee-bec578a6051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:19.423457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a971f-51d8-4a7f-a3ee-bec578a6051f admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:19.423730 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a971f-51d8-4a7f-a3ee-bec578a6051f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:19.424000 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a971f-51d8-4a7f-a3ee-bec578a6051f admin admin] PATH_INFO: `/v3/projects/df86145b25454d319f775ac136bf2710/users/476c6caf78914745869bbe2e9a28fba0/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:19.424740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1687417-b7c9-4995-96f8-b952a5966c43 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:19.439444 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 936/1896] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:19.441019 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1687417-b7c9-4995-96f8-b952a5966c43 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:19.445763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a971f-51d8-4a7f-a3ee-bec578a6051f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df86145b25454d319f775ac136bf2710, user_id=476c6caf78914745869bbe2e9a28fba0, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:19.451770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a971f-51d8-4a7f-a3ee-bec578a6051f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:19.453109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1687417-b7c9-4995-96f8-b952a5966c43 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:19.459627 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ad1f7-aa5f-40f9-b371-8f865ba3b0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:19.460311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ad1f7-aa5f-40f9-b371-8f865ba3b0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:19.460597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ad1f7-aa5f-40f9-b371-8f865ba3b0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:19.460878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ad1f7-aa5f-40f9-b371-8f865ba3b0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:19.461623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ad1f7-aa5f-40f9-b371-8f865ba3b0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:19.463361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ad1f7-aa5f-40f9-b371-8f865ba3b0d0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:19.476524 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 937/1897] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:19.477560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ad1f7-aa5f-40f9-b371-8f865ba3b0d0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:19.488682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ad1f7-aa5f-40f9-b371-8f865ba3b0d0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:19.495803 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db0ada-f4a8-477c-bc68-0f3aa99a4541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:19.496933 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0ada-f4a8-477c-bc68-0f3aa99a4541 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:19.497305 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0ada-f4a8-477c-bc68-0f3aa99a4541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:19.497697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0ada-f4a8-477c-bc68-0f3aa99a4541 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:19.498583 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db0ada-f4a8-477c-bc68-0f3aa99a4541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:19.504472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db0ada-f4a8-477c-bc68-0f3aa99a4541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:19.504472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db0ada-f4a8-477c-bc68-0f3aa99a4541 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:19.514890 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 938/1898] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:19.516120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db0ada-f4a8-477c-bc68-0f3aa99a4541 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:19.531913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db0ada-f4a8-477c-bc68-0f3aa99a4541 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:19.538191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 961/1899] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:19 2022] PUT /identity/v3/projects/df86145b25454d319f775ac136bf2710/users/476c6caf78914745869bbe2e9a28fba0/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:19.539565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a971f-51d8-4a7f-a3ee-bec578a6051f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:19.629900 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30578597-83b2-4c56-aa71-a2b2e80c5a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:19.631308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30578597-83b2-4c56-aa71-a2b2e80c5a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:19.631778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30578597-83b2-4c56-aa71-a2b2e80c5a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:19.632125 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30578597-83b2-4c56-aa71-a2b2e80c5a9a admin admin] PATH_INFO: `/v3/projects/fc51aee0bd2f4597b1aaf0466ae379f9/users/7c0fe2aeda2d47e2bd0f0798ab032535/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:19.649404 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a971f-51d8-4a7f-a3ee-bec578a6051f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:19.658266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30578597-83b2-4c56-aa71-a2b2e80c5a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc51aee0bd2f4597b1aaf0466ae379f9, user_id=7c0fe2aeda2d47e2bd0f0798ab032535, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:19.660218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0b6eb-c7e0-49b2-8227-b6882bec52cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:19.662414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b6eb-c7e0-49b2-8227-b6882bec52cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:19.663491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b6eb-c7e0-49b2-8227-b6882bec52cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:19.664027 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30578597-83b2-4c56-aa71-a2b2e80c5a9a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:19.664803 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b6eb-c7e0-49b2-8227-b6882bec52cf admin admin] PATH_INFO: `/v3/projects/e159393918854a0496d9b0b01abb6e40/users/c12ef666817d41868284fd31cef205cf/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:19.672549 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:19.692782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0b6eb-c7e0-49b2-8227-b6882bec52cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e159393918854a0496d9b0b01abb6e40, user_id=c12ef666817d41868284fd31cef205cf, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:19.695865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0b6eb-c7e0-49b2-8227-b6882bec52cf admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:19.800254 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 939/1900] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:19 2022] PUT /identity/v3/projects/fc51aee0bd2f4597b1aaf0466ae379f9/users/7c0fe2aeda2d47e2bd0f0798ab032535/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:19.800254 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30578597-83b2-4c56-aa71-a2b2e80c5a9a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:19.846530 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 962/1901] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:19 2022] PUT /identity/v3/projects/e159393918854a0496d9b0b01abb6e40/users/c12ef666817d41868284fd31cef205cf/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:19.846530 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0b6eb-c7e0-49b2-8227-b6882bec52cf admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:19.910481 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30578597-83b2-4c56-aa71-a2b2e80c5a9a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:19.947577 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:19.993359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0b6eb-c7e0-49b2-8227-b6882bec52cf admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:20.004176 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b584c-f29c-4fa0-91c2-279b3054b31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:20.004950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b584c-f29c-4fa0-91c2-279b3054b31f admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:20.005125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b584c-f29c-4fa0-91c2-279b3054b31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:20.005403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b584c-f29c-4fa0-91c2-279b3054b31f admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:20.006120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b584c-f29c-4fa0-91c2-279b3054b31f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:20.008308 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b584c-f29c-4fa0-91c2-279b3054b31f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:20.015744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b68149-8389-4868-b75a-e8c451c10e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:20.017859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b68149-8389-4868-b75a-e8c451c10e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:20.017859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b68149-8389-4868-b75a-e8c451c10e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:20.018758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b68149-8389-4868-b75a-e8c451c10e07 admin admin] PATH_INFO: `/v3/projects/488ab7a9b1f04ad09bedf464c9f3ebb2/users/c0f693dc69014f3ca2e1158810e28802/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:20.041686 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b68149-8389-4868-b75a-e8c451c10e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=488ab7a9b1f04ad09bedf464c9f3ebb2, user_id=c0f693dc69014f3ca2e1158810e28802, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:20.046539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b68149-8389-4868-b75a-e8c451c10e07 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:20.094771 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 963/1902] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:19 2022] POST /identity/v3/projects => generated 377 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:20.096191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0f4a-a515-41c6-b07d-4d328449e8fc None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:20.097355 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0f4a-a515-41c6-b07d-4d328449e8fc None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:20.097560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0f4a-a515-41c6-b07d-4d328449e8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:20.134222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-418f0f4a-a515-41c6-b07d-4d328449e8fc None None] MFA Rules not processed for user `476c6caf78914745869bbe2e9a28fba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:20.136401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-418f0f4a-a515-41c6-b07d-4d328449e8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:20.142152 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 940/1903] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:19 2022] PUT /identity/v3/projects/488ab7a9b1f04ad09bedf464c9f3ebb2/users/c0f693dc69014f3ca2e1158810e28802/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:20.144839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b68149-8389-4868-b75a-e8c451c10e07 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:20.247872 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b68149-8389-4868-b75a-e8c451c10e07 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:20.256619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c912796-6881-4f91-a4b9-644d7a214a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:20.256922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 964/1904] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:20.257764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c912796-6881-4f91-a4b9-644d7a214a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:20.258079 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d70c1-88ad-4d53-898f-c4385f538a62 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:20.258260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c912796-6881-4f91-a4b9-644d7a214a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:20.258647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d70c1-88ad-4d53-898f-c4385f538a62 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:20.258827 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c912796-6881-4f91-a4b9-644d7a214a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:20.258979 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d70c1-88ad-4d53-898f-c4385f538a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:20.260206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c912796-6881-4f91-a4b9-644d7a214a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:20.263487 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c912796-6881-4f91-a4b9-644d7a214a05 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:20.285635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 941/1905] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:20.287003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c912796-6881-4f91-a4b9-644d7a214a05 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:20.295488 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-157d70c1-88ad-4d53-898f-c4385f538a62 None None] MFA Rules not processed for user `c12ef666817d41868284fd31cef205cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:20.297071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-157d70c1-88ad-4d53-898f-c4385f538a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:20.305470 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c912796-6881-4f91-a4b9-644d7a214a05 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:20.313818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13762d-38bd-4b03-a8d2-7ef1b349f3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:20.315120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13762d-38bd-4b03-a8d2-7ef1b349f3cc admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:20.315691 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13762d-38bd-4b03-a8d2-7ef1b349f3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:20.316114 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13762d-38bd-4b03-a8d2-7ef1b349f3cc admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:20.317404 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13762d-38bd-4b03-a8d2-7ef1b349f3cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:20.321210 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13762d-38bd-4b03-a8d2-7ef1b349f3cc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:20.380244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 965/1906] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:20.381695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0346b-71f1-4989-8857-38b61a28230c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:20.382007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0346b-71f1-4989-8857-38b61a28230c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:20.382511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0346b-71f1-4989-8857-38b61a28230c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:20.417985 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-4af0346b-71f1-4989-8857-38b61a28230c None None] MFA Rules not processed for user `c0f693dc69014f3ca2e1158810e28802`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:20.419118 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4af0346b-71f1-4989-8857-38b61a28230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:20.504942 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 942/1907] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:20 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:20.507579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13762d-38bd-4b03-a8d2-7ef1b349f3cc admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:20.527740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13762d-38bd-4b03-a8d2-7ef1b349f3cc admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:20.538135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 966/1908] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:20.539273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71c8a3-7f8e-46a2-a58d-0b939e794662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:20.539650 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0346b-71f1-4989-8857-38b61a28230c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:20.540890 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c8a3-7f8e-46a2-a58d-0b939e794662 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:20.541410 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c8a3-7f8e-46a2-a58d-0b939e794662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:20.542018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c8a3-7f8e-46a2-a58d-0b939e794662 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:20.544324 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71c8a3-7f8e-46a2-a58d-0b939e794662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:20.547448 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71c8a3-7f8e-46a2-a58d-0b939e794662 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:20.567815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0346b-71f1-4989-8857-38b61a28230c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:20.576611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdea5dc-dca3-4cea-9822-7555a576fe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:20.577674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdea5dc-dca3-4cea-9822-7555a576fe52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:20.578023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdea5dc-dca3-4cea-9822-7555a576fe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:20.578406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdea5dc-dca3-4cea-9822-7555a576fe52 admin admin] PATH_INFO: `/v3/projects/fc51aee0bd2f4597b1aaf0466ae379f9/users/7c0fe2aeda2d47e2bd0f0798ab032535/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:20.580644 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdea5dc-dca3-4cea-9822-7555a576fe52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc51aee0bd2f4597b1aaf0466ae379f9, user_id=7c0fe2aeda2d47e2bd0f0798ab032535, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:20.584081 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdea5dc-dca3-4cea-9822-7555a576fe52 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:20.598343 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 967/1909] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:20 2022] PUT /identity/v3/projects/fc51aee0bd2f4597b1aaf0466ae379f9/users/7c0fe2aeda2d47e2bd0f0798ab032535/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:20.599389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdea5dc-dca3-4cea-9822-7555a576fe52 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:20.689393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 943/1910] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:20 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:20.691715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71c8a3-7f8e-46a2-a58d-0b939e794662 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:20.703180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdea5dc-dca3-4cea-9822-7555a576fe52 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:20.791949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75b416-cbc7-4240-b601-3e7024890651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:20.793170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75b416-cbc7-4240-b601-3e7024890651 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:20.793733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75b416-cbc7-4240-b601-3e7024890651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:20.794226 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75b416-cbc7-4240-b601-3e7024890651 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:20.795604 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75b416-cbc7-4240-b601-3e7024890651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:20.798221 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71c8a3-7f8e-46a2-a58d-0b939e794662 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:20.799554 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75b416-cbc7-4240-b601-3e7024890651 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:20.807531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63734342-f5f0-4210-872e-1c2e159a99cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:20.812421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63734342-f5f0-4210-872e-1c2e159a99cc admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:20.812421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63734342-f5f0-4210-872e-1c2e159a99cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:20.812421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63734342-f5f0-4210-872e-1c2e159a99cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:20.812421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63734342-f5f0-4210-872e-1c2e159a99cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:20.813820 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63734342-f5f0-4210-872e-1c2e159a99cc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:20.836053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 944/1911] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:20.839040 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63734342-f5f0-4210-872e-1c2e159a99cc admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:20.855469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63734342-f5f0-4210-872e-1c2e159a99cc admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:20.864819 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d897a7-baf0-4dc5-9d29-0fd2a10fe80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:20.865847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d897a7-baf0-4dc5-9d29-0fd2a10fe80a admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:20.866287 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d897a7-baf0-4dc5-9d29-0fd2a10fe80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:20.866788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d897a7-baf0-4dc5-9d29-0fd2a10fe80a admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:20.868851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d897a7-baf0-4dc5-9d29-0fd2a10fe80a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:20.871753 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d897a7-baf0-4dc5-9d29-0fd2a10fe80a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:20.965437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 968/1912] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:20 2022] POST /identity/v3/projects => generated 385 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:20.968591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62c6aa-1d33-423e-85aa-b276e68dc907 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:20.969042 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62c6aa-1d33-423e-85aa-b276e68dc907 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:20.969594 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62c6aa-1d33-423e-85aa-b276e68dc907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:21.022419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:21.026150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-dc62c6aa-1d33-423e-85aa-b276e68dc907 None None] MFA Rules not processed for user `7c0fe2aeda2d47e2bd0f0798ab032535`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:21.027944 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dc62c6aa-1d33-423e-85aa-b276e68dc907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:21.034620 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 945/1913] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:20 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:21.036321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d897a7-baf0-4dc5-9d29-0fd2a10fe80a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:21.142143 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 969/1914] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:21.143631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62c6aa-1d33-423e-85aa-b276e68dc907 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:21.150042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d897a7-baf0-4dc5-9d29-0fd2a10fe80a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:21.156219 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62c6aa-1d33-423e-85aa-b276e68dc907 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:21.159450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e01025-3c0f-4b46-bd1c-e5a21def4bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:21.159450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e01025-3c0f-4b46-bd1c-e5a21def4bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:21.159450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e01025-3c0f-4b46-bd1c-e5a21def4bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:21.159450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e01025-3c0f-4b46-bd1c-e5a21def4bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:21.160529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e01025-3c0f-4b46-bd1c-e5a21def4bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:21.162589 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f33b5-b5b4-471e-8dc1-dde18f782b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:21.162920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e01025-3c0f-4b46-bd1c-e5a21def4bc7 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:21.163544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f33b5-b5b4-471e-8dc1-dde18f782b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:21.164012 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f33b5-b5b4-471e-8dc1-dde18f782b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:21.164417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f33b5-b5b4-471e-8dc1-dde18f782b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:21.165358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f33b5-b5b4-471e-8dc1-dde18f782b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:21.167188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f33b5-b5b4-471e-8dc1-dde18f782b8e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:21.184148 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 970/1915] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:21.184148 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f33b5-b5b4-471e-8dc1-dde18f782b8e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:21.194477 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:21.202424 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f33b5-b5b4-471e-8dc1-dde18f782b8e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:21.209196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb74e4-0bc4-49c3-8b16-44c98437bf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:21.209981 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb74e4-0bc4-49c3-8b16-44c98437bf14 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:21.210384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb74e4-0bc4-49c3-8b16-44c98437bf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:21.210789 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb74e4-0bc4-49c3-8b16-44c98437bf14 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:21.211950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb74e4-0bc4-49c3-8b16-44c98437bf14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:21.215454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb74e4-0bc4-49c3-8b16-44c98437bf14 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:21.288176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 946/1916] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:21 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:21.290735 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e01025-3c0f-4b46-bd1c-e5a21def4bc7 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:21.312273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e01025-3c0f-4b46-bd1c-e5a21def4bc7 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:21.320700 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ff4da-f3de-4153-831c-531013bfc337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:21.329475 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ff4da-f3de-4153-831c-531013bfc337 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:21.329475 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ff4da-f3de-4153-831c-531013bfc337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:21.329475 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ff4da-f3de-4153-831c-531013bfc337 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:21.329475 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ff4da-f3de-4153-831c-531013bfc337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:21.329475 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ff4da-f3de-4153-831c-531013bfc337 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:21.358704 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 971/1917] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:21 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:21.359644 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb74e4-0bc4-49c3-8b16-44c98437bf14 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:21.362000 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3dfb74e4-0bc4-49c3-8b16-44c98437bf14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:21.425464 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 947/1918] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:21 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:21.426568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ff4da-f3de-4153-831c-531013bfc337 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:21.438696 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ff4da-f3de-4153-831c-531013bfc337 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:21.445271 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4321347-9b49-4554-a1a5-8803cfe98114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:21.446208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4321347-9b49-4554-a1a5-8803cfe98114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:21.446529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4321347-9b49-4554-a1a5-8803cfe98114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:21.446813 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4321347-9b49-4554-a1a5-8803cfe98114 admin admin] PATH_INFO: `/v3/projects/9a9a53e4516749108aad2020373c3763/users/460fc330cd7246748f88dae502336e1c/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:21.454637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb74e4-0bc4-49c3-8b16-44c98437bf14 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:21.461495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a73b4-fc6a-47fb-bd35-45729180f877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:21.463750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a73b4-fc6a-47fb-bd35-45729180f877 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:21.463750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a73b4-fc6a-47fb-bd35-45729180f877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:21.463750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a73b4-fc6a-47fb-bd35-45729180f877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:21.471571 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4321347-9b49-4554-a1a5-8803cfe98114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9a53e4516749108aad2020373c3763, user_id=460fc330cd7246748f88dae502336e1c, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:21.477325 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4321347-9b49-4554-a1a5-8803cfe98114 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:21.480275 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a73b4-fc6a-47fb-bd35-45729180f877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:21.482880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a73b4-fc6a-47fb-bd35-45729180f877 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:21.497590 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 972/1919] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:21.499154 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a73b4-fc6a-47fb-bd35-45729180f877 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:21.516994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a73b4-fc6a-47fb-bd35-45729180f877 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:21.524575 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a80df-f476-4663-a76b-de76c74ff51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:21.527123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a80df-f476-4663-a76b-de76c74ff51e admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:21.527123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a80df-f476-4663-a76b-de76c74ff51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:21.527123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a80df-f476-4663-a76b-de76c74ff51e admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:21.527980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a80df-f476-4663-a76b-de76c74ff51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:21.530963 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a80df-f476-4663-a76b-de76c74ff51e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:21.551013 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 973/1920] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:21.552269 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a80df-f476-4663-a76b-de76c74ff51e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:21.558219 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 948/1921] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:21 2022] PUT /identity/v3/projects/9a9a53e4516749108aad2020373c3763/users/460fc330cd7246748f88dae502336e1c/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:21.558219 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4321347-9b49-4554-a1a5-8803cfe98114 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:21.575094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a80df-f476-4663-a76b-de76c74ff51e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:21.645060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4321347-9b49-4554-a1a5-8803cfe98114 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:21.650472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27945d48-90c8-40de-b848-de778635198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:21.651460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27945d48-90c8-40de-b848-de778635198b admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:21.651621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27945d48-90c8-40de-b848-de778635198b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:21.651783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27945d48-90c8-40de-b848-de778635198b admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:21.652538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27945d48-90c8-40de-b848-de778635198b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:21.654477 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27945d48-90c8-40de-b848-de778635198b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:21.673350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 949/1922] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:21.673350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27945d48-90c8-40de-b848-de778635198b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:21.677861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2d12c-61a1-4b3b-8994-c3d0a2762189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:21.678589 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d12c-61a1-4b3b-8994-c3d0a2762189 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:21.678870 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d12c-61a1-4b3b-8994-c3d0a2762189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:21.679151 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d12c-61a1-4b3b-8994-c3d0a2762189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:21.679894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2d12c-61a1-4b3b-8994-c3d0a2762189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:21.681742 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2d12c-61a1-4b3b-8994-c3d0a2762189 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:21.694722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27945d48-90c8-40de-b848-de778635198b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:21.699619 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 974/1923] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:21.701987 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dfcdd-7757-436d-bdeb-b139e8cf8675 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:21.702530 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dfcdd-7757-436d-bdeb-b139e8cf8675 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:21.703036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dfcdd-7757-436d-bdeb-b139e8cf8675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:21.704771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca831b97-6446-46b3-958f-178665582591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:21.706085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca831b97-6446-46b3-958f-178665582591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:21.706730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca831b97-6446-46b3-958f-178665582591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:21.708387 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca831b97-6446-46b3-958f-178665582591 admin admin] PATH_INFO: `/v3/projects/8659fa91b5ef4ef295aaa7a5872ccbc9/users/1943ae0e67864cc69a998fb58f5bdc46/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:21.727512 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca831b97-6446-46b3-958f-178665582591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8659fa91b5ef4ef295aaa7a5872ccbc9, user_id=1943ae0e67864cc69a998fb58f5bdc46, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:21.730614 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca831b97-6446-46b3-958f-178665582591 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:21.759894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-dd4dfcdd-7757-436d-bdeb-b139e8cf8675 None None] MFA Rules not processed for user `460fc330cd7246748f88dae502336e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:21.763028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dd4dfcdd-7757-436d-bdeb-b139e8cf8675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:21.865361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 950/1924] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:21 2022] PUT /identity/v3/projects/8659fa91b5ef4ef295aaa7a5872ccbc9/users/1943ae0e67864cc69a998fb58f5bdc46/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:21.867534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca831b97-6446-46b3-958f-178665582591 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:21.880333 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 975/1925] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:21.881234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4dfcdd-7757-436d-bdeb-b139e8cf8675 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:21.895289 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4dfcdd-7757-436d-bdeb-b139e8cf8675 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:21.993718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca831b97-6446-46b3-958f-178665582591 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:21.996426 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4665a49-6631-47ce-bab6-6a9ba33cb311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:21.997642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4665a49-6631-47ce-bab6-6a9ba33cb311 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:21.997856 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4665a49-6631-47ce-bab6-6a9ba33cb311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:21.998236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4665a49-6631-47ce-bab6-6a9ba33cb311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:21.999144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4665a49-6631-47ce-bab6-6a9ba33cb311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:22.001090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4665a49-6631-47ce-bab6-6a9ba33cb311 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:22.007080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60473581-f138-4b91-88d8-23d8cab25870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:22.009536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473581-f138-4b91-88d8-23d8cab25870 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:22.010007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473581-f138-4b91-88d8-23d8cab25870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:22.010652 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473581-f138-4b91-88d8-23d8cab25870 admin admin] PATH_INFO: `/v3/projects/31510ebe134a4e8cb7369a4193333f04/users/37fca0d9e6b3455e8ff57cf6cd60f8fe/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:22.025198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 976/1926] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:22.027248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4665a49-6631-47ce-bab6-6a9ba33cb311 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:22.045077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60473581-f138-4b91-88d8-23d8cab25870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31510ebe134a4e8cb7369a4193333f04, user_id=37fca0d9e6b3455e8ff57cf6cd60f8fe, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:22.051097 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60473581-f138-4b91-88d8-23d8cab25870 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:22.130813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4665a49-6631-47ce-bab6-6a9ba33cb311 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:22.138013 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 951/1927] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:21 2022] PUT /identity/v3/projects/31510ebe134a4e8cb7369a4193333f04/users/37fca0d9e6b3455e8ff57cf6cd60f8fe/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:22.138013 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60473581-f138-4b91-88d8-23d8cab25870 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:22.259165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60473581-f138-4b91-88d8-23d8cab25870 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:22.261159 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d56a68-709e-481d-b882-1f249f29705b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:22.262133 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d56a68-709e-481d-b882-1f249f29705b service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:22.262778 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d56a68-709e-481d-b882-1f249f29705b service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:22.263640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d56a68-709e-481d-b882-1f249f29705b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:22.266594 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-02d56a68-709e-481d-b882-1f249f29705b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:22.269706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800f3f8-ef63-41bb-a274-80e2cca95ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:22.270795 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800f3f8-ef63-41bb-a274-80e2cca95ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:22.271265 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800f3f8-ef63-41bb-a274-80e2cca95ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:22.271804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800f3f8-ef63-41bb-a274-80e2cca95ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:22.273185 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800f3f8-ef63-41bb-a274-80e2cca95ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:22.276589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800f3f8-ef63-41bb-a274-80e2cca95ccd admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:22.292753 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 952/1928] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:22.293967 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800f3f8-ef63-41bb-a274-80e2cca95ccd admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:22.308513 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800f3f8-ef63-41bb-a274-80e2cca95ccd admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:22.315791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ff0af-e953-4c17-8620-14cb3fbf7a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:22.316705 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ff0af-e953-4c17-8620-14cb3fbf7a66 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:22.316993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ff0af-e953-4c17-8620-14cb3fbf7a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:22.317271 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ff0af-e953-4c17-8620-14cb3fbf7a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:22.318220 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ff0af-e953-4c17-8620-14cb3fbf7a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:22.324083 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ff0af-e953-4c17-8620-14cb3fbf7a66 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:22.369426 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d56a68-709e-481d-b882-1f249f29705b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:22.372120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d56a68-709e-481d-b882-1f249f29705b service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:22.383773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 977/1929] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:22.384554 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d56a68-709e-481d-b882-1f249f29705b service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:22.398682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d56a68-709e-481d-b882-1f249f29705b service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:22.404298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff107d3-049d-4f76-a87a-fed7f429291d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:22.405257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff107d3-049d-4f76-a87a-fed7f429291d admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:22.405629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff107d3-049d-4f76-a87a-fed7f429291d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:22.412286 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff107d3-049d-4f76-a87a-fed7f429291d admin admin] PATH_INFO: `/v3/projects/d222448b86b7467880df55f71210b862/users/6fd3d627b5d649c99ebc56fcacddfdf4/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:22.426147 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff107d3-049d-4f76-a87a-fed7f429291d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d222448b86b7467880df55f71210b862, user_id=6fd3d627b5d649c99ebc56fcacddfdf4, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:22.430392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff107d3-049d-4f76-a87a-fed7f429291d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:22.460649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 953/1930] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:22 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:22.463478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ff0af-e953-4c17-8620-14cb3fbf7a66 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:22.531729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 978/1931] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:22 2022] PUT /identity/v3/projects/d222448b86b7467880df55f71210b862/users/6fd3d627b5d649c99ebc56fcacddfdf4/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:22.533241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff107d3-049d-4f76-a87a-fed7f429291d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:22.618912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ff0af-e953-4c17-8620-14cb3fbf7a66 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:22.680792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff107d3-049d-4f76-a87a-fed7f429291d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:22.688541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:22.692770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70767469-b9f0-4135-913e-4b42f416ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:22.694588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70767469-b9f0-4135-913e-4b42f416ec7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:22.695407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70767469-b9f0-4135-913e-4b42f416ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:22.696311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70767469-b9f0-4135-913e-4b42f416ec7d admin admin] PATH_INFO: `/v3/projects/8659fa91b5ef4ef295aaa7a5872ccbc9/users/1943ae0e67864cc69a998fb58f5bdc46/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:22.700166 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70767469-b9f0-4135-913e-4b42f416ec7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8659fa91b5ef4ef295aaa7a5872ccbc9, user_id=1943ae0e67864cc69a998fb58f5bdc46, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:22.708218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70767469-b9f0-4135-913e-4b42f416ec7d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:22.732598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 979/1932] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:22 2022] PUT /identity/v3/projects/8659fa91b5ef4ef295aaa7a5872ccbc9/users/1943ae0e67864cc69a998fb58f5bdc46/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:22.734675 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70767469-b9f0-4135-913e-4b42f416ec7d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:22.755121 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0471a7d-c979-4ddd-9420-826a2389b017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:22.756261 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0471a7d-c979-4ddd-9420-826a2389b017 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:22.756739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0471a7d-c979-4ddd-9420-826a2389b017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:22.757206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0471a7d-c979-4ddd-9420-826a2389b017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:22.758693 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0471a7d-c979-4ddd-9420-826a2389b017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:22.762038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0471a7d-c979-4ddd-9420-826a2389b017 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:22.769869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:22.787046 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 954/1933] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:22.787312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c9296-d436-41bc-b9a4-b2008ba02bfa None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:22.788026 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c9296-d436-41bc-b9a4-b2008ba02bfa None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:22.788631 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c9296-d436-41bc-b9a4-b2008ba02bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:22.832666 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b50c9296-d436-41bc-b9a4-b2008ba02bfa None None] MFA Rules not processed for user `6fd3d627b5d649c99ebc56fcacddfdf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:22.835462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b50c9296-d436-41bc-b9a4-b2008ba02bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:22.848869 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70767469-b9f0-4135-913e-4b42f416ec7d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:22.857210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc112cee-7cde-4f93-88c7-12cd063fd39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:22.862931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc112cee-7cde-4f93-88c7-12cd063fd39e admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:22.862931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc112cee-7cde-4f93-88c7-12cd063fd39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:22.862931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc112cee-7cde-4f93-88c7-12cd063fd39e admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:22.862931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc112cee-7cde-4f93-88c7-12cd063fd39e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:22.863928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc112cee-7cde-4f93-88c7-12cd063fd39e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:22.945195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 955/1934] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:22.947998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee51ede-58a7-4ce5-ae86-c50e9161367b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:22.948494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee51ede-58a7-4ce5-ae86-c50e9161367b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:22.949212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee51ede-58a7-4ce5-ae86-c50e9161367b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:22.967710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 980/1935] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:22 2022] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:22.967710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc112cee-7cde-4f93-88c7-12cd063fd39e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:22.982090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc112cee-7cde-4f93-88c7-12cd063fd39e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:22.999685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd84f51-8ef1-4ad9-a5f6-184cb7c9ebbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:23.001318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd84f51-8ef1-4ad9-a5f6-184cb7c9ebbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:23.001649 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd84f51-8ef1-4ad9-a5f6-184cb7c9ebbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:23.001941 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd84f51-8ef1-4ad9-a5f6-184cb7c9ebbc admin admin] PATH_INFO: `/v3/projects/31510ebe134a4e8cb7369a4193333f04/users/37fca0d9e6b3455e8ff57cf6cd60f8fe/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:23.002599 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8ee51ede-58a7-4ce5-ae86-c50e9161367b None None] MFA Rules not processed for user `1943ae0e67864cc69a998fb58f5bdc46`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:23.004928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8ee51ede-58a7-4ce5-ae86-c50e9161367b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:23.005957 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd84f51-8ef1-4ad9-a5f6-184cb7c9ebbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=31510ebe134a4e8cb7369a4193333f04, user_id=37fca0d9e6b3455e8ff57cf6cd60f8fe, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:23.009143 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd84f51-8ef1-4ad9-a5f6-184cb7c9ebbc admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:23.024998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 981/1936] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:22 2022] PUT /identity/v3/projects/31510ebe134a4e8cb7369a4193333f04/users/37fca0d9e6b3455e8ff57cf6cd60f8fe/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:23.025744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd84f51-8ef1-4ad9-a5f6-184cb7c9ebbc admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:23.130108 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 956/1937] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:23.135910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee51ede-58a7-4ce5-ae86-c50e9161367b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:23.146612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd84f51-8ef1-4ad9-a5f6-184cb7c9ebbc admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:23.147816 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee51ede-58a7-4ce5-ae86-c50e9161367b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:23.157034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e13ccb-aeae-4380-aac6-60d8ee0a21a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:23.159219 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f820c74-d14a-4c87-af10-86eca7f76ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:23.160351 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f820c74-d14a-4c87-af10-86eca7f76ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:23.160351 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f820c74-d14a-4c87-af10-86eca7f76ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:23.160590 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f820c74-d14a-4c87-af10-86eca7f76ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:23.161171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f820c74-d14a-4c87-af10-86eca7f76ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:23.162283 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e13ccb-aeae-4380-aac6-60d8ee0a21a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:23.162827 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e13ccb-aeae-4380-aac6-60d8ee0a21a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:23.162956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f820c74-d14a-4c87-af10-86eca7f76ac2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:23.163359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e13ccb-aeae-4380-aac6-60d8ee0a21a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:23.166018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e13ccb-aeae-4380-aac6-60d8ee0a21a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:23.169394 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e13ccb-aeae-4380-aac6-60d8ee0a21a0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:23.178268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 957/1938] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:23.178268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f626-795d-42d4-98a0-075d70f5cba5 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:23.182766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f626-795d-42d4-98a0-075d70f5cba5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:23.183063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f626-795d-42d4-98a0-075d70f5cba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:23.216915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9659f626-795d-42d4-98a0-075d70f5cba5 None None] MFA Rules not processed for user `37fca0d9e6b3455e8ff57cf6cd60f8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:23.218186 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9659f626-795d-42d4-98a0-075d70f5cba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:23.305707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 958/1939] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:23.306485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659f626-795d-42d4-98a0-075d70f5cba5 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:23.307810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9659f626-795d-42d4-98a0-075d70f5cba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:23.318376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 982/1940] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:23 2022] POST /identity/v3/projects => generated 385 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:23.321884 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e13ccb-aeae-4380-aac6-60d8ee0a21a0 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:23.427754 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659f626-795d-42d4-98a0-075d70f5cba5 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:23.433791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e13ccb-aeae-4380-aac6-60d8ee0a21a0 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:23.442855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898fc8a-3f3f-42d6-bd9a-bb584cbe0cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:23.448111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898fc8a-3f3f-42d6-bd9a-bb584cbe0cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:23.448111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898fc8a-3f3f-42d6-bd9a-bb584cbe0cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:23.448111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898fc8a-3f3f-42d6-bd9a-bb584cbe0cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:23.448111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898fc8a-3f3f-42d6-bd9a-bb584cbe0cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:23.449983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898fc8a-3f3f-42d6-bd9a-bb584cbe0cc6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:23.467231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 983/1941] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:23.468130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898fc8a-3f3f-42d6-bd9a-bb584cbe0cc6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:23.489592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898fc8a-3f3f-42d6-bd9a-bb584cbe0cc6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:23.494980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df3d20-7f1f-4c39-ba6e-536551b8ac34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:23.496142 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df3d20-7f1f-4c39-ba6e-536551b8ac34 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:23.496495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df3d20-7f1f-4c39-ba6e-536551b8ac34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:23.496845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df3d20-7f1f-4c39-ba6e-536551b8ac34 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:23.497640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df3d20-7f1f-4c39-ba6e-536551b8ac34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:23.499876 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df3d20-7f1f-4c39-ba6e-536551b8ac34 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:23.511855 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2f4bf-b079-4bac-985c-e8f876f8495c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:23.512542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2f4bf-b079-4bac-985c-e8f876f8495c service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:23.512992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2f4bf-b079-4bac-985c-e8f876f8495c service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:23.513326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2f4bf-b079-4bac-985c-e8f876f8495c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:23.595820 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2f4bf-b079-4bac-985c-e8f876f8495c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:23.598106 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2f4bf-b079-4bac-985c-e8f876f8495c service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:23.609417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 959/1942] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:23.610698 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2f4bf-b079-4bac-985c-e8f876f8495c service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:23.616853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 984/1943] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:23 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:23.617255 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df3d20-7f1f-4c39-ba6e-536551b8ac34 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:23.623462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2f4bf-b079-4bac-985c-e8f876f8495c service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:23.628724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df3d20-7f1f-4c39-ba6e-536551b8ac34 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:23.630637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9300315-e4b3-494f-94b1-5608883c19d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:23.631308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9300315-e4b3-494f-94b1-5608883c19d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:23.631597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9300315-e4b3-494f-94b1-5608883c19d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:23.631906 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9300315-e4b3-494f-94b1-5608883c19d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:23.633626 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454295f-89a5-452b-bbd2-c7ce478de60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:23.634561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454295f-89a5-452b-bbd2-c7ce478de60a admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:23.635015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454295f-89a5-452b-bbd2-c7ce478de60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:23.635390 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454295f-89a5-452b-bbd2-c7ce478de60a admin admin] PATH_INFO: `/v3/projects/3c6b31a52a344919bedc43fb6f9b80f6/users/747bfd94669c4556a42db5736ba8d93d/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:23.656078 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454295f-89a5-452b-bbd2-c7ce478de60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6b31a52a344919bedc43fb6f9b80f6, user_id=747bfd94669c4556a42db5736ba8d93d, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:23.659318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454295f-89a5-452b-bbd2-c7ce478de60a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:23.699637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9300315-e4b3-494f-94b1-5608883c19d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:23.701121 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9300315-e4b3-494f-94b1-5608883c19d3 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:23.714574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 960/1944] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:23.726943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9300315-e4b3-494f-94b1-5608883c19d3 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:23.737326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9300315-e4b3-494f-94b1-5608883c19d3 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:23.742418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6311cf-15a6-4e52-8dd8-6ca77827cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:23.743244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6311cf-15a6-4e52-8dd8-6ca77827cc98 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:23.743562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6311cf-15a6-4e52-8dd8-6ca77827cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:23.743928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6311cf-15a6-4e52-8dd8-6ca77827cc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:23.748081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6311cf-15a6-4e52-8dd8-6ca77827cc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:23.748081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6311cf-15a6-4e52-8dd8-6ca77827cc98 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:23.763762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 961/1945] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:23.765340 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6311cf-15a6-4e52-8dd8-6ca77827cc98 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:23.777052 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 985/1946] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:23 2022] PUT /identity/v3/projects/3c6b31a52a344919bedc43fb6f9b80f6/users/747bfd94669c4556a42db5736ba8d93d/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:23.792775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91188855-9c0b-4136-a043-6e8a62263d03 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:23.792775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91188855-9c0b-4136-a043-6e8a62263d03 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:23.793094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91188855-9c0b-4136-a043-6e8a62263d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:23.808987 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6311cf-15a6-4e52-8dd8-6ca77827cc98 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:23.849010 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-91188855-9c0b-4136-a043-6e8a62263d03 None None] MFA Rules not processed for user `747bfd94669c4556a42db5736ba8d93d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:23.851754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-91188855-9c0b-4136-a043-6e8a62263d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:23.973045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:23.985926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92f275-4595-4ebe-a2c0-246f3d84c1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:23.987441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92f275-4595-4ebe-a2c0-246f3d84c1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:23.987743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92f275-4595-4ebe-a2c0-246f3d84c1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:23.988028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92f275-4595-4ebe-a2c0-246f3d84c1f5 admin admin] PATH_INFO: `/v3/projects/105467e1ea6242b0ac2ecd61c60a6547/users/7e843a55a15f4c61a41a52e3c4776f00/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:24.014268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92f275-4595-4ebe-a2c0-246f3d84c1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105467e1ea6242b0ac2ecd61c60a6547, user_id=7e843a55a15f4c61a41a52e3c4776f00, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:24.019181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92f275-4595-4ebe-a2c0-246f3d84c1f5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:24.048746 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 986/1947] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:24.050787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91188855-9c0b-4136-a043-6e8a62263d03 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:24.106255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:24.118505 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 962/1948] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:23 2022] PUT /identity/v3/projects/105467e1ea6242b0ac2ecd61c60a6547/users/7e843a55a15f4c61a41a52e3c4776f00/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:24.119928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92f275-4595-4ebe-a2c0-246f3d84c1f5 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:24.128934 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91188855-9c0b-4136-a043-6e8a62263d03 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:24.206018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637da53f-9c6c-4aca-a898-d12263ed4975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:24.207526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637da53f-9c6c-4aca-a898-d12263ed4975 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:24.207839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637da53f-9c6c-4aca-a898-d12263ed4975 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:24.208125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637da53f-9c6c-4aca-a898-d12263ed4975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:24.229321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92f275-4595-4ebe-a2c0-246f3d84c1f5 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:24.236136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf076aaf-37af-420d-9854-a7b8d7fb4d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:24.238016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf076aaf-37af-420d-9854-a7b8d7fb4d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:24.238513 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf076aaf-37af-420d-9854-a7b8d7fb4d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:24.239033 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf076aaf-37af-420d-9854-a7b8d7fb4d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:24.239849 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf076aaf-37af-420d-9854-a7b8d7fb4d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:24.242722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf076aaf-37af-420d-9854-a7b8d7fb4d96 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:24.301133 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637da53f-9c6c-4aca-a898-d12263ed4975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:24.303184 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637da53f-9c6c-4aca-a898-d12263ed4975 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:24.315185 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 987/1949] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:24 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:24.316682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637da53f-9c6c-4aca-a898-d12263ed4975 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:24.328819 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637da53f-9c6c-4aca-a898-d12263ed4975 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:24.339123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9fdf0-e5b7-413e-8d3e-fdf2d21ad8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:24.340374 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9fdf0-e5b7-413e-8d3e-fdf2d21ad8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:24.340907 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9fdf0-e5b7-413e-8d3e-fdf2d21ad8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:24.341191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9fdf0-e5b7-413e-8d3e-fdf2d21ad8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:24.342747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9fdf0-e5b7-413e-8d3e-fdf2d21ad8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:24.346742 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9fdf0-e5b7-413e-8d3e-fdf2d21ad8e6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:24.370520 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 988/1950] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:24.373135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9fdf0-e5b7-413e-8d3e-fdf2d21ad8e6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:24.397118 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 963/1951] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:24 2022] POST /identity/v3/projects => generated 377 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:24.401850 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf076aaf-37af-420d-9854-a7b8d7fb4d96 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:24.405342 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9fdf0-e5b7-413e-8d3e-fdf2d21ad8e6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:24.488938 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4fc86-cb12-44ba-82ed-306aa30a056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:24.490061 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4fc86-cb12-44ba-82ed-306aa30a056d admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:24.490503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4fc86-cb12-44ba-82ed-306aa30a056d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:24.491076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4fc86-cb12-44ba-82ed-306aa30a056d admin admin] PATH_INFO: `/v3/projects/105467e1ea6242b0ac2ecd61c60a6547/users/7e843a55a15f4c61a41a52e3c4776f00/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:24.493162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4fc86-cb12-44ba-82ed-306aa30a056d admin admin] RBAC: Authorizing `identity:create_grant(project_id=105467e1ea6242b0ac2ecd61c60a6547, user_id=7e843a55a15f4c61a41a52e3c4776f00, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:24.496747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4fc86-cb12-44ba-82ed-306aa30a056d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:24.514014 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 989/1952] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:24 2022] PUT /identity/v3/projects/105467e1ea6242b0ac2ecd61c60a6547/users/7e843a55a15f4c61a41a52e3c4776f00/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:24.522852 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916f8f8-6aab-4f41-b4a1-b5ee4a44b94e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:24.523403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916f8f8-6aab-4f41-b4a1-b5ee4a44b94e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:24.523688 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916f8f8-6aab-4f41-b4a1-b5ee4a44b94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:24.543263 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf076aaf-37af-420d-9854-a7b8d7fb4d96 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:24.557345 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5916f8f8-6aab-4f41-b4a1-b5ee4a44b94e None None] MFA Rules not processed for user `7e843a55a15f4c61a41a52e3c4776f00`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:24.559330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5916f8f8-6aab-4f41-b4a1-b5ee4a44b94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:24.643681 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8038d4-9b03-4653-a8fb-eef237be755e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:24.644473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8038d4-9b03-4653-a8fb-eef237be755e admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:24.644807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8038d4-9b03-4653-a8fb-eef237be755e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:24.645168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8038d4-9b03-4653-a8fb-eef237be755e admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:24.645897 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8038d4-9b03-4653-a8fb-eef237be755e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:24.648793 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8038d4-9b03-4653-a8fb-eef237be755e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:24.662057 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 990/1953] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:41:24.720645 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916f8f8-6aab-4f41-b4a1-b5ee4a44b94e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:24.757353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 964/1954] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:24 2022] POST /identity/v3/users => generated 295 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:24.758561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8038d4-9b03-4653-a8fb-eef237be755e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:24.772805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8038d4-9b03-4653-a8fb-eef237be755e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:24.779126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f2ce5-c453-462c-88d8-289dbb0f4e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:24.788361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f2ce5-c453-462c-88d8-289dbb0f4e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:24.788361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f2ce5-c453-462c-88d8-289dbb0f4e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:24.788361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f2ce5-c453-462c-88d8-289dbb0f4e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:24.788361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f2ce5-c453-462c-88d8-289dbb0f4e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:24.788361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f2ce5-c453-462c-88d8-289dbb0f4e87 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:24.801094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 965/1955] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:24.803189 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f2ce5-c453-462c-88d8-289dbb0f4e87 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:24.811725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916f8f8-6aab-4f41-b4a1-b5ee4a44b94e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:24.822016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f96d8-27cb-401c-ab0f-fe114531cf6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:24.823554 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f96d8-27cb-401c-ab0f-fe114531cf6a service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:24.823918 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f96d8-27cb-401c-ab0f-fe114531cf6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:24.824344 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f96d8-27cb-401c-ab0f-fe114531cf6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:24.825266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f2ce5-c453-462c-88d8-289dbb0f4e87 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:24.835122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe377c-0bb9-4adc-86a6-3496b0e86a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:24.837091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe377c-0bb9-4adc-86a6-3496b0e86a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:24.838068 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe377c-0bb9-4adc-86a6-3496b0e86a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:24.838418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe377c-0bb9-4adc-86a6-3496b0e86a0d admin admin] PATH_INFO: `/v3/projects/2675ba5686864c6fb604822f7e00d630/users/b4115f4ed2cb481590359f1690f8ef14/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:24.839248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f96d8-27cb-401c-ab0f-fe114531cf6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:24.841411 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f96d8-27cb-401c-ab0f-fe114531cf6a service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:24.856468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 991/1956] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:24.899981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe377c-0bb9-4adc-86a6-3496b0e86a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2675ba5686864c6fb604822f7e00d630, user_id=b4115f4ed2cb481590359f1690f8ef14, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:24.904655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe377c-0bb9-4adc-86a6-3496b0e86a0d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:25.012164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 966/1957] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:24 2022] PUT /identity/v3/projects/2675ba5686864c6fb604822f7e00d630/users/b4115f4ed2cb481590359f1690f8ef14/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:25.013507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f96d8-27cb-401c-ab0f-fe114531cf6a service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:25.036423 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f96d8-27cb-401c-ab0f-fe114531cf6a service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:25.209755 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9369c-3dc0-4613-9a39-95323a0b777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:25.209755 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9369c-3dc0-4613-9a39-95323a0b777f admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:25.209755 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9369c-3dc0-4613-9a39-95323a0b777f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:25.209755 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9369c-3dc0-4613-9a39-95323a0b777f admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:25.210301 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9369c-3dc0-4613-9a39-95323a0b777f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:25.210301 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9369c-3dc0-4613-9a39-95323a0b777f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:25.221763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 992/1958] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:25.227989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe377c-0bb9-4adc-86a6-3496b0e86a0d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:25.248489 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe377c-0bb9-4adc-86a6-3496b0e86a0d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:25.256554 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea7cba-7bff-4360-b7fa-481df0dd3fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:25.258472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea7cba-7bff-4360-b7fa-481df0dd3fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:25.259115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea7cba-7bff-4360-b7fa-481df0dd3fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:25.259602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea7cba-7bff-4360-b7fa-481df0dd3fa0 admin admin] PATH_INFO: `/v3/projects/2675ba5686864c6fb604822f7e00d630/users/b4115f4ed2cb481590359f1690f8ef14/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:25.263437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea7cba-7bff-4360-b7fa-481df0dd3fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2675ba5686864c6fb604822f7e00d630, user_id=b4115f4ed2cb481590359f1690f8ef14, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:25.269358 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea7cba-7bff-4360-b7fa-481df0dd3fa0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:25.298525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 967/1959] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:25 2022] PUT /identity/v3/projects/2675ba5686864c6fb604822f7e00d630/users/b4115f4ed2cb481590359f1690f8ef14/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:25.310403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8473741-5ea9-4a71-82e7-9c0286d0623f None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:25.311327 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8473741-5ea9-4a71-82e7-9c0286d0623f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:25.317248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8473741-5ea9-4a71-82e7-9c0286d0623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:25.381160 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a8473741-5ea9-4a71-82e7-9c0286d0623f None None] MFA Rules not processed for user `b4115f4ed2cb481590359f1690f8ef14`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:25.382485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a8473741-5ea9-4a71-82e7-9c0286d0623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:25.461108 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 993/1960] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:25.514522 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea7cba-7bff-4360-b7fa-481df0dd3fa0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:25.533060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:25.598652 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea7cba-7bff-4360-b7fa-481df0dd3fa0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:25.601969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35294b-f08c-4610-970b-d47f11ef023f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:25.603121 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35294b-f08c-4610-970b-d47f11ef023f service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:25.603610 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35294b-f08c-4610-970b-d47f11ef023f service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:25.604111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35294b-f08c-4610-970b-d47f11ef023f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:25.625567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:25.693380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35294b-f08c-4610-970b-d47f11ef023f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:25.696021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35294b-f08c-4610-970b-d47f11ef023f service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:25.708601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 968/1961] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:26.220107 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20935969-deb8-4857-b405-683e224a7a1d None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:26.220391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20935969-deb8-4857-b405-683e224a7a1d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:26.221139 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20935969-deb8-4857-b405-683e224a7a1d None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:26.223020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 994/1962] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 18 10:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:41:26.235739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b26d-21b8-41e7-8f96-dae741d6da70 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:26.235739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b26d-21b8-41e7-8f96-dae741d6da70 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:26.235739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b26d-21b8-41e7-8f96-dae741d6da70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:26.254195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-89f2b26d-21b8-41e7-8f96-dae741d6da70 None None] MFA Rules not processed for user `f7abf6b71ac3454ca547a750cef9220a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:26.255452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-89f2b26d-21b8-41e7-8f96-dae741d6da70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:26.349623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 969/1963] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 18 10:41:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:26.363846 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20935969-deb8-4857-b405-683e224a7a1d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:26.366063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-20935969-deb8-4857-b405-683e224a7a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:26.388134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20935969-deb8-4857-b405-683e224a7a1d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:26.401769 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc5fb2-8151-477a-86f5-aee5cfd8d7d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:26.402773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc5fb2-8151-477a-86f5-aee5cfd8d7d6 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:26.403376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc5fb2-8151-477a-86f5-aee5cfd8d7d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:26.403663 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc5fb2-8151-477a-86f5-aee5cfd8d7d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:26.416669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc5fb2-8151-477a-86f5-aee5cfd8d7d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:26.419457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc5fb2-8151-477a-86f5-aee5cfd8d7d6 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:26.438450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 995/1964] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:27.527889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:27.533866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b26d-21b8-41e7-8f96-dae741d6da70 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:27.545820 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b26d-21b8-41e7-8f96-dae741d6da70 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:27.550147 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c92ef4-2319-4d5a-9439-711a89c75855 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:27.550807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c92ef4-2319-4d5a-9439-711a89c75855 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:27.551254 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c92ef4-2319-4d5a-9439-711a89c75855 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:27.551804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c92ef4-2319-4d5a-9439-711a89c75855 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:27.627349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c92ef4-2319-4d5a-9439-711a89c75855 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:27.629103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c92ef4-2319-4d5a-9439-711a89c75855 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:27.638949 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 970/1965] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:28.184222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:28.517227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc5fb2-8151-477a-86f5-aee5cfd8d7d6 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:28.536055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc5fb2-8151-477a-86f5-aee5cfd8d7d6 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:28.540060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9e5a-d1c9-49ad-ba34-01be8baf36e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:28.541041 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9e5a-d1c9-49ad-ba34-01be8baf36e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:28.542069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9e5a-d1c9-49ad-ba34-01be8baf36e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:28.542676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9e5a-d1c9-49ad-ba34-01be8baf36e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:28.678840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee9e5a-d1c9-49ad-ba34-01be8baf36e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:28.680725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee9e5a-d1c9-49ad-ba34-01be8baf36e7 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:28.693190 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 996/1966] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:28.832583 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c92ef4-2319-4d5a-9439-711a89c75855 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:28.842313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c92ef4-2319-4d5a-9439-711a89c75855 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:28.847332 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efa2c1-e10c-4067-ad25-42d924e641a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:28.848011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efa2c1-e10c-4067-ad25-42d924e641a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:28.848295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efa2c1-e10c-4067-ad25-42d924e641a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:28.848576 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efa2c1-e10c-4067-ad25-42d924e641a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:28.964013 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efa2c1-e10c-4067-ad25-42d924e641a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:28.966063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efa2c1-e10c-4067-ad25-42d924e641a7 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:28.978963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 971/1967] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:29.967007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:30.677384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:30.894494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9e5a-d1c9-49ad-ba34-01be8baf36e7 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:31.050045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9e5a-d1c9-49ad-ba34-01be8baf36e7 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:31.056891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929e282-36e0-4a31-9645-36e43c93caf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:31.058152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929e282-36e0-4a31-9645-36e43c93caf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:31.058600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929e282-36e0-4a31-9645-36e43c93caf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:31.059977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929e282-36e0-4a31-9645-36e43c93caf3 admin admin] PATH_INFO: `/v3/users/eef3811579114df494e5d3d914709e2f` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:31.060637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929e282-36e0-4a31-9645-36e43c93caf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef3811579114df494e5d3d914709e2f)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:31.067769 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929e282-36e0-4a31-9645-36e43c93caf3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:31.328362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9929e282-36e0-4a31-9645-36e43c93caf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef3811579114df494e5d3d914709e2f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:31.356356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efa2c1-e10c-4067-ad25-42d924e641a7 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:31.367544 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efa2c1-e10c-4067-ad25-42d924e641a7 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:31.371973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf9f24-6ba1-41b0-82fe-fc73b216bcc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:31.372810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf9f24-6ba1-41b0-82fe-fc73b216bcc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:31.373158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf9f24-6ba1-41b0-82fe-fc73b216bcc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:31.373598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf9f24-6ba1-41b0-82fe-fc73b216bcc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:31.395846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf9f24-6ba1-41b0-82fe-fc73b216bcc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:31.395846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf9f24-6ba1-41b0-82fe-fc73b216bcc2 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:31.404105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 972/1968] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:41:31.447651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9929e282-36e0-4a31-9645-36e43c93caf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef3811579114df494e5d3d914709e2f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:31.460609 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9929e282-36e0-4a31-9645-36e43c93caf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef3811579114df494e5d3d914709e2f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:31.461465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9929e282-36e0-4a31-9645-36e43c93caf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef3811579114df494e5d3d914709e2f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:31.482418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf9f24-6ba1-41b0-82fe-fc73b216bcc2 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:31.496692 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9929e282-36e0-4a31-9645-36e43c93caf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef3811579114df494e5d3d914709e2f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:31.507022 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf9f24-6ba1-41b0-82fe-fc73b216bcc2 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:31.508438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 997/1969] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:30 2022] DELETE /identity/v3/users/eef3811579114df494e5d3d914709e2f => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:31.513984 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9251391-c1d6-465f-8ff9-311f7a3d682b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:31.514286 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9251391-c1d6-465f-8ff9-311f7a3d682b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:31.514592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9251391-c1d6-465f-8ff9-311f7a3d682b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:31.536666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c9251391-c1d6-465f-8ff9-311f7a3d682b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:31.545966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c9251391-c1d6-465f-8ff9-311f7a3d682b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:31.652516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da70ec4-44c9-4796-85a0-73795702c6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:31.652516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da70ec4-44c9-4796-85a0-73795702c6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:31.652516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da70ec4-44c9-4796-85a0-73795702c6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:31.652516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da70ec4-44c9-4796-85a0-73795702c6aa admin admin] PATH_INFO: `/v3/users/476c6caf78914745869bbe2e9a28fba0` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:31.654259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da70ec4-44c9-4796-85a0-73795702c6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=476c6caf78914745869bbe2e9a28fba0)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:31.656660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da70ec4-44c9-4796-85a0-73795702c6aa admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:31.686246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 998/1970] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:31.702447 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9251391-c1d6-465f-8ff9-311f7a3d682b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:31.706614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c9251391-c1d6-465f-8ff9-311f7a3d682b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:31.878290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9251391-c1d6-465f-8ff9-311f7a3d682b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:31.883550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beaee56-6cff-4e83-83f0-667956364882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:31.884719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beaee56-6cff-4e83-83f0-667956364882 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:31.885231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beaee56-6cff-4e83-83f0-667956364882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:31.885689 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beaee56-6cff-4e83-83f0-667956364882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:31.899582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beaee56-6cff-4e83-83f0-667956364882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:31.901892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beaee56-6cff-4e83-83f0-667956364882 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:31.924327 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 999/1971] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:32.019158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8da70ec4-44c9-4796-85a0-73795702c6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476c6caf78914745869bbe2e9a28fba0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:32.077740 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:32.104833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8da70ec4-44c9-4796-85a0-73795702c6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476c6caf78914745869bbe2e9a28fba0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:32.121147 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8da70ec4-44c9-4796-85a0-73795702c6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476c6caf78914745869bbe2e9a28fba0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:32.123782 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8da70ec4-44c9-4796-85a0-73795702c6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476c6caf78914745869bbe2e9a28fba0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:32.146707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:32.168548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8da70ec4-44c9-4796-85a0-73795702c6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476c6caf78914745869bbe2e9a28fba0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:32.180584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 973/1972] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:31 2022] DELETE /identity/v3/users/476c6caf78914745869bbe2e9a28fba0 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:32.186504 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313b82d-51e6-4204-b3be-2a833981b4a6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:32.186904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313b82d-51e6-4204-b3be-2a833981b4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:32.187352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313b82d-51e6-4204-b3be-2a833981b4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:32.228409 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c313b82d-51e6-4204-b3be-2a833981b4a6 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:32.230279 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c313b82d-51e6-4204-b3be-2a833981b4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:32.365412 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1000/1973] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:32.387899 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da70ec4-44c9-4796-85a0-73795702c6aa admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:32.390255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8da70ec4-44c9-4796-85a0-73795702c6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:32.540919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da70ec4-44c9-4796-85a0-73795702c6aa admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:32.547367 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe79b6b-66e3-4c2d-a4c8-fc500037da08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:32.548456 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe79b6b-66e3-4c2d-a4c8-fc500037da08 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:32.549154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe79b6b-66e3-4c2d-a4c8-fc500037da08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:32.549881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe79b6b-66e3-4c2d-a4c8-fc500037da08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:32.567598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe79b6b-66e3-4c2d-a4c8-fc500037da08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:32.571684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe79b6b-66e3-4c2d-a4c8-fc500037da08 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:32.608744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 974/1974] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:41:33.131830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313b82d-51e6-4204-b3be-2a833981b4a6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:33.135609 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c313b82d-51e6-4204-b3be-2a833981b4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:33.165214 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313b82d-51e6-4204-b3be-2a833981b4a6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:33.176981 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60cb42-6dce-433b-83b0-6e2bcc646024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:33.179268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60cb42-6dce-433b-83b0-6e2bcc646024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:33.180322 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60cb42-6dce-433b-83b0-6e2bcc646024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:33.181010 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60cb42-6dce-433b-83b0-6e2bcc646024 admin admin] PATH_INFO: `/v3/projects/7c68da02104a4818a37a8c0a36e1f691` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:33.184583 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60cb42-6dce-433b-83b0-6e2bcc646024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c68da02104a4818a37a8c0a36e1f691)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:33.188829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60cb42-6dce-433b-83b0-6e2bcc646024 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:33.439794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1e60cb42-6dce-433b-83b0-6e2bcc646024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c68da02104a4818a37a8c0a36e1f691', 'request_id': 'req-1e60cb42-6dce-433b-83b0-6e2bcc646024'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:33.456641 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1e60cb42-6dce-433b-83b0-6e2bcc646024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c68da02104a4818a37a8c0a36e1f691', 'request_id': 'req-1e60cb42-6dce-433b-83b0-6e2bcc646024'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:33.471174 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1e60cb42-6dce-433b-83b0-6e2bcc646024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c68da02104a4818a37a8c0a36e1f691', 'request_id': 'req-1e60cb42-6dce-433b-83b0-6e2bcc646024'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:33.596630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1e60cb42-6dce-433b-83b0-6e2bcc646024 admin admin] The token cache is being invalidate because project 7c68da02104a4818a37a8c0a36e1f691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:33.597288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1e60cb42-6dce-433b-83b0-6e2bcc646024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:33.598549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1e60cb42-6dce-433b-83b0-6e2bcc646024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:33.607571 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1001/1975] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:33 2022] DELETE /identity/v3/projects/7c68da02104a4818a37a8c0a36e1f691 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:33.609845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe79b6b-66e3-4c2d-a4c8-fc500037da08 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:33.636560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe79b6b-66e3-4c2d-a4c8-fc500037da08 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:33.648470 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:33.819499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d595e0c-d8df-42e5-b145-b86f8cef7cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:33.822161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d595e0c-d8df-42e5-b145-b86f8cef7cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:33.822782 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d595e0c-d8df-42e5-b145-b86f8cef7cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:33.823466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d595e0c-d8df-42e5-b145-b86f8cef7cf8 admin admin] PATH_INFO: `/v3/users/7c0fe2aeda2d47e2bd0f0798ab032535` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:33.826267 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d595e0c-d8df-42e5-b145-b86f8cef7cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0fe2aeda2d47e2bd0f0798ab032535)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:33.843635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d595e0c-d8df-42e5-b145-b86f8cef7cf8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:34.129866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4d595e0c-d8df-42e5-b145-b86f8cef7cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0fe2aeda2d47e2bd0f0798ab032535'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:34.259236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:34.327581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4d595e0c-d8df-42e5-b145-b86f8cef7cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0fe2aeda2d47e2bd0f0798ab032535'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:34.351956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4d595e0c-d8df-42e5-b145-b86f8cef7cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0fe2aeda2d47e2bd0f0798ab032535'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:34.353290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4d595e0c-d8df-42e5-b145-b86f8cef7cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0fe2aeda2d47e2bd0f0798ab032535'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:34.386519 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4d595e0c-d8df-42e5-b145-b86f8cef7cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0fe2aeda2d47e2bd0f0798ab032535'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:34.416431 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 975/1976] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:33 2022] DELETE /identity/v3/users/7c0fe2aeda2d47e2bd0f0798ab032535 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:34.832795 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60cb42-6dce-433b-83b0-6e2bcc646024 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:34.834707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1e60cb42-6dce-433b-83b0-6e2bcc646024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:34.858294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60cb42-6dce-433b-83b0-6e2bcc646024 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:35.067868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:35.069158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:35.069892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:35.070748 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f admin admin] PATH_INFO: `/v3/projects/df86145b25454d319f775ac136bf2710` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:35.076066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f admin admin] RBAC: Authorizing `identity:delete_project(project_id=df86145b25454d319f775ac136bf2710)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:35.085231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:35.313215 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df86145b25454d319f775ac136bf2710', 'request_id': 'req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:35.320889 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df86145b25454d319f775ac136bf2710', 'request_id': 'req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:35.329051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df86145b25454d319f775ac136bf2710', 'request_id': 'req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:35.369447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d595e0c-d8df-42e5-b145-b86f8cef7cf8 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:35.372195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4d595e0c-d8df-42e5-b145-b86f8cef7cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:35.404490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d595e0c-d8df-42e5-b145-b86f8cef7cf8 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:35.494077 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f admin admin] The token cache is being invalidate because project df86145b25454d319f775ac136bf2710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:35.494627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:35.498934 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:35.506825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1002/1977] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:34 2022] DELETE /identity/v3/projects/df86145b25454d319f775ac136bf2710 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:35.511441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:35.515727 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:35.530766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196f399-deb8-4e1f-af43-0b5f0cd23933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:35.533722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196f399-deb8-4e1f-af43-0b5f0cd23933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:35.534275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196f399-deb8-4e1f-af43-0b5f0cd23933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:35.540223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196f399-deb8-4e1f-af43-0b5f0cd23933 admin admin] PATH_INFO: `/v3/projects/fc51aee0bd2f4597b1aaf0466ae379f9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:35.542555 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196f399-deb8-4e1f-af43-0b5f0cd23933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc51aee0bd2f4597b1aaf0466ae379f9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:35.549914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196f399-deb8-4e1f-af43-0b5f0cd23933 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:35.663025 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f74dd-cb97-488f-a1a9-3d1659e1400f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:35.671180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9804658-2bc7-4c45-af6f-53372f36edfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:35.672376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9804658-2bc7-4c45-af6f-53372f36edfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:35.672782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9804658-2bc7-4c45-af6f-53372f36edfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:35.678743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9804658-2bc7-4c45-af6f-53372f36edfe admin admin] PATH_INFO: `/v3/users/1943ae0e67864cc69a998fb58f5bdc46` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:35.679452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9804658-2bc7-4c45-af6f-53372f36edfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1943ae0e67864cc69a998fb58f5bdc46)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:35.681679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9804658-2bc7-4c45-af6f-53372f36edfe admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:35.839551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f196f399-deb8-4e1f-af43-0b5f0cd23933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc51aee0bd2f4597b1aaf0466ae379f9', 'request_id': 'req-f196f399-deb8-4e1f-af43-0b5f0cd23933'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:35.851829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f196f399-deb8-4e1f-af43-0b5f0cd23933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc51aee0bd2f4597b1aaf0466ae379f9', 'request_id': 'req-f196f399-deb8-4e1f-af43-0b5f0cd23933'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:35.863448 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f196f399-deb8-4e1f-af43-0b5f0cd23933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc51aee0bd2f4597b1aaf0466ae379f9', 'request_id': 'req-f196f399-deb8-4e1f-af43-0b5f0cd23933'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:35.947798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f196f399-deb8-4e1f-af43-0b5f0cd23933 admin admin] The token cache is being invalidate because project fc51aee0bd2f4597b1aaf0466ae379f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:35.948672 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f196f399-deb8-4e1f-af43-0b5f0cd23933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:35.960370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f196f399-deb8-4e1f-af43-0b5f0cd23933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:35.960370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 976/1978] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:35 2022] DELETE /identity/v3/projects/fc51aee0bd2f4597b1aaf0466ae379f9 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:35.965730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196f399-deb8-4e1f-af43-0b5f0cd23933 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:35.965730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f196f399-deb8-4e1f-af43-0b5f0cd23933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:35.999792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e9804658-2bc7-4c45-af6f-53372f36edfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1943ae0e67864cc69a998fb58f5bdc46'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:36.059260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196f399-deb8-4e1f-af43-0b5f0cd23933 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:36.071660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df79e5c-31ca-428d-8f5e-b87ead3cf873 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:36.072735 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df79e5c-31ca-428d-8f5e-b87ead3cf873 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:36.073421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df79e5c-31ca-428d-8f5e-b87ead3cf873 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:36.073967 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df79e5c-31ca-428d-8f5e-b87ead3cf873 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:36.077570 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3df79e5c-31ca-428d-8f5e-b87ead3cf873 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:36.091233 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e9804658-2bc7-4c45-af6f-53372f36edfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1943ae0e67864cc69a998fb58f5bdc46'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:36.102633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e9804658-2bc7-4c45-af6f-53372f36edfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1943ae0e67864cc69a998fb58f5bdc46'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:36.104399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e9804658-2bc7-4c45-af6f-53372f36edfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1943ae0e67864cc69a998fb58f5bdc46'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:36.139873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e9804658-2bc7-4c45-af6f-53372f36edfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1943ae0e67864cc69a998fb58f5bdc46'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:36.149094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1003/1979] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:35 2022] DELETE /identity/v3/users/1943ae0e67864cc69a998fb58f5bdc46 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:36.151626 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32728c39-4fb0-4c9f-9146-01749d7d7b9b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:36.166166 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32728c39-4fb0-4c9f-9146-01749d7d7b9b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:36.167322 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32728c39-4fb0-4c9f-9146-01749d7d7b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:36.225209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df79e5c-31ca-428d-8f5e-b87ead3cf873 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:36.230155 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df79e5c-31ca-428d-8f5e-b87ead3cf873 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:36.242779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-32728c39-4fb0-4c9f-9146-01749d7d7b9b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:36.249773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-32728c39-4fb0-4c9f-9146-01749d7d7b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:36.261209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 977/1980] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:36.369355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:36.438167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1004/1981] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:36.439556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f00a7f-bd0d-46c3-9e97-70125c034bfe None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:36.439556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f00a7f-bd0d-46c3-9e97-70125c034bfe None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:36.440184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f00a7f-bd0d-46c3-9e97-70125c034bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:36.487460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a4f00a7f-bd0d-46c3-9e97-70125c034bfe None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:36.494168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a4f00a7f-bd0d-46c3-9e97-70125c034bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:36.513928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 978/1982] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:36.521134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32728c39-4fb0-4c9f-9146-01749d7d7b9b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:36.563265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32728c39-4fb0-4c9f-9146-01749d7d7b9b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:36.583978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f2cc1-1eed-4f29-8e19-04a40da3be81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:36.585224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f2cc1-1eed-4f29-8e19-04a40da3be81 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:36.585784 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f2cc1-1eed-4f29-8e19-04a40da3be81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:36.586313 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f2cc1-1eed-4f29-8e19-04a40da3be81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:36.587362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f2cc1-1eed-4f29-8e19-04a40da3be81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:36.587795 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f2cc1-1eed-4f29-8e19-04a40da3be81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:36.590134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f2cc1-1eed-4f29-8e19-04a40da3be81 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:36.621195 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1005/1983] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:36.622031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f00a7f-bd0d-46c3-9e97-70125c034bfe None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:36.640393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f00a7f-bd0d-46c3-9e97-70125c034bfe None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:36.650686 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f926862-9f69-432e-bdba-0d3d54e0af67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:36.652184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f926862-9f69-432e-bdba-0d3d54e0af67 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:36.653014 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f926862-9f69-432e-bdba-0d3d54e0af67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:36.653829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f926862-9f69-432e-bdba-0d3d54e0af67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:36.655402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f926862-9f69-432e-bdba-0d3d54e0af67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:36.658402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f926862-9f69-432e-bdba-0d3d54e0af67 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:36.824980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f2cc1-1eed-4f29-8e19-04a40da3be81 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:36.833432 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 979/1984] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:36 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:41:36.864841 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f2cc1-1eed-4f29-8e19-04a40da3be81 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:37.046012 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a81e7-97c7-4b9b-97e9-d6f40ed319c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:37.050957 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a81e7-97c7-4b9b-97e9-d6f40ed319c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:37.054583 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a81e7-97c7-4b9b-97e9-d6f40ed319c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:37.055429 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a81e7-97c7-4b9b-97e9-d6f40ed319c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:37.057502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a81e7-97c7-4b9b-97e9-d6f40ed319c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:37.062977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a81e7-97c7-4b9b-97e9-d6f40ed319c4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:37.324795 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1006/1985] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:36 2022] POST /identity/v3/users => generated 291 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:41:37.327043 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f926862-9f69-432e-bdba-0d3d54e0af67 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:37.346910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f926862-9f69-432e-bdba-0d3d54e0af67 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:37.354479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57ed38-24ab-49e6-b054-22215f405395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:37.355446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ed38-24ab-49e6-b054-22215f405395 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:37.355815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ed38-24ab-49e6-b054-22215f405395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:37.356184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ed38-24ab-49e6-b054-22215f405395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:37.357078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57ed38-24ab-49e6-b054-22215f405395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:37.359021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57ed38-24ab-49e6-b054-22215f405395 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:37.374511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 980/1986] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:37.380460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a81e7-97c7-4b9b-97e9-d6f40ed319c4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:37.405279 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a81e7-97c7-4b9b-97e9-d6f40ed319c4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:37.406471 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57ed38-24ab-49e6-b054-22215f405395 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:37.411559 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9337db-af15-4c6c-a244-92a8d2518a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:37.413068 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9337db-af15-4c6c-a244-92a8d2518a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:37.413353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9337db-af15-4c6c-a244-92a8d2518a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:37.413647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9337db-af15-4c6c-a244-92a8d2518a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:37.414569 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9337db-af15-4c6c-a244-92a8d2518a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:37.416602 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9337db-af15-4c6c-a244-92a8d2518a64 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:37.418951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0d57ed38-24ab-49e6-b054-22215f405395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:37.463271 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1007/1987] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:37.470680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57ed38-24ab-49e6-b054-22215f405395 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:37.471428 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9337db-af15-4c6c-a244-92a8d2518a64 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:37.483937 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c411b54-b447-428e-945f-0897704a4034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:37.491463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c411b54-b447-428e-945f-0897704a4034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:37.494461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c411b54-b447-428e-945f-0897704a4034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:37.494461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c411b54-b447-428e-945f-0897704a4034 admin admin] PATH_INFO: `/v3/projects/8659fa91b5ef4ef295aaa7a5872ccbc9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:37.494461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c411b54-b447-428e-945f-0897704a4034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8659fa91b5ef4ef295aaa7a5872ccbc9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:37.496704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c411b54-b447-428e-945f-0897704a4034 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:37.514730 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9337db-af15-4c6c-a244-92a8d2518a64 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:37.524636 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef987d-c774-4ae5-a99c-ae77c73468b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:37.526437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef987d-c774-4ae5-a99c-ae77c73468b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:37.527010 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef987d-c774-4ae5-a99c-ae77c73468b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:37.527525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef987d-c774-4ae5-a99c-ae77c73468b0 admin admin] PATH_INFO: `/v3/projects/e8973db5eb8245b693a86f15d2230856/users/491851670e3247f8848c2a53516c6e45/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:37.561734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef987d-c774-4ae5-a99c-ae77c73468b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8973db5eb8245b693a86f15d2230856, user_id=491851670e3247f8848c2a53516c6e45, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:37.574785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef987d-c774-4ae5-a99c-ae77c73468b0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:37.689362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:37.711980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1008/1988] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:37 2022] PUT /identity/v3/projects/e8973db5eb8245b693a86f15d2230856/users/491851670e3247f8848c2a53516c6e45/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:37.713817 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef987d-c774-4ae5-a99c-ae77c73468b0 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:37.717129 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8aef987d-c774-4ae5-a99c-ae77c73468b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:37.761480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3c411b54-b447-428e-945f-0897704a4034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8659fa91b5ef4ef295aaa7a5872ccbc9', 'request_id': 'req-3c411b54-b447-428e-945f-0897704a4034'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:37.776780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3c411b54-b447-428e-945f-0897704a4034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8659fa91b5ef4ef295aaa7a5872ccbc9', 'request_id': 'req-3c411b54-b447-428e-945f-0897704a4034'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:37.790588 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3c411b54-b447-428e-945f-0897704a4034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8659fa91b5ef4ef295aaa7a5872ccbc9', 'request_id': 'req-3c411b54-b447-428e-945f-0897704a4034'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:37.840126 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef987d-c774-4ae5-a99c-ae77c73468b0 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:37.883592 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3c411b54-b447-428e-945f-0897704a4034 admin admin] The token cache is being invalidate because project 8659fa91b5ef4ef295aaa7a5872ccbc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:37.884459 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3c411b54-b447-428e-945f-0897704a4034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:37.886102 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3c411b54-b447-428e-945f-0897704a4034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:37.888260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 981/1989] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:37 2022] DELETE /identity/v3/projects/8659fa91b5ef4ef295aaa7a5872ccbc9 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:37.890362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c6ed7-0c13-49ef-976a-72867163791a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:37.891162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c6ed7-0c13-49ef-976a-72867163791a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:37.891748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c6ed7-0c13-49ef-976a-72867163791a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:37.942618 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-872c6ed7-0c13-49ef-976a-72867163791a None None] MFA Rules not processed for user `491851670e3247f8848c2a53516c6e45`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:37.944319 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-872c6ed7-0c13-49ef-976a-72867163791a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:37.959865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ab191-cd51-44c7-9b77-dfd1e224dd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:37.962017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ab191-cd51-44c7-9b77-dfd1e224dd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:37.962017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ab191-cd51-44c7-9b77-dfd1e224dd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:37.962017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ab191-cd51-44c7-9b77-dfd1e224dd40 admin admin] PATH_INFO: `/v3/users/460fc330cd7246748f88dae502336e1c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:37.963613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ab191-cd51-44c7-9b77-dfd1e224dd40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=460fc330cd7246748f88dae502336e1c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:37.966778 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ab191-cd51-44c7-9b77-dfd1e224dd40 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:38.059216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 982/1990] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:38.062852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338c35e-40cd-4a27-b54f-6a60e96533fc None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:38.064235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338c35e-40cd-4a27-b54f-6a60e96533fc None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:38.066702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338c35e-40cd-4a27-b54f-6a60e96533fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:38.093087 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1338c35e-40cd-4a27-b54f-6a60e96533fc None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:38.094235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1338c35e-40cd-4a27-b54f-6a60e96533fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:38.103822 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 983/1991] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:38.104858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338c35e-40cd-4a27-b54f-6a60e96533fc None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:38.109866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1338c35e-40cd-4a27-b54f-6a60e96533fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:38.123610 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338c35e-40cd-4a27-b54f-6a60e96533fc None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:38.133290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848ec8b-4aa2-447f-8912-9d42a217921f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:38.136696 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848ec8b-4aa2-447f-8912-9d42a217921f admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:38.136696 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848ec8b-4aa2-447f-8912-9d42a217921f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:38.136696 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848ec8b-4aa2-447f-8912-9d42a217921f admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:38.137333 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848ec8b-4aa2-447f-8912-9d42a217921f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:38.141386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848ec8b-4aa2-447f-8912-9d42a217921f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:38.316191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7a7ab191-cd51-44c7-9b77-dfd1e224dd40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460fc330cd7246748f88dae502336e1c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:38.360826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 984/1992] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:38 2022] POST /identity/v3/projects => generated 383 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:38.363376 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea522e19-022c-4260-8490-4cfce3f2f4a3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:38.363867 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea522e19-022c-4260-8490-4cfce3f2f4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:38.364328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea522e19-022c-4260-8490-4cfce3f2f4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:38.388967 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ea522e19-022c-4260-8490-4cfce3f2f4a3 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:38.390233 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ea522e19-022c-4260-8490-4cfce3f2f4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:38.430571 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7a7ab191-cd51-44c7-9b77-dfd1e224dd40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460fc330cd7246748f88dae502336e1c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:38.441533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7a7ab191-cd51-44c7-9b77-dfd1e224dd40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460fc330cd7246748f88dae502336e1c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:38.442437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7a7ab191-cd51-44c7-9b77-dfd1e224dd40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460fc330cd7246748f88dae502336e1c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:38.459777 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7a7ab191-cd51-44c7-9b77-dfd1e224dd40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460fc330cd7246748f88dae502336e1c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:38.471848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1009/1993] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:37 2022] DELETE /identity/v3/users/460fc330cd7246748f88dae502336e1c => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:38.473675 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ab191-cd51-44c7-9b77-dfd1e224dd40 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:38.477127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7a7ab191-cd51-44c7-9b77-dfd1e224dd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:38.500150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 985/1994] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:38.508176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b5281-b377-46db-915b-d3c62898c2cb None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:38.508781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b5281-b377-46db-915b-d3c62898c2cb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:38.509362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b5281-b377-46db-915b-d3c62898c2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:38.534677 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2b4b5281-b377-46db-915b-d3c62898c2cb None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:38.536031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2b4b5281-b377-46db-915b-d3c62898c2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:38.626080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 986/1995] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:38.626080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b5281-b377-46db-915b-d3c62898c2cb None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:38.627016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ab191-cd51-44c7-9b77-dfd1e224dd40 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:38.634631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176c2e0-b61b-461a-be09-3dfe959dabdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:38.635762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176c2e0-b61b-461a-be09-3dfe959dabdd admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:38.636259 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176c2e0-b61b-461a-be09-3dfe959dabdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:38.636700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176c2e0-b61b-461a-be09-3dfe959dabdd admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:38.637997 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176c2e0-b61b-461a-be09-3dfe959dabdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:38.639565 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b5281-b377-46db-915b-d3c62898c2cb None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:38.642473 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176c2e0-b61b-461a-be09-3dfe959dabdd admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:38.649149 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5a966-f1c8-41eb-ae70-4e6688911cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:38.650950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5a966-f1c8-41eb-ae70-4e6688911cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:38.651980 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5a966-f1c8-41eb-ae70-4e6688911cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:38.652859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5a966-f1c8-41eb-ae70-4e6688911cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:38.655942 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5a966-f1c8-41eb-ae70-4e6688911cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:38.657712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5a966-f1c8-41eb-ae70-4e6688911cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:38.661413 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5a966-f1c8-41eb-ae70-4e6688911cb7 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:38.684706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 987/1996] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:38.686088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5a966-f1c8-41eb-ae70-4e6688911cb7 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:38.688200 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b3a5a966-f1c8-41eb-ae70-4e6688911cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:38.777575 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1010/1997] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:38 2022] POST /identity/v3/users => generated 298 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:38.783777 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176c2e0-b61b-461a-be09-3dfe959dabdd admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:38.807973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176c2e0-b61b-461a-be09-3dfe959dabdd admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:38.810861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5a966-f1c8-41eb-ae70-4e6688911cb7 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:38.816676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8b71b-0c32-46c8-af2b-62b77bb14bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:38.817702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbb488-0a03-4c3d-9e4e-f8776ea5bec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:38.818386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8b71b-0c32-46c8-af2b-62b77bb14bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:38.819051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8b71b-0c32-46c8-af2b-62b77bb14bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:38.819245 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbb488-0a03-4c3d-9e4e-f8776ea5bec9 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:38.819594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbb488-0a03-4c3d-9e4e-f8776ea5bec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:38.820071 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbb488-0a03-4c3d-9e4e-f8776ea5bec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:38.820326 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8b71b-0c32-46c8-af2b-62b77bb14bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:38.822989 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8b71b-0c32-46c8-af2b-62b77bb14bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:38.827148 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8b71b-0c32-46c8-af2b-62b77bb14bcf admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:38.837832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fbb488-0a03-4c3d-9e4e-f8776ea5bec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:38.840485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fbb488-0a03-4c3d-9e4e-f8776ea5bec9 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:38.857051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 988/1998] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:38.858535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbb488-0a03-4c3d-9e4e-f8776ea5bec9 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:38.877690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbb488-0a03-4c3d-9e4e-f8776ea5bec9 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:38.887234 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb29d8-a1cd-46da-8f82-90315aadce72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:38.889427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb29d8-a1cd-46da-8f82-90315aadce72 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:38.889427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb29d8-a1cd-46da-8f82-90315aadce72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:38.889756 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb29d8-a1cd-46da-8f82-90315aadce72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:38.891170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb29d8-a1cd-46da-8f82-90315aadce72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:38.895417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb29d8-a1cd-46da-8f82-90315aadce72 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:38.918712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 989/1999] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:38.923317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb29d8-a1cd-46da-8f82-90315aadce72 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:38.945457 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb29d8-a1cd-46da-8f82-90315aadce72 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:38.969028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5222e73-2656-4ad2-8851-b18c18b59201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:38.969028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5222e73-2656-4ad2-8851-b18c18b59201 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:38.969028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5222e73-2656-4ad2-8851-b18c18b59201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:38.969028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5222e73-2656-4ad2-8851-b18c18b59201 admin admin] PATH_INFO: `/v3/projects/62acaa2e9971447ea61e73f4b825e1b8/users/670f0483d3d84dcd87f5912c09abe7aa/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:38.971498 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1011/2000] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:38 2022] POST /identity/v3/projects => generated 391 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:38.982168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8b71b-0c32-46c8-af2b-62b77bb14bcf admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:38.998556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5222e73-2656-4ad2-8851-b18c18b59201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62acaa2e9971447ea61e73f4b825e1b8, user_id=670f0483d3d84dcd87f5912c09abe7aa, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:39.003145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5222e73-2656-4ad2-8851-b18c18b59201 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:39.121134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8b71b-0c32-46c8-af2b-62b77bb14bcf admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:39.130688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 990/2001] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:38 2022] PUT /identity/v3/projects/62acaa2e9971447ea61e73f4b825e1b8/users/670f0483d3d84dcd87f5912c09abe7aa/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:39.135619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5222e73-2656-4ad2-8851-b18c18b59201 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:39.174770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:39.239180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc84e35-86b7-44db-aae0-0bc284bc741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:39.239180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc84e35-86b7-44db-aae0-0bc284bc741e admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:39.239180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc84e35-86b7-44db-aae0-0bc284bc741e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:39.239180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc84e35-86b7-44db-aae0-0bc284bc741e admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:39.239839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc84e35-86b7-44db-aae0-0bc284bc741e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:39.240128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc84e35-86b7-44db-aae0-0bc284bc741e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:39.293480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5222e73-2656-4ad2-8851-b18c18b59201 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:39.302422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f7cbe-1947-46fb-8661-0d34b8c7900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:39.303461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f7cbe-1947-46fb-8661-0d34b8c7900b admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:39.303982 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f7cbe-1947-46fb-8661-0d34b8c7900b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:39.304538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f7cbe-1947-46fb-8661-0d34b8c7900b admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:39.306020 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f7cbe-1947-46fb-8661-0d34b8c7900b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:39.309175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f7cbe-1947-46fb-8661-0d34b8c7900b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:39.332650 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 991/2002] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:41:39.334138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f7cbe-1947-46fb-8661-0d34b8c7900b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:39.344807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f7cbe-1947-46fb-8661-0d34b8c7900b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:39.350717 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58c5b0-b145-4b77-a8a2-a125ecf86128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:39.351699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58c5b0-b145-4b77-a8a2-a125ecf86128 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:39.351987 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58c5b0-b145-4b77-a8a2-a125ecf86128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:39.352271 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58c5b0-b145-4b77-a8a2-a125ecf86128 admin admin] PATH_INFO: `/v3/projects/62acaa2e9971447ea61e73f4b825e1b8/users/670f0483d3d84dcd87f5912c09abe7aa/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:39.354516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58c5b0-b145-4b77-a8a2-a125ecf86128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62acaa2e9971447ea61e73f4b825e1b8, user_id=670f0483d3d84dcd87f5912c09abe7aa, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:39.357237 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58c5b0-b145-4b77-a8a2-a125ecf86128 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:39.366377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1012/2003] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:38 2022] POST /identity/v3/users => generated 296 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:41:39.369551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc84e35-86b7-44db-aae0-0bc284bc741e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:39.383655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 992/2004] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:39 2022] PUT /identity/v3/projects/62acaa2e9971447ea61e73f4b825e1b8/users/670f0483d3d84dcd87f5912c09abe7aa/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:39.388226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb6b5d-37f3-4e81-85c5-91d9c4a665c0 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:39.393741 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb6b5d-37f3-4e81-85c5-91d9c4a665c0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:39.393741 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb6b5d-37f3-4e81-85c5-91d9c4a665c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:39.395386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc84e35-86b7-44db-aae0-0bc284bc741e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:39.434241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2efb6b5d-37f3-4e81-85c5-91d9c4a665c0 None None] MFA Rules not processed for user `670f0483d3d84dcd87f5912c09abe7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:39.436398 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2efb6b5d-37f3-4e81-85c5-91d9c4a665c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:39.475538 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef31382-76b3-4844-bdac-82b35d20cf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:39.476256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef31382-76b3-4844-bdac-82b35d20cf4b admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:39.476494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef31382-76b3-4844-bdac-82b35d20cf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:39.476770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef31382-76b3-4844-bdac-82b35d20cf4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:39.477503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef31382-76b3-4844-bdac-82b35d20cf4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:39.479179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef31382-76b3-4844-bdac-82b35d20cf4b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:39.486485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:39.496492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1013/2005] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:39.498042 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef31382-76b3-4844-bdac-82b35d20cf4b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:39.512348 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef31382-76b3-4844-bdac-82b35d20cf4b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:39.522528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ab8ee-6381-4e28-aa2c-d20281a18881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:39.524047 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ab8ee-6381-4e28-aa2c-d20281a18881 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:39.524539 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ab8ee-6381-4e28-aa2c-d20281a18881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:39.525213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ab8ee-6381-4e28-aa2c-d20281a18881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:39.527126 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ab8ee-6381-4e28-aa2c-d20281a18881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:39.529470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ab8ee-6381-4e28-aa2c-d20281a18881 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:39.546603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1014/2006] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:39.556287 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ab8ee-6381-4e28-aa2c-d20281a18881 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:39.575976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ab8ee-6381-4e28-aa2c-d20281a18881 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:39.579936 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 993/2007] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:41:39.582475 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb6b5d-37f3-4e81-85c5-91d9c4a665c0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:39.587409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2efb6b5d-37f3-4e81-85c5-91d9c4a665c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:39.587603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0fb9a-0c44-481b-a8de-39024855f979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:39.589850 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0fb9a-0c44-481b-a8de-39024855f979 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:39.591105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0fb9a-0c44-481b-a8de-39024855f979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:39.591105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0fb9a-0c44-481b-a8de-39024855f979 admin admin] PATH_INFO: `/v3/projects/f5104ec21457452392cca9b11dc290a5/users/6f27d4e8c9924df68ef00aeb15137b81/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:39.625658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0fb9a-0c44-481b-a8de-39024855f979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5104ec21457452392cca9b11dc290a5, user_id=6f27d4e8c9924df68ef00aeb15137b81, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:39.630572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb6b5d-37f3-4e81-85c5-91d9c4a665c0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:39.632176 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0fb9a-0c44-481b-a8de-39024855f979 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:39.639231 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba0295-35bb-40b2-9516-1571e53c5c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:39.640579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba0295-35bb-40b2-9516-1571e53c5c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:39.641019 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba0295-35bb-40b2-9516-1571e53c5c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:39.641500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba0295-35bb-40b2-9516-1571e53c5c7f admin admin] PATH_INFO: `/v3/projects/9a9a53e4516749108aad2020373c3763` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:39.644132 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba0295-35bb-40b2-9516-1571e53c5c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9a53e4516749108aad2020373c3763)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:39.647066 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba0295-35bb-40b2-9516-1571e53c5c7f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:39.777431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1015/2008] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:39 2022] PUT /identity/v3/projects/f5104ec21457452392cca9b11dc290a5/users/6f27d4e8c9924df68ef00aeb15137b81/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:39.777431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0fb9a-0c44-481b-a8de-39024855f979 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:39.777431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e7e0fb9a-0c44-481b-a8de-39024855f979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:39.862395 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0fb9a-0c44-481b-a8de-39024855f979 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:39.867120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4ba0295-35bb-40b2-9516-1571e53c5c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9a53e4516749108aad2020373c3763', 'request_id': 'req-c4ba0295-35bb-40b2-9516-1571e53c5c7f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:39.877645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4ba0295-35bb-40b2-9516-1571e53c5c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9a53e4516749108aad2020373c3763', 'request_id': 'req-c4ba0295-35bb-40b2-9516-1571e53c5c7f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:39.890304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4ba0295-35bb-40b2-9516-1571e53c5c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9a53e4516749108aad2020373c3763', 'request_id': 'req-c4ba0295-35bb-40b2-9516-1571e53c5c7f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:39.926017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a31002-1209-4da6-ba6a-33977f0cb56d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:39.926763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a31002-1209-4da6-ba6a-33977f0cb56d service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:39.927162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a31002-1209-4da6-ba6a-33977f0cb56d service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:39.927492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a31002-1209-4da6-ba6a-33977f0cb56d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:40.017302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4ba0295-35bb-40b2-9516-1571e53c5c7f admin admin] The token cache is being invalidate because project 9a9a53e4516749108aad2020373c3763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:40.017740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4ba0295-35bb-40b2-9516-1571e53c5c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:40.018544 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4ba0295-35bb-40b2-9516-1571e53c5c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:40.020286 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 994/2009] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:39 2022] DELETE /identity/v3/projects/9a9a53e4516749108aad2020373c3763 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:40.021731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83499da1-513d-4baa-8afa-51706d8c49de None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:40.022083 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83499da1-513d-4baa-8afa-51706d8c49de None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:40.022471 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83499da1-513d-4baa-8afa-51706d8c49de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:40.038173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a31002-1209-4da6-ba6a-33977f0cb56d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:40.041207 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a31002-1209-4da6-ba6a-33977f0cb56d service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:40.061797 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1016/2010] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:40.063440 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a31002-1209-4da6-ba6a-33977f0cb56d service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:40.073945 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-83499da1-513d-4baa-8afa-51706d8c49de None None] MFA Rules not processed for user `6f27d4e8c9924df68ef00aeb15137b81`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:40.076385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-83499da1-513d-4baa-8afa-51706d8c49de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:40.191028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a31002-1209-4da6-ba6a-33977f0cb56d service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:40.200694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122252a7-4d4a-4b06-bcff-4edb29c5c195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:40.200924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122252a7-4d4a-4b06-bcff-4edb29c5c195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:40.201420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122252a7-4d4a-4b06-bcff-4edb29c5c195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:40.201922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122252a7-4d4a-4b06-bcff-4edb29c5c195 admin admin] PATH_INFO: `/v3/users/747bfd94669c4556a42db5736ba8d93d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:40.205621 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122252a7-4d4a-4b06-bcff-4edb29c5c195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747bfd94669c4556a42db5736ba8d93d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:40.213622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 995/2011] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:40.213846 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122252a7-4d4a-4b06-bcff-4edb29c5c195 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:40.215670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83499da1-513d-4baa-8afa-51706d8c49de None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:40.218202 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-83499da1-513d-4baa-8afa-51706d8c49de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:40.247887 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83499da1-513d-4baa-8afa-51706d8c49de None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:40.258296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1487edd-14c8-45ce-9052-fe72947a4c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:40.259653 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1487edd-14c8-45ce-9052-fe72947a4c5b admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:40.260275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1487edd-14c8-45ce-9052-fe72947a4c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:40.260774 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1487edd-14c8-45ce-9052-fe72947a4c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:40.262240 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1487edd-14c8-45ce-9052-fe72947a4c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:40.266486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1487edd-14c8-45ce-9052-fe72947a4c5b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:40.322257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:40.439954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:40.456183 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 996/2012] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:40 2022] POST /identity/v3/projects => generated 391 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:41:40.456183 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1487edd-14c8-45ce-9052-fe72947a4c5b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:40.458861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e1487edd-14c8-45ce-9052-fe72947a4c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:40.532046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-122252a7-4d4a-4b06-bcff-4edb29c5c195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747bfd94669c4556a42db5736ba8d93d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:40.564914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1487edd-14c8-45ce-9052-fe72947a4c5b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:40.569635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e2927-c5b4-48a6-b10c-8a97164b530e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:40.570520 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e2927-c5b4-48a6-b10c-8a97164b530e service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:40.571005 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e2927-c5b4-48a6-b10c-8a97164b530e service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:40.571467 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e2927-c5b4-48a6-b10c-8a97164b530e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:40.573876 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-976e2927-c5b4-48a6-b10c-8a97164b530e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:40.630058 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-122252a7-4d4a-4b06-bcff-4edb29c5c195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747bfd94669c4556a42db5736ba8d93d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:40.640650 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-122252a7-4d4a-4b06-bcff-4edb29c5c195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747bfd94669c4556a42db5736ba8d93d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:40.641640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-122252a7-4d4a-4b06-bcff-4edb29c5c195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747bfd94669c4556a42db5736ba8d93d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:40.658790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-122252a7-4d4a-4b06-bcff-4edb29c5c195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747bfd94669c4556a42db5736ba8d93d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:40.660506 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e2927-c5b4-48a6-b10c-8a97164b530e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:40.663594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e2927-c5b4-48a6-b10c-8a97164b530e service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:40.669125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1017/2013] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:40 2022] DELETE /identity/v3/users/747bfd94669c4556a42db5736ba8d93d => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:40.677028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122252a7-4d4a-4b06-bcff-4edb29c5c195 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:40.677648 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-122252a7-4d4a-4b06-bcff-4edb29c5c195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:40.696712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 997/2014] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:40.857811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122252a7-4d4a-4b06-bcff-4edb29c5c195 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:40.865358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8e53f-0098-41d2-8bc6-c212ef142f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:40.866599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8e53f-0098-41d2-8bc6-c212ef142f26 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:40.867049 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8e53f-0098-41d2-8bc6-c212ef142f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:40.867556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8e53f-0098-41d2-8bc6-c212ef142f26 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:40.868603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8e53f-0098-41d2-8bc6-c212ef142f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:40.871740 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8e53f-0098-41d2-8bc6-c212ef142f26 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:41.020461 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1018/2015] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:40 2022] POST /identity/v3/users => generated 302 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:41.026590 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e2927-c5b4-48a6-b10c-8a97164b530e service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:41.137938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e2927-c5b4-48a6-b10c-8a97164b530e service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:41.145261 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131813f1-57e9-4859-87ec-e9033c5f4601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:41.146145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131813f1-57e9-4859-87ec-e9033c5f4601 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:41.150491 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131813f1-57e9-4859-87ec-e9033c5f4601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:41.151276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131813f1-57e9-4859-87ec-e9033c5f4601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:41.151943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131813f1-57e9-4859-87ec-e9033c5f4601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:41.153711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131813f1-57e9-4859-87ec-e9033c5f4601 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:41.166954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 998/2016] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:41:41.171391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8e53f-0098-41d2-8bc6-c212ef142f26 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:41.184865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8e53f-0098-41d2-8bc6-c212ef142f26 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:41.193450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86968ae-dc42-43b5-87a7-4c61d7f16ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:41.194858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86968ae-dc42-43b5-87a7-4c61d7f16ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:41.195285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86968ae-dc42-43b5-87a7-4c61d7f16ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:41.195794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86968ae-dc42-43b5-87a7-4c61d7f16ca9 admin admin] PATH_INFO: `/v3/projects/299b0ffd71c24478beb3aa1c11b97e53/users/d69cc1a0ae30457383b00758286714dc/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:41.219055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86968ae-dc42-43b5-87a7-4c61d7f16ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299b0ffd71c24478beb3aa1c11b97e53, user_id=d69cc1a0ae30457383b00758286714dc, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:41.222359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86968ae-dc42-43b5-87a7-4c61d7f16ca9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:41.313178 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1019/2017] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:41 2022] PUT /identity/v3/projects/299b0ffd71c24478beb3aa1c11b97e53/users/d69cc1a0ae30457383b00758286714dc/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:41.320864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131813f1-57e9-4859-87ec-e9033c5f4601 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:41.347951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131813f1-57e9-4859-87ec-e9033c5f4601 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:41.449515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86968ae-dc42-43b5-87a7-4c61d7f16ca9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:41.452801 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e86968ae-dc42-43b5-87a7-4c61d7f16ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:41.453523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ae6ea-2898-4774-9a32-4c3f0305a067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:41.454666 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ae6ea-2898-4774-9a32-4c3f0305a067 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:41.455144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ae6ea-2898-4774-9a32-4c3f0305a067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:41.455672 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ae6ea-2898-4774-9a32-4c3f0305a067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:41.457009 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ae6ea-2898-4774-9a32-4c3f0305a067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:41.460050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ae6ea-2898-4774-9a32-4c3f0305a067 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:41.483091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 999/2018] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:41.483370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86968ae-dc42-43b5-87a7-4c61d7f16ca9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:41.491017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ae6ea-2898-4774-9a32-4c3f0305a067 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:41.502617 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51b60c-dc4e-4e3b-a433-74099c15c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:41.505255 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51b60c-dc4e-4e3b-a433-74099c15c39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:41.505255 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51b60c-dc4e-4e3b-a433-74099c15c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:41.505762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51b60c-dc4e-4e3b-a433-74099c15c39f admin admin] PATH_INFO: `/v3/projects/3c6b31a52a344919bedc43fb6f9b80f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:41.507886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51b60c-dc4e-4e3b-a433-74099c15c39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c6b31a52a344919bedc43fb6f9b80f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:41.512609 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51b60c-dc4e-4e3b-a433-74099c15c39f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:41.515609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ae6ea-2898-4774-9a32-4c3f0305a067 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:41.532909 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34b773-2e18-4011-824a-639803949540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:41.537233 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34b773-2e18-4011-824a-639803949540 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:41.538136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34b773-2e18-4011-824a-639803949540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:41.538887 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34b773-2e18-4011-824a-639803949540 admin admin] PATH_INFO: `/v3/projects/299b0ffd71c24478beb3aa1c11b97e53/users/d69cc1a0ae30457383b00758286714dc/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:41.543268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34b773-2e18-4011-824a-639803949540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299b0ffd71c24478beb3aa1c11b97e53, user_id=d69cc1a0ae30457383b00758286714dc, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:41.549942 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34b773-2e18-4011-824a-639803949540 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:41.572607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1000/2019] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:41 2022] PUT /identity/v3/projects/299b0ffd71c24478beb3aa1c11b97e53/users/d69cc1a0ae30457383b00758286714dc/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:41.587613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6cf82-f496-466d-bbd4-e938df7e7942 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:41.587935 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6cf82-f496-466d-bbd4-e938df7e7942 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:41.588397 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6cf82-f496-466d-bbd4-e938df7e7942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:41.646308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a3e6cf82-f496-466d-bbd4-e938df7e7942 None None] MFA Rules not processed for user `d69cc1a0ae30457383b00758286714dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:41.648694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a3e6cf82-f496-466d-bbd4-e938df7e7942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:41.706584 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fa51b60c-dc4e-4e3b-a433-74099c15c39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c6b31a52a344919bedc43fb6f9b80f6', 'request_id': 'req-fa51b60c-dc4e-4e3b-a433-74099c15c39f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:41.721891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fa51b60c-dc4e-4e3b-a433-74099c15c39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c6b31a52a344919bedc43fb6f9b80f6', 'request_id': 'req-fa51b60c-dc4e-4e3b-a433-74099c15c39f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:41.731843 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fa51b60c-dc4e-4e3b-a433-74099c15c39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c6b31a52a344919bedc43fb6f9b80f6', 'request_id': 'req-fa51b60c-dc4e-4e3b-a433-74099c15c39f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:41.769999 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1001/2020] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:41.793956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6cf82-f496-466d-bbd4-e938df7e7942 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:41.795468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a3e6cf82-f496-466d-bbd4-e938df7e7942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:41.838152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fa51b60c-dc4e-4e3b-a433-74099c15c39f admin admin] The token cache is being invalidate because project 3c6b31a52a344919bedc43fb6f9b80f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:41.838863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fa51b60c-dc4e-4e3b-a433-74099c15c39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:41.839994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fa51b60c-dc4e-4e3b-a433-74099c15c39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:41.842828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1020/2021] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:41 2022] DELETE /identity/v3/projects/3c6b31a52a344919bedc43fb6f9b80f6 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:41.851006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51b60c-dc4e-4e3b-a433-74099c15c39f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:41.853232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fa51b60c-dc4e-4e3b-a433-74099c15c39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:41.902470 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6cf82-f496-466d-bbd4-e938df7e7942 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:41.959903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51b60c-dc4e-4e3b-a433-74099c15c39f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:41.967714 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32161ea-8fab-4011-ae39-81abca07adfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:41.968860 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32161ea-8fab-4011-ae39-81abca07adfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:41.969198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32161ea-8fab-4011-ae39-81abca07adfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:41.969516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32161ea-8fab-4011-ae39-81abca07adfa admin admin] PATH_INFO: `/v3/users/b4115f4ed2cb481590359f1690f8ef14` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:41.972354 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32161ea-8fab-4011-ae39-81abca07adfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4115f4ed2cb481590359f1690f8ef14)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:41.974572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32161ea-8fab-4011-ae39-81abca07adfa admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:41.987571 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1d426-7eac-4af2-ac96-5f1012e99560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:41.988343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1d426-7eac-4af2-ac96-5f1012e99560 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:41.988681 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1d426-7eac-4af2-ac96-5f1012e99560 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:41.988960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1d426-7eac-4af2-ac96-5f1012e99560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:41.991336 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b7d1d426-7eac-4af2-ac96-5f1012e99560 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:42.103251 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1d426-7eac-4af2-ac96-5f1012e99560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:42.104999 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1d426-7eac-4af2-ac96-5f1012e99560 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:42.117873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1002/2022] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:41:42.185390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1d426-7eac-4af2-ac96-5f1012e99560 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:42.187122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b7d1d426-7eac-4af2-ac96-5f1012e99560 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:42.201857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:42.209123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1d426-7eac-4af2-ac96-5f1012e99560 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:42.216324 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeecd69-bbd1-4ed1-965f-6ae965b04345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:42.217474 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeecd69-bbd1-4ed1-965f-6ae965b04345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:42.217751 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeecd69-bbd1-4ed1-965f-6ae965b04345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:42.218133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeecd69-bbd1-4ed1-965f-6ae965b04345 admin admin] PATH_INFO: `/v3/users/491851670e3247f8848c2a53516c6e45` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:42.219826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeecd69-bbd1-4ed1-965f-6ae965b04345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=491851670e3247f8848c2a53516c6e45)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:42.222622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeecd69-bbd1-4ed1-965f-6ae965b04345 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:42.276861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d32161ea-8fab-4011-ae39-81abca07adfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4115f4ed2cb481590359f1690f8ef14'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:42.309901 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:42.388417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d32161ea-8fab-4011-ae39-81abca07adfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4115f4ed2cb481590359f1690f8ef14'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:42.399271 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d32161ea-8fab-4011-ae39-81abca07adfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4115f4ed2cb481590359f1690f8ef14'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:42.400843 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d32161ea-8fab-4011-ae39-81abca07adfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4115f4ed2cb481590359f1690f8ef14'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:42.420664 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d32161ea-8fab-4011-ae39-81abca07adfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4115f4ed2cb481590359f1690f8ef14'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:42.429189 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1021/2023] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:41 2022] DELETE /identity/v3/users/b4115f4ed2cb481590359f1690f8ef14 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:42.466621 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32161ea-8fab-4011-ae39-81abca07adfa admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:42.471847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d32161ea-8fab-4011-ae39-81abca07adfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:42.503625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aeeecd69-bbd1-4ed1-965f-6ae965b04345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491851670e3247f8848c2a53516c6e45'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:42.561062 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32161ea-8fab-4011-ae39-81abca07adfa admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:42.567597 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7f0f8-d545-495c-9e4e-d392db9180e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:42.568328 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7f0f8-d545-495c-9e4e-d392db9180e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:42.568619 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7f0f8-d545-495c-9e4e-d392db9180e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:42.569240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7f0f8-d545-495c-9e4e-d392db9180e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:42.572947 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a0d7f0f8-d545-495c-9e4e-d392db9180e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:42.601536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aeeecd69-bbd1-4ed1-965f-6ae965b04345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491851670e3247f8848c2a53516c6e45'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:42.609767 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aeeecd69-bbd1-4ed1-965f-6ae965b04345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491851670e3247f8848c2a53516c6e45'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:42.610784 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aeeecd69-bbd1-4ed1-965f-6ae965b04345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491851670e3247f8848c2a53516c6e45'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:42.632370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aeeecd69-bbd1-4ed1-965f-6ae965b04345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491851670e3247f8848c2a53516c6e45'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:42.642837 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1003/2024] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:42 2022] DELETE /identity/v3/users/491851670e3247f8848c2a53516c6e45 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:42.650026 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e67717-f047-4113-a93e-02abf8555d38 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:42.650746 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e67717-f047-4113-a93e-02abf8555d38 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:42.651540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e67717-f047-4113-a93e-02abf8555d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:42.680932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7f0f8-d545-495c-9e4e-d392db9180e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:42.684572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7f0f8-d545-495c-9e4e-d392db9180e8 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:42.685622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-05e67717-f047-4113-a93e-02abf8555d38 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:42.687469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-05e67717-f047-4113-a93e-02abf8555d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:42.712544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1022/2025] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:41:42.855587 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1004/2026] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:41:42.871609 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7f0f8-d545-495c-9e4e-d392db9180e8 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:42.877879 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a0d7f0f8-d545-495c-9e4e-d392db9180e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:42.900507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:42.971804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7f0f8-d545-495c-9e4e-d392db9180e8 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:43.076110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e31945-a3ae-4201-872e-aaa7d622c074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:43.077226 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e31945-a3ae-4201-872e-aaa7d622c074 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:43.077719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e31945-a3ae-4201-872e-aaa7d622c074 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:43.078222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e31945-a3ae-4201-872e-aaa7d622c074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:43.096189 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e31945-a3ae-4201-872e-aaa7d622c074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:43.098811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e31945-a3ae-4201-872e-aaa7d622c074 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:43.118422 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1023/2027] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:43.234373 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e67717-f047-4113-a93e-02abf8555d38 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:43.238430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-05e67717-f047-4113-a93e-02abf8555d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:43.263746 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e67717-f047-4113-a93e-02abf8555d38 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:43.272257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04b95d-5714-4dd0-ada8-4ad22fea9463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:43.273916 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04b95d-5714-4dd0-ada8-4ad22fea9463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:43.274453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04b95d-5714-4dd0-ada8-4ad22fea9463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:43.275011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04b95d-5714-4dd0-ada8-4ad22fea9463 admin admin] PATH_INFO: `/v3/projects/2675ba5686864c6fb604822f7e00d630` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:43.277394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04b95d-5714-4dd0-ada8-4ad22fea9463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2675ba5686864c6fb604822f7e00d630)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:43.282095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04b95d-5714-4dd0-ada8-4ad22fea9463 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:43.299457 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:43.511468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e31945-a3ae-4201-872e-aaa7d622c074 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:43.511468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-34e31945-a3ae-4201-872e-aaa7d622c074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:43.524670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bc04b95d-5714-4dd0-ada8-4ad22fea9463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2675ba5686864c6fb604822f7e00d630', 'request_id': 'req-bc04b95d-5714-4dd0-ada8-4ad22fea9463'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:43.547552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bc04b95d-5714-4dd0-ada8-4ad22fea9463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2675ba5686864c6fb604822f7e00d630', 'request_id': 'req-bc04b95d-5714-4dd0-ada8-4ad22fea9463'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:43.548410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:43.577660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e31945-a3ae-4201-872e-aaa7d622c074 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:43.587777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bc04b95d-5714-4dd0-ada8-4ad22fea9463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2675ba5686864c6fb604822f7e00d630', 'request_id': 'req-bc04b95d-5714-4dd0-ada8-4ad22fea9463'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:43.710401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2f545-69c3-4ed8-9294-2ab42b209cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:43.713207 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2f545-69c3-4ed8-9294-2ab42b209cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:43.714156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2f545-69c3-4ed8-9294-2ab42b209cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:43.714310 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2f545-69c3-4ed8-9294-2ab42b209cec admin admin] PATH_INFO: `/v3/users/c12ef666817d41868284fd31cef205cf` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:43.716670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2f545-69c3-4ed8-9294-2ab42b209cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c12ef666817d41868284fd31cef205cf)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:43.716877 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bc04b95d-5714-4dd0-ada8-4ad22fea9463 admin admin] The token cache is being invalidate because project 2675ba5686864c6fb604822f7e00d630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:43.717320 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bc04b95d-5714-4dd0-ada8-4ad22fea9463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:43.718575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bc04b95d-5714-4dd0-ada8-4ad22fea9463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:43.722082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2f545-69c3-4ed8-9294-2ab42b209cec admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:43.722656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1005/2028] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:43 2022] DELETE /identity/v3/projects/2675ba5686864c6fb604822f7e00d630 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:43.728544 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4d27-d190-4a27-8bc2-e7f05bce84c2 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:43.728781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4d27-d190-4a27-8bc2-e7f05bce84c2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:43.728976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4d27-d190-4a27-8bc2-e7f05bce84c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:43.796687 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-261d4d27-d190-4a27-8bc2-e7f05bce84c2 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:43.796687 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-261d4d27-d190-4a27-8bc2-e7f05bce84c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:43.809839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1006/2029] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:41:43.824142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a9ee7-affc-4921-80f7-3c76da491cea None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:43.824687 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a9ee7-affc-4921-80f7-3c76da491cea None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:43.826450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a9ee7-affc-4921-80f7-3c76da491cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:43.853468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e39a9ee7-affc-4921-80f7-3c76da491cea None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:43.855271 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e39a9ee7-affc-4921-80f7-3c76da491cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:43.869756 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1007/2030] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:43.875562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a9ee7-affc-4921-80f7-3c76da491cea None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:43.888486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a9ee7-affc-4921-80f7-3c76da491cea None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:43.904640 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22afbd-4c9d-4c35-a328-8caed3f08ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:43.906051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22afbd-4c9d-4c35-a328-8caed3f08ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:43.906690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22afbd-4c9d-4c35-a328-8caed3f08ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:43.907228 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22afbd-4c9d-4c35-a328-8caed3f08ee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:43.908707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22afbd-4c9d-4c35-a328-8caed3f08ee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:43.909540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22afbd-4c9d-4c35-a328-8caed3f08ee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:43.915332 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22afbd-4c9d-4c35-a328-8caed3f08ee3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:43.968969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1008/2031] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:41:43.970626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22afbd-4c9d-4c35-a328-8caed3f08ee3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:43.991115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22afbd-4c9d-4c35-a328-8caed3f08ee3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:43.991728 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30e2f545-69c3-4ed8-9294-2ab42b209cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c12ef666817d41868284fd31cef205cf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:43.998611 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c0ebe-7157-4bbc-8679-ff18ea1c8d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:43.999287 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c0ebe-7157-4bbc-8679-ff18ea1c8d89 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:43.999582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c0ebe-7157-4bbc-8679-ff18ea1c8d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:43.999847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c0ebe-7157-4bbc-8679-ff18ea1c8d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:44.000577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c0ebe-7157-4bbc-8679-ff18ea1c8d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:44.003563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c0ebe-7157-4bbc-8679-ff18ea1c8d89 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:44.136898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30e2f545-69c3-4ed8-9294-2ab42b209cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c12ef666817d41868284fd31cef205cf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:44.149501 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1009/2032] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:43 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:44.150675 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c0ebe-7157-4bbc-8679-ff18ea1c8d89 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:44.152650 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-251c0ebe-7157-4bbc-8679-ff18ea1c8d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:44.155239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30e2f545-69c3-4ed8-9294-2ab42b209cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c12ef666817d41868284fd31cef205cf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:44.155988 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30e2f545-69c3-4ed8-9294-2ab42b209cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c12ef666817d41868284fd31cef205cf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:44.175297 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30e2f545-69c3-4ed8-9294-2ab42b209cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c12ef666817d41868284fd31cef205cf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:44.183367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1024/2033] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:43 2022] DELETE /identity/v3/users/c12ef666817d41868284fd31cef205cf => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:44.189027 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2f545-69c3-4ed8-9294-2ab42b209cec admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:44.189027 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-30e2f545-69c3-4ed8-9294-2ab42b209cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:44.261761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c0ebe-7157-4bbc-8679-ff18ea1c8d89 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:44.287873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2f545-69c3-4ed8-9294-2ab42b209cec admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:44.299904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d12e01-0e11-44d8-8a01-d735a409ca6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:44.300943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d12e01-0e11-44d8-8a01-d735a409ca6d admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:44.301491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d12e01-0e11-44d8-8a01-d735a409ca6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:44.302029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d12e01-0e11-44d8-8a01-d735a409ca6d admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:44.303638 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d12e01-0e11-44d8-8a01-d735a409ca6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:44.307298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d12e01-0e11-44d8-8a01-d735a409ca6d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:44.321630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:44.347727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88328209-6c37-40e4-957c-e7c26722c77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:44.348621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88328209-6c37-40e4-957c-e7c26722c77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:44.348902 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88328209-6c37-40e4-957c-e7c26722c77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:44.349208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88328209-6c37-40e4-957c-e7c26722c77d admin admin] PATH_INFO: `/v3/projects/e8973db5eb8245b693a86f15d2230856` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:44.350602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88328209-6c37-40e4-957c-e7c26722c77d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8973db5eb8245b693a86f15d2230856)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:44.352580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88328209-6c37-40e4-957c-e7c26722c77d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:44.408087 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1025/2034] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:44 2022] POST /identity/v3/users => generated 288 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:44.410526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5259cb6-ca04-43f4-beb7-7c65c363aa10 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:44.410996 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5259cb6-ca04-43f4-beb7-7c65c363aa10 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:44.411483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5259cb6-ca04-43f4-beb7-7c65c363aa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:44.413766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:44.435588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e5259cb6-ca04-43f4-beb7-7c65c363aa10 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:44.436864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e5259cb6-ca04-43f4-beb7-7c65c363aa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:44.447043 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1026/2035] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:44.447885 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5259cb6-ca04-43f4-beb7-7c65c363aa10 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:44.461325 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5259cb6-ca04-43f4-beb7-7c65c363aa10 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:44.467091 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c041ae5-ec26-471f-960b-516f61703d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:44.467821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c041ae5-ec26-471f-960b-516f61703d56 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:44.468152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c041ae5-ec26-471f-960b-516f61703d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:44.468521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c041ae5-ec26-471f-960b-516f61703d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:44.469313 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c041ae5-ec26-471f-960b-516f61703d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:44.471374 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c041ae5-ec26-471f-960b-516f61703d56 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:44.482853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1027/2036] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:44.483753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c041ae5-ec26-471f-960b-516f61703d56 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:44.486368 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4c041ae5-ec26-471f-960b-516f61703d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:44.544029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-88328209-6c37-40e4-957c-e7c26722c77d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8973db5eb8245b693a86f15d2230856', 'request_id': 'req-88328209-6c37-40e4-957c-e7c26722c77d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:44.554453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-88328209-6c37-40e4-957c-e7c26722c77d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8973db5eb8245b693a86f15d2230856', 'request_id': 'req-88328209-6c37-40e4-957c-e7c26722c77d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:44.564569 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c041ae5-ec26-471f-960b-516f61703d56 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:44.564787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-88328209-6c37-40e4-957c-e7c26722c77d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8973db5eb8245b693a86f15d2230856', 'request_id': 'req-88328209-6c37-40e4-957c-e7c26722c77d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:44.642386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe09cb-788e-4227-8b31-aa3a94b8abfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:44.646816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe09cb-788e-4227-8b31-aa3a94b8abfb service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:44.646816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe09cb-788e-4227-8b31-aa3a94b8abfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:44.646816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe09cb-788e-4227-8b31-aa3a94b8abfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:44.674300 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-88328209-6c37-40e4-957c-e7c26722c77d admin admin] The token cache is being invalidate because project e8973db5eb8245b693a86f15d2230856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:44.674848 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-88328209-6c37-40e4-957c-e7c26722c77d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:44.676389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-88328209-6c37-40e4-957c-e7c26722c77d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:44.679370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1010/2037] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:44 2022] DELETE /identity/v3/projects/e8973db5eb8245b693a86f15d2230856 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:44.680957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88328209-6c37-40e4-957c-e7c26722c77d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:44.685337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-88328209-6c37-40e4-957c-e7c26722c77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:44.728425 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe09cb-788e-4227-8b31-aa3a94b8abfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:44.731477 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe09cb-788e-4227-8b31-aa3a94b8abfb service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:44.752483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1028/2038] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:44.754023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe09cb-788e-4227-8b31-aa3a94b8abfb service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:44.756495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b3fe09cb-788e-4227-8b31-aa3a94b8abfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:44.786399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe09cb-788e-4227-8b31-aa3a94b8abfb service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:44.800417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd9bab-51e0-4254-b95e-3fe7e0e3c4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:44.800417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd9bab-51e0-4254-b95e-3fe7e0e3c4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:44.800417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd9bab-51e0-4254-b95e-3fe7e0e3c4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:44.800417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd9bab-51e0-4254-b95e-3fe7e0e3c4ee admin admin] PATH_INFO: `/v3/users/670f0483d3d84dcd87f5912c09abe7aa` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:44.801535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd9bab-51e0-4254-b95e-3fe7e0e3c4ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=670f0483d3d84dcd87f5912c09abe7aa)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:44.803151 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88328209-6c37-40e4-957c-e7c26722c77d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:44.803855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd9bab-51e0-4254-b95e-3fe7e0e3c4ee admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:44.816390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dfa25-947b-46a7-a9e6-8c51dacdf06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:44.818845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dfa25-947b-46a7-a9e6-8c51dacdf06f admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:44.819468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dfa25-947b-46a7-a9e6-8c51dacdf06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:44.820018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dfa25-947b-46a7-a9e6-8c51dacdf06f admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:44.821526 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2dfa25-947b-46a7-a9e6-8c51dacdf06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:44.826529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2dfa25-947b-46a7-a9e6-8c51dacdf06f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:44.853373 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1011/2039] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:44.854918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dfa25-947b-46a7-a9e6-8c51dacdf06f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:44.875579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dfa25-947b-46a7-a9e6-8c51dacdf06f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:44.899314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c87611-7c2f-49db-86d7-af89e67fb0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:44.900970 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87611-7c2f-49db-86d7-af89e67fb0e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:44.901770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87611-7c2f-49db-86d7-af89e67fb0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:44.902922 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87611-7c2f-49db-86d7-af89e67fb0e8 admin admin] PATH_INFO: `/v3/projects/5826d76956d74176b9e3407562a84462/users/54db213074d342cd9954ba5acc3f22f5/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:44.923078 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:44.943002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c87611-7c2f-49db-86d7-af89e67fb0e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5826d76956d74176b9e3407562a84462, user_id=54db213074d342cd9954ba5acc3f22f5, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:44.955384 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c87611-7c2f-49db-86d7-af89e67fb0e8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:44.966406 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:45.107984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1012/2040] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:44 2022] PUT /identity/v3/projects/5826d76956d74176b9e3407562a84462/users/54db213074d342cd9954ba5acc3f22f5/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:45.133420 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eace823-2397-4873-a746-3000e9febf29 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:45.134988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eace823-2397-4873-a746-3000e9febf29 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:45.144228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a5bd9bab-51e0-4254-b95e-3fe7e0e3c4ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '670f0483d3d84dcd87f5912c09abe7aa'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:45.149161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eace823-2397-4873-a746-3000e9febf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:45.201308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8eace823-2397-4873-a746-3000e9febf29 None None] MFA Rules not processed for user `54db213074d342cd9954ba5acc3f22f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:45.202927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8eace823-2397-4873-a746-3000e9febf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:45.223168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a5bd9bab-51e0-4254-b95e-3fe7e0e3c4ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '670f0483d3d84dcd87f5912c09abe7aa'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:45.239501 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a5bd9bab-51e0-4254-b95e-3fe7e0e3c4ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '670f0483d3d84dcd87f5912c09abe7aa'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:45.240497 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a5bd9bab-51e0-4254-b95e-3fe7e0e3c4ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '670f0483d3d84dcd87f5912c09abe7aa'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:45.291338 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a5bd9bab-51e0-4254-b95e-3fe7e0e3c4ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '670f0483d3d84dcd87f5912c09abe7aa'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:45.314382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1029/2041] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:44 2022] DELETE /identity/v3/users/670f0483d3d84dcd87f5912c09abe7aa => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:45.400414 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1013/2042] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:45.415824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd9bab-51e0-4254-b95e-3fe7e0e3c4ee admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:45.417901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a5bd9bab-51e0-4254-b95e-3fe7e0e3c4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:45.518216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eace823-2397-4873-a746-3000e9febf29 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:45.520927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8eace823-2397-4873-a746-3000e9febf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:45.568508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd9bab-51e0-4254-b95e-3fe7e0e3c4ee admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:45.577320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2026cd-1f58-4ac1-9568-e9de6acb2efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:45.579029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2026cd-1f58-4ac1-9568-e9de6acb2efb service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:45.580425 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2026cd-1f58-4ac1-9568-e9de6acb2efb service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:45.581408 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2026cd-1f58-4ac1-9568-e9de6acb2efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:45.634852 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:45.659930 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eace823-2397-4873-a746-3000e9febf29 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:45.730801 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2026cd-1f58-4ac1-9568-e9de6acb2efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:45.740930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2026cd-1f58-4ac1-9568-e9de6acb2efb service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:45.773032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1030/2043] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:45.802758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:45.803423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:45.805168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:45.808360 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99 admin admin] PATH_INFO: `/v3/projects/e159393918854a0496d9b0b01abb6e40` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:45.810830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e159393918854a0496d9b0b01abb6e40)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:45.813027 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:46.064349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e159393918854a0496d9b0b01abb6e40', 'request_id': 'req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:46.076352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e159393918854a0496d9b0b01abb6e40', 'request_id': 'req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:46.085638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e159393918854a0496d9b0b01abb6e40', 'request_id': 'req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:46.210294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99 admin admin] The token cache is being invalidate because project e159393918854a0496d9b0b01abb6e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:46.211126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:46.219282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:46.226301 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1014/2044] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:45 2022] DELETE /identity/v3/projects/e159393918854a0496d9b0b01abb6e40 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:46.237368 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2026cd-1f58-4ac1-9568-e9de6acb2efb service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:46.253884 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2026cd-1f58-4ac1-9568-e9de6acb2efb service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:46.325073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:46.339704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:46.345274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:46.440900 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd88a4-e239-4864-afc3-7bf17e45caf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:46.442628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd88a4-e239-4864-afc3-7bf17e45caf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.443515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd88a4-e239-4864-afc3-7bf17e45caf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.443617 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd88a4-e239-4864-afc3-7bf17e45caf5 admin admin] PATH_INFO: `/v3/users/6fd3d627b5d649c99ebc56fcacddfdf4` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.447007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd88a4-e239-4864-afc3-7bf17e45caf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd3d627b5d649c99ebc56fcacddfdf4)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:46.451610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd88a4-e239-4864-afc3-7bf17e45caf5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:46.536504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d011b8-26a1-48ec-9fc8-a94c5edd1a99 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:46.542013 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3753cdb-d3c3-4aa5-a51c-532f2d7c0497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:46.543151 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753cdb-d3c3-4aa5-a51c-532f2d7c0497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.543813 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753cdb-d3c3-4aa5-a51c-532f2d7c0497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.544175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753cdb-d3c3-4aa5-a51c-532f2d7c0497 admin admin] PATH_INFO: `/v3/projects/62acaa2e9971447ea61e73f4b825e1b8` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.545680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3753cdb-d3c3-4aa5-a51c-532f2d7c0497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62acaa2e9971447ea61e73f4b825e1b8)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:46.548996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3753cdb-d3c3-4aa5-a51c-532f2d7c0497 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:46.645320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:46.698141 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7afd88a4-e239-4864-afc3-7bf17e45caf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd3d627b5d649c99ebc56fcacddfdf4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:46.722798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d3753cdb-d3c3-4aa5-a51c-532f2d7c0497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62acaa2e9971447ea61e73f4b825e1b8', 'request_id': 'req-d3753cdb-d3c3-4aa5-a51c-532f2d7c0497'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:46.729835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d3753cdb-d3c3-4aa5-a51c-532f2d7c0497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62acaa2e9971447ea61e73f4b825e1b8', 'request_id': 'req-d3753cdb-d3c3-4aa5-a51c-532f2d7c0497'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:46.737898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d3753cdb-d3c3-4aa5-a51c-532f2d7c0497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62acaa2e9971447ea61e73f4b825e1b8', 'request_id': 'req-d3753cdb-d3c3-4aa5-a51c-532f2d7c0497'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:46.785439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7afd88a4-e239-4864-afc3-7bf17e45caf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd3d627b5d649c99ebc56fcacddfdf4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:46.798740 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7afd88a4-e239-4864-afc3-7bf17e45caf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd3d627b5d649c99ebc56fcacddfdf4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:46.800981 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7afd88a4-e239-4864-afc3-7bf17e45caf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd3d627b5d649c99ebc56fcacddfdf4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:46.860755 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7afd88a4-e239-4864-afc3-7bf17e45caf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd3d627b5d649c99ebc56fcacddfdf4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:46.880818 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1031/2045] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:46 2022] DELETE /identity/v3/users/6fd3d627b5d649c99ebc56fcacddfdf4 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:46.901674 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d3753cdb-d3c3-4aa5-a51c-532f2d7c0497 admin admin] The token cache is being invalidate because project 62acaa2e9971447ea61e73f4b825e1b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:46.902153 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d3753cdb-d3c3-4aa5-a51c-532f2d7c0497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:46.908825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d3753cdb-d3c3-4aa5-a51c-532f2d7c0497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:46.928157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1015/2046] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:46 2022] DELETE /identity/v3/projects/62acaa2e9971447ea61e73f4b825e1b8 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:46.929413 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1cc4f-dc45-4371-997a-fa9917d49dd9 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.931419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1cc4f-dc45-4371-997a-fa9917d49dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.931419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1cc4f-dc45-4371-997a-fa9917d49dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.979097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-05c1cc4f-dc45-4371-997a-fa9917d49dd9 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:46.980498 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-05c1cc4f-dc45-4371-997a-fa9917d49dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:47.037530 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:47.132442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1032/2047] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:41:47.141185 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e3063-287d-40c3-9e14-872fbee2cfdd None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.142784 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e3063-287d-40c3-9e14-872fbee2cfdd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.142784 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e3063-287d-40c3-9e14-872fbee2cfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.171383 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-bc0e3063-287d-40c3-9e14-872fbee2cfdd None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:47.173620 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-bc0e3063-287d-40c3-9e14-872fbee2cfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:47.193760 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1016/2048] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:41:47.207173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1cc4f-dc45-4371-997a-fa9917d49dd9 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.226069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1cc4f-dc45-4371-997a-fa9917d49dd9 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.234000 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbf6a6-2959-4c3c-b3b7-9e96939e69af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.234764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbf6a6-2959-4c3c-b3b7-9e96939e69af admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.235949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbf6a6-2959-4c3c-b3b7-9e96939e69af admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.235949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbf6a6-2959-4c3c-b3b7-9e96939e69af admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.236698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbf6a6-2959-4c3c-b3b7-9e96939e69af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:47.237111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbf6a6-2959-4c3c-b3b7-9e96939e69af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.239020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbf6a6-2959-4c3c-b3b7-9e96939e69af admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.255870 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1033/2049] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:47.261511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e3063-287d-40c3-9e14-872fbee2cfdd None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.273839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e3063-287d-40c3-9e14-872fbee2cfdd None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.279951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c47326-bd22-4054-af86-7ca0d44aac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.281095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c47326-bd22-4054-af86-7ca0d44aac2c admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.281586 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c47326-bd22-4054-af86-7ca0d44aac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.282277 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c47326-bd22-4054-af86-7ca0d44aac2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.284006 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c47326-bd22-4054-af86-7ca0d44aac2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.287801 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c47326-bd22-4054-af86-7ca0d44aac2c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.304141 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:47.502882 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1017/2050] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/projects => generated 375 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:47.509570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbf6a6-2959-4c3c-b3b7-9e96939e69af admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.539658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbf6a6-2959-4c3c-b3b7-9e96939e69af admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.659897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be876b-232a-419b-ad10-361d0c5eb87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.661578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be876b-232a-419b-ad10-361d0c5eb87a admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.663653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be876b-232a-419b-ad10-361d0c5eb87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.664197 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be876b-232a-419b-ad10-361d0c5eb87a admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.665018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be876b-232a-419b-ad10-361d0c5eb87a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.667598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be876b-232a-419b-ad10-361d0c5eb87a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.818102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1034/2051] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/users => generated 288 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:41:47.822581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c47326-bd22-4054-af86-7ca0d44aac2c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.824126 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be876b-232a-419b-ad10-361d0c5eb87a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.825697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-15c47326-bd22-4054-af86-7ca0d44aac2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:47.871227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be876b-232a-419b-ad10-361d0c5eb87a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.872234 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c47326-bd22-4054-af86-7ca0d44aac2c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.899471 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057087f1-550f-41a2-a7c7-3987a8aa313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.901318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057087f1-550f-41a2-a7c7-3987a8aa313a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.902655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea506f-a436-41bd-956d-5916da27796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.903770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea506f-a436-41bd-956d-5916da27796e admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.904300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea506f-a436-41bd-956d-5916da27796e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.904821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea506f-a436-41bd-956d-5916da27796e admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.909534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057087f1-550f-41a2-a7c7-3987a8aa313a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.909534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057087f1-550f-41a2-a7c7-3987a8aa313a admin admin] PATH_INFO: `/v3/projects/d222448b86b7467880df55f71210b862` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.910217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057087f1-550f-41a2-a7c7-3987a8aa313a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d222448b86b7467880df55f71210b862)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.911818 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea506f-a436-41bd-956d-5916da27796e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.914018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057087f1-550f-41a2-a7c7-3987a8aa313a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.916184 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea506f-a436-41bd-956d-5916da27796e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.990966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1035/2052] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:41:47.992862 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faba27-01a5-489f-b6d4-1bfb17401724 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.993263 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faba27-01a5-489f-b6d4-1bfb17401724 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.993536 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3faba27-01a5-489f-b6d4-1bfb17401724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.021767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d3faba27-01a5-489f-b6d4-1bfb17401724 None None] MFA Rules not processed for user `54db213074d342cd9954ba5acc3f22f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:48.023055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d3faba27-01a5-489f-b6d4-1bfb17401724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:48.101311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1036/2053] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:48.102213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3faba27-01a5-489f-b6d4-1bfb17401724 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.124735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3faba27-01a5-489f-b6d4-1bfb17401724 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.128335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069516f8-962f-4945-b36f-d6c3db2701c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.129166 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069516f8-962f-4945-b36f-d6c3db2701c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.130421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069516f8-962f-4945-b36f-d6c3db2701c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.130896 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069516f8-962f-4945-b36f-d6c3db2701c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.131817 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069516f8-962f-4945-b36f-d6c3db2701c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.133849 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069516f8-962f-4945-b36f-d6c3db2701c0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.157689 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1037/2054] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:48.159055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-057087f1-550f-41a2-a7c7-3987a8aa313a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd222448b86b7467880df55f71210b862', 'request_id': 'req-057087f1-550f-41a2-a7c7-3987a8aa313a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:48.160842 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069516f8-962f-4945-b36f-d6c3db2701c0 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.169086 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-057087f1-550f-41a2-a7c7-3987a8aa313a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd222448b86b7467880df55f71210b862', 'request_id': 'req-057087f1-550f-41a2-a7c7-3987a8aa313a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:48.178942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069516f8-962f-4945-b36f-d6c3db2701c0 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.183796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-057087f1-550f-41a2-a7c7-3987a8aa313a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd222448b86b7467880df55f71210b862', 'request_id': 'req-057087f1-550f-41a2-a7c7-3987a8aa313a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:48.189676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:48.243437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:48.290243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd32ee0-08fc-4223-b0d2-316e24cca8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.292277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd32ee0-08fc-4223-b0d2-316e24cca8df admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.293017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd32ee0-08fc-4223-b0d2-316e24cca8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.293612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd32ee0-08fc-4223-b0d2-316e24cca8df admin admin] PATH_INFO: `/v3/projects/0b19b4d4f73f486ba6a9051f4472720b/users/4363a5c6920244e29060a300949b5ed0/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.328627 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-057087f1-550f-41a2-a7c7-3987a8aa313a admin admin] The token cache is being invalidate because project d222448b86b7467880df55f71210b862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:48.329370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-057087f1-550f-41a2-a7c7-3987a8aa313a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:48.331071 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-057087f1-550f-41a2-a7c7-3987a8aa313a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:48.333778 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd32ee0-08fc-4223-b0d2-316e24cca8df admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b19b4d4f73f486ba6a9051f4472720b, user_id=4363a5c6920244e29060a300949b5ed0, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.343546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1018/2055] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:47 2022] DELETE /identity/v3/projects/d222448b86b7467880df55f71210b862 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:48.343851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd32ee0-08fc-4223-b0d2-316e24cca8df admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.345443 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057087f1-550f-41a2-a7c7-3987a8aa313a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.347182 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-057087f1-550f-41a2-a7c7-3987a8aa313a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:48.379725 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057087f1-550f-41a2-a7c7-3987a8aa313a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.391976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95aab1-28ca-4384-8f11-648e7d0b6356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.394552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95aab1-28ca-4384-8f11-648e7d0b6356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.395409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95aab1-28ca-4384-8f11-648e7d0b6356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.396249 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95aab1-28ca-4384-8f11-648e7d0b6356 admin admin] PATH_INFO: `/v3/users/7e843a55a15f4c61a41a52e3c4776f00` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.400211 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95aab1-28ca-4384-8f11-648e7d0b6356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e843a55a15f4c61a41a52e3c4776f00)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.406751 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95aab1-28ca-4384-8f11-648e7d0b6356 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.413600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1038/2056] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:48 2022] PUT /identity/v3/projects/0b19b4d4f73f486ba6a9051f4472720b/users/4363a5c6920244e29060a300949b5ed0/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:48.433551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4ec6e-aa03-498b-b989-e7ed4e5b8ae2 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.436583 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4ec6e-aa03-498b-b989-e7ed4e5b8ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.437734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4ec6e-aa03-498b-b989-e7ed4e5b8ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.499198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d1a4ec6e-aa03-498b-b989-e7ed4e5b8ae2 None None] MFA Rules not processed for user `4363a5c6920244e29060a300949b5ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:48.503231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d1a4ec6e-aa03-498b-b989-e7ed4e5b8ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:48.614848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1039/2057] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:41:48.621441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4ec6e-aa03-498b-b989-e7ed4e5b8ae2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.622956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d1a4ec6e-aa03-498b-b989-e7ed4e5b8ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:48.688676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:48.707773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4ec6e-aa03-498b-b989-e7ed4e5b8ae2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.712177 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0b95aab1-28ca-4384-8f11-648e7d0b6356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e843a55a15f4c61a41a52e3c4776f00'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:48.716726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72eb9d-6f4e-406b-8dc1-160b1aaf11ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.722042 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72eb9d-6f4e-406b-8dc1-160b1aaf11ca admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.722042 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72eb9d-6f4e-406b-8dc1-160b1aaf11ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.722042 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72eb9d-6f4e-406b-8dc1-160b1aaf11ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.722042 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72eb9d-6f4e-406b-8dc1-160b1aaf11ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.723828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72eb9d-6f4e-406b-8dc1-160b1aaf11ca admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.744734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:48.800825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0b95aab1-28ca-4384-8f11-648e7d0b6356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e843a55a15f4c61a41a52e3c4776f00'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:48.815869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0b95aab1-28ca-4384-8f11-648e7d0b6356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e843a55a15f4c61a41a52e3c4776f00'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:48.817319 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0b95aab1-28ca-4384-8f11-648e7d0b6356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e843a55a15f4c61a41a52e3c4776f00'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:48.837722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0b95aab1-28ca-4384-8f11-648e7d0b6356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e843a55a15f4c61a41a52e3c4776f00'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:48.855476 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1019/2058] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:48 2022] DELETE /identity/v3/users/7e843a55a15f4c61a41a52e3c4776f00 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:48.867254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1040/2059] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:48 2022] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:41:48.869063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95aab1-28ca-4384-8f11-648e7d0b6356 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.871142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0b95aab1-28ca-4384-8f11-648e7d0b6356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:48.984334 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95aab1-28ca-4384-8f11-648e7d0b6356 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.067620 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d778e70-9696-4267-a16b-58256f98913b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.068493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d778e70-9696-4267-a16b-58256f98913b admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.068789 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d778e70-9696-4267-a16b-58256f98913b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.069065 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d778e70-9696-4267-a16b-58256f98913b admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.069774 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d778e70-9696-4267-a16b-58256f98913b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.072297 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d778e70-9696-4267-a16b-58256f98913b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.204765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1020/2060] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:48 2022] POST /identity/v3/users => generated 294 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:49.212061 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72eb9d-6f4e-406b-8dc1-160b1aaf11ca admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.233139 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72eb9d-6f4e-406b-8dc1-160b1aaf11ca admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.247228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b217-f086-4fd0-9119-7047cb145be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.253213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b217-f086-4fd0-9119-7047cb145be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.253213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b217-f086-4fd0-9119-7047cb145be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.254002 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b217-f086-4fd0-9119-7047cb145be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.255414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7b217-f086-4fd0-9119-7047cb145be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.267789 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7b217-f086-4fd0-9119-7047cb145be4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.306103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1041/2061] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:41:49.311123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d778e70-9696-4267-a16b-58256f98913b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.324072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d778e70-9696-4267-a16b-58256f98913b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.336107 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b53f2-0e88-4a0e-9b66-1510239c9777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.337312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b53f2-0e88-4a0e-9b66-1510239c9777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.337726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b53f2-0e88-4a0e-9b66-1510239c9777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.338069 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b53f2-0e88-4a0e-9b66-1510239c9777 admin admin] PATH_INFO: `/v3/projects/eea1d736ad804ec9a903e5b4cb474e42/users/ec0b1c56749546e8bef6d4c33a7a5e07/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.363245 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b53f2-0e88-4a0e-9b66-1510239c9777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea1d736ad804ec9a903e5b4cb474e42, user_id=ec0b1c56749546e8bef6d4c33a7a5e07, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.367399 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b53f2-0e88-4a0e-9b66-1510239c9777 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.396117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:49.453635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1021/2062] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:49 2022] PUT /identity/v3/projects/eea1d736ad804ec9a903e5b4cb474e42/users/ec0b1c56749546e8bef6d4c33a7a5e07/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:49.462796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b217-f086-4fd0-9119-7047cb145be4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.464872 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:49.505743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b217-f086-4fd0-9119-7047cb145be4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.542810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b53f2-0e88-4a0e-9b66-1510239c9777 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.548847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-239b53f2-0e88-4a0e-9b66-1510239c9777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:49.605677 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2e8bc-7700-44a2-84be-1b0ebffc1d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.606584 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2e8bc-7700-44a2-84be-1b0ebffc1d7e admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.606971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2e8bc-7700-44a2-84be-1b0ebffc1d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.607625 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2e8bc-7700-44a2-84be-1b0ebffc1d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.608418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2e8bc-7700-44a2-84be-1b0ebffc1d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.610767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2e8bc-7700-44a2-84be-1b0ebffc1d7e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.633040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1042/2063] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:49.634119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2e8bc-7700-44a2-84be-1b0ebffc1d7e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.640045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-73e2e8bc-7700-44a2-84be-1b0ebffc1d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:49.658576 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2e8bc-7700-44a2-84be-1b0ebffc1d7e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.663149 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c1aec-57ad-49d5-9710-6bb0779b9f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.664027 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c1aec-57ad-49d5-9710-6bb0779b9f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.664308 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c1aec-57ad-49d5-9710-6bb0779b9f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.664588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c1aec-57ad-49d5-9710-6bb0779b9f4f admin admin] PATH_INFO: `/v3/projects/105467e1ea6242b0ac2ecd61c60a6547` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.666253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c1aec-57ad-49d5-9710-6bb0779b9f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=105467e1ea6242b0ac2ecd61c60a6547)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.668548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c1aec-57ad-49d5-9710-6bb0779b9f4f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.678584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b53f2-0e88-4a0e-9b66-1510239c9777 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.684995 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac4da8-6095-413e-9f89-8a90f950811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.685943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac4da8-6095-413e-9f89-8a90f950811b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.686364 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac4da8-6095-413e-9f89-8a90f950811b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.686730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac4da8-6095-413e-9f89-8a90f950811b admin admin] PATH_INFO: `/v3/users/6f27d4e8c9924df68ef00aeb15137b81` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.688548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac4da8-6095-413e-9f89-8a90f950811b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f27d4e8c9924df68ef00aeb15137b81)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.698590 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac4da8-6095-413e-9f89-8a90f950811b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.795233 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:49.885433 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:49.938586 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3c3c1aec-57ad-49d5-9710-6bb0779b9f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105467e1ea6242b0ac2ecd61c60a6547', 'request_id': 'req-3c3c1aec-57ad-49d5-9710-6bb0779b9f4f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:49.945749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-14ac4da8-6095-413e-9f89-8a90f950811b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f27d4e8c9924df68ef00aeb15137b81'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:49.948002 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3c3c1aec-57ad-49d5-9710-6bb0779b9f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105467e1ea6242b0ac2ecd61c60a6547', 'request_id': 'req-3c3c1aec-57ad-49d5-9710-6bb0779b9f4f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:49.957508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3c3c1aec-57ad-49d5-9710-6bb0779b9f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105467e1ea6242b0ac2ecd61c60a6547', 'request_id': 'req-3c3c1aec-57ad-49d5-9710-6bb0779b9f4f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:50.016912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-14ac4da8-6095-413e-9f89-8a90f950811b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f27d4e8c9924df68ef00aeb15137b81'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:50.028816 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-14ac4da8-6095-413e-9f89-8a90f950811b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f27d4e8c9924df68ef00aeb15137b81'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:50.029626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-14ac4da8-6095-413e-9f89-8a90f950811b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f27d4e8c9924df68ef00aeb15137b81'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:50.049179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-14ac4da8-6095-413e-9f89-8a90f950811b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f27d4e8c9924df68ef00aeb15137b81'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:50.057461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1022/2064] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:49 2022] DELETE /identity/v3/users/6f27d4e8c9924df68ef00aeb15137b81 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:50.058646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac4da8-6095-413e-9f89-8a90f950811b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.060187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-14ac4da8-6095-413e-9f89-8a90f950811b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:50.117968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3c3c1aec-57ad-49d5-9710-6bb0779b9f4f admin admin] The token cache is being invalidate because project 105467e1ea6242b0ac2ecd61c60a6547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:50.118567 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3c3c1aec-57ad-49d5-9710-6bb0779b9f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:50.119758 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3c3c1aec-57ad-49d5-9710-6bb0779b9f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:50.125070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1043/2065] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:49 2022] DELETE /identity/v3/projects/105467e1ea6242b0ac2ecd61c60a6547 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:50.132730 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64398f31-58c9-4af5-8f27-2789d4a62a06 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.133272 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64398f31-58c9-4af5-8f27-2789d4a62a06 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.133790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64398f31-58c9-4af5-8f27-2789d4a62a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.162294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-64398f31-58c9-4af5-8f27-2789d4a62a06 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:50.168663 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-64398f31-58c9-4af5-8f27-2789d4a62a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:50.193523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac4da8-6095-413e-9f89-8a90f950811b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.199037 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:50.204409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc29df3-9173-41a0-81cd-b37a8b204754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.206746 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc29df3-9173-41a0-81cd-b37a8b204754 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.207789 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc29df3-9173-41a0-81cd-b37a8b204754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.207789 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc29df3-9173-41a0-81cd-b37a8b204754 admin admin] PATH_INFO: `/v3/projects/eea1d736ad804ec9a903e5b4cb474e42/users/ec0b1c56749546e8bef6d4c33a7a5e07/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.211613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc29df3-9173-41a0-81cd-b37a8b204754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea1d736ad804ec9a903e5b4cb474e42, user_id=ec0b1c56749546e8bef6d4c33a7a5e07, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.217013 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc29df3-9173-41a0-81cd-b37a8b204754 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.257743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1023/2066] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:50 2022] PUT /identity/v3/projects/eea1d736ad804ec9a903e5b4cb474e42/users/ec0b1c56749546e8bef6d4c33a7a5e07/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:50.266891 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326aab7d-a69d-4794-8c29-767987abea13 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.266891 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326aab7d-a69d-4794-8c29-767987abea13 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.267405 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1044/2067] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:50.274673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326aab7d-a69d-4794-8c29-767987abea13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.290285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30848ad3-ec37-4a4c-9cee-ea4d1b682e8e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.290844 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30848ad3-ec37-4a4c-9cee-ea4d1b682e8e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.291344 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30848ad3-ec37-4a4c-9cee-ea4d1b682e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.327756 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-326aab7d-a69d-4794-8c29-767987abea13 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:50.331080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-326aab7d-a69d-4794-8c29-767987abea13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:50.353863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-30848ad3-ec37-4a4c-9cee-ea4d1b682e8e None None] MFA Rules not processed for user `ec0b1c56749546e8bef6d4c33a7a5e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:50.357901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-30848ad3-ec37-4a4c-9cee-ea4d1b682e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:50.440956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:50.504958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1024/2068] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:50.506889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326aab7d-a69d-4794-8c29-767987abea13 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.512095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-326aab7d-a69d-4794-8c29-767987abea13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:50.525971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1045/2069] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:41:50.533801 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d703-ca24-44b5-adea-b193e5d56e17 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.534114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d703-ca24-44b5-adea-b193e5d56e17 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.535073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d703-ca24-44b5-adea-b193e5d56e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.568202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-63d8d703-ca24-44b5-adea-b193e5d56e17 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:50.570581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-63d8d703-ca24-44b5-adea-b193e5d56e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:50.587794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1046/2070] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:50.595577 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8d703-ca24-44b5-adea-b193e5d56e17 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.602434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-63d8d703-ca24-44b5-adea-b193e5d56e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:50.637422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326aab7d-a69d-4794-8c29-767987abea13 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.644690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2aead-1169-4b02-abe7-d7c76b0890c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.645641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2aead-1169-4b02-abe7-d7c76b0890c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.645928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2aead-1169-4b02-abe7-d7c76b0890c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.646373 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2aead-1169-4b02-abe7-d7c76b0890c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.662085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2aead-1169-4b02-abe7-d7c76b0890c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.663725 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2aead-1169-4b02-abe7-d7c76b0890c8 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.678799 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1025/2071] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:50.678799 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2aead-1169-4b02-abe7-d7c76b0890c8 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.709373 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2aead-1169-4b02-abe7-d7c76b0890c8 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.716130 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfd0a6-a7e5-4a12-ba51-9b5f6c11517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.717451 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfd0a6-a7e5-4a12-ba51-9b5f6c11517a admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.717955 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfd0a6-a7e5-4a12-ba51-9b5f6c11517a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.718639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfd0a6-a7e5-4a12-ba51-9b5f6c11517a admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.719763 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfd0a6-a7e5-4a12-ba51-9b5f6c11517a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:50.720279 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfd0a6-a7e5-4a12-ba51-9b5f6c11517a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.723270 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfd0a6-a7e5-4a12-ba51-9b5f6c11517a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.740147 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8d703-ca24-44b5-adea-b193e5d56e17 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.747176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:50.753221 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1026/2072] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:50.761867 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfd0a6-a7e5-4a12-ba51-9b5f6c11517a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.762550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd677c8-251c-44ce-8f6f-345f3f21b920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.763853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd677c8-251c-44ce-8f6f-345f3f21b920 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.764381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd677c8-251c-44ce-8f6f-345f3f21b920 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.764880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd677c8-251c-44ce-8f6f-345f3f21b920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.769055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0dd677c8-251c-44ce-8f6f-345f3f21b920 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:50.787527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfd0a6-a7e5-4a12-ba51-9b5f6c11517a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.797149 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35210031-d0a9-45a1-8a81-397244cb36dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.798616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210031-d0a9-45a1-8a81-397244cb36dc admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.799077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210031-d0a9-45a1-8a81-397244cb36dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.799643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210031-d0a9-45a1-8a81-397244cb36dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.800933 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35210031-d0a9-45a1-8a81-397244cb36dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.806491 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35210031-d0a9-45a1-8a81-397244cb36dc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.920041 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd677c8-251c-44ce-8f6f-345f3f21b920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.921851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd677c8-251c-44ce-8f6f-345f3f21b920 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.933246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1047/2073] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:50.946794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1027/2074] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:50 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:41:50.955798 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd677c8-251c-44ce-8f6f-345f3f21b920 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.970745 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd677c8-251c-44ce-8f6f-345f3f21b920 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.082761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a352703-8605-44be-84e5-9e352f4bb648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.083453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a352703-8605-44be-84e5-9e352f4bb648 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.083735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a352703-8605-44be-84e5-9e352f4bb648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.084010 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a352703-8605-44be-84e5-9e352f4bb648 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.084779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a352703-8605-44be-84e5-9e352f4bb648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.087082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a352703-8605-44be-84e5-9e352f4bb648 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.093668 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:51.136064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35210031-d0a9-45a1-8a81-397244cb36dc admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.137954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-35210031-d0a9-45a1-8a81-397244cb36dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:51.159640 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:51.167874 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35210031-d0a9-45a1-8a81-397244cb36dc admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.175478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d2959-321d-4571-bdbf-d6b5df661205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.176337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2959-321d-4571-bdbf-d6b5df661205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.176670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2959-321d-4571-bdbf-d6b5df661205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.177037 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2959-321d-4571-bdbf-d6b5df661205 admin admin] PATH_INFO: `/v3/users/c0f693dc69014f3ca2e1158810e28802` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.178449 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d2959-321d-4571-bdbf-d6b5df661205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f693dc69014f3ca2e1158810e28802)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.180469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d2959-321d-4571-bdbf-d6b5df661205 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.225338 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1048/2075] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:50 2022] POST /identity/v3/users => generated 290 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:41:51.231691 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a352703-8605-44be-84e5-9e352f4bb648 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.247035 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a352703-8605-44be-84e5-9e352f4bb648 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.256350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cefe7-94d6-4093-afab-e42ba188a0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.257114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cefe7-94d6-4093-afab-e42ba188a0cd admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.258020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cefe7-94d6-4093-afab-e42ba188a0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.258366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cefe7-94d6-4093-afab-e42ba188a0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.259302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cefe7-94d6-4093-afab-e42ba188a0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.261916 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cefe7-94d6-4093-afab-e42ba188a0cd admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.286630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1049/2076] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:51.291190 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cefe7-94d6-4093-afab-e42ba188a0cd admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.303472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cefe7-94d6-4093-afab-e42ba188a0cd admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.308921 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ada5a-c84e-460d-a890-ec7d662e2672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.309618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ada5a-c84e-460d-a890-ec7d662e2672 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.310995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ada5a-c84e-460d-a890-ec7d662e2672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.310995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ada5a-c84e-460d-a890-ec7d662e2672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.311253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ada5a-c84e-460d-a890-ec7d662e2672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.313420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ada5a-c84e-460d-a890-ec7d662e2672 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.327897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1050/2077] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:41:51.335400 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ada5a-c84e-460d-a890-ec7d662e2672 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.358244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ada5a-c84e-460d-a890-ec7d662e2672 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.366475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d710a-bc09-40b7-9160-58601fa2cae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.367962 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d710a-bc09-40b7-9160-58601fa2cae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.368420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d710a-bc09-40b7-9160-58601fa2cae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.368868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d710a-bc09-40b7-9160-58601fa2cae0 admin admin] PATH_INFO: `/v3/projects/5c99faea63f04268b8ae7e7f9c9d9124/users/de0b90efb3484146ac0b8b1bbaafc053/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.389411 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d710a-bc09-40b7-9160-58601fa2cae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c99faea63f04268b8ae7e7f9c9d9124, user_id=de0b90efb3484146ac0b8b1bbaafc053, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.392822 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d710a-bc09-40b7-9160-58601fa2cae0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.458113 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bb4d2959-321d-4571-bdbf-d6b5df661205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f693dc69014f3ca2e1158810e28802'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:51.470193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1051/2078] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:51 2022] PUT /identity/v3/projects/5c99faea63f04268b8ae7e7f9c9d9124/users/de0b90efb3484146ac0b8b1bbaafc053/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:51.471851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d710a-bc09-40b7-9160-58601fa2cae0 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.475376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6a0d710a-bc09-40b7-9160-58601fa2cae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:51.545279 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bb4d2959-321d-4571-bdbf-d6b5df661205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f693dc69014f3ca2e1158810e28802'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:51.558468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bb4d2959-321d-4571-bdbf-d6b5df661205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f693dc69014f3ca2e1158810e28802'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:51.560070 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bb4d2959-321d-4571-bdbf-d6b5df661205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f693dc69014f3ca2e1158810e28802'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:51.593076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bb4d2959-321d-4571-bdbf-d6b5df661205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f693dc69014f3ca2e1158810e28802'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:51.605306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1028/2079] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:51 2022] DELETE /identity/v3/users/c0f693dc69014f3ca2e1158810e28802 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:51.607825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056310f6-2c03-4110-8337-0f741710ebd8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.608665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056310f6-2c03-4110-8337-0f741710ebd8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.627701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056310f6-2c03-4110-8337-0f741710ebd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.628176 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d710a-bc09-40b7-9160-58601fa2cae0 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.653573 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-056310f6-2c03-4110-8337-0f741710ebd8 None None] MFA Rules not processed for user `de0b90efb3484146ac0b8b1bbaafc053`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:51.655176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-056310f6-2c03-4110-8337-0f741710ebd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:51.664902 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:51.709033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b58eab-87f9-492d-a504-b28d36e6d17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.709938 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b58eab-87f9-492d-a504-b28d36e6d17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.710216 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b58eab-87f9-492d-a504-b28d36e6d17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.710644 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b58eab-87f9-492d-a504-b28d36e6d17c admin admin] PATH_INFO: `/v3/projects/f5104ec21457452392cca9b11dc290a5` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.711834 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b58eab-87f9-492d-a504-b28d36e6d17c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5104ec21457452392cca9b11dc290a5)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.716239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b58eab-87f9-492d-a504-b28d36e6d17c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.774772 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1029/2080] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:51.775989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5157b-0e12-4bef-a34a-b3939c429f9f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.776356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5157b-0e12-4bef-a34a-b3939c429f9f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.778902 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5157b-0e12-4bef-a34a-b3939c429f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.801695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-88f5157b-0e12-4bef-a34a-b3939c429f9f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:51.803184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-88f5157b-0e12-4bef-a34a-b3939c429f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:51.818164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1030/2081] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:51.818164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5157b-0e12-4bef-a34a-b3939c429f9f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.818164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-88f5157b-0e12-4bef-a34a-b3939c429f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:51.836861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5157b-0e12-4bef-a34a-b3939c429f9f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.846285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bfa33-8852-4ce9-ac10-f672d180bec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.847500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bfa33-8852-4ce9-ac10-f672d180bec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.848018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bfa33-8852-4ce9-ac10-f672d180bec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.848521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bfa33-8852-4ce9-ac10-f672d180bec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.849955 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bfa33-8852-4ce9-ac10-f672d180bec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.854696 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bfa33-8852-4ce9-ac10-f672d180bec0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.866484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d6b58eab-87f9-492d-a504-b28d36e6d17c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5104ec21457452392cca9b11dc290a5', 'request_id': 'req-d6b58eab-87f9-492d-a504-b28d36e6d17c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:51.889970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d6b58eab-87f9-492d-a504-b28d36e6d17c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5104ec21457452392cca9b11dc290a5', 'request_id': 'req-d6b58eab-87f9-492d-a504-b28d36e6d17c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:51.893224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:51.897071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d6b58eab-87f9-492d-a504-b28d36e6d17c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5104ec21457452392cca9b11dc290a5', 'request_id': 'req-d6b58eab-87f9-492d-a504-b28d36e6d17c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:51.964327 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1031/2082] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:51 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:51.970223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bfa33-8852-4ce9-ac10-f672d180bec0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.972202 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-690bfa33-8852-4ce9-ac10-f672d180bec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:51.996780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d6b58eab-87f9-492d-a504-b28d36e6d17c admin admin] The token cache is being invalidate because project f5104ec21457452392cca9b11dc290a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:51.997955 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d6b58eab-87f9-492d-a504-b28d36e6d17c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:51.999246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d6b58eab-87f9-492d-a504-b28d36e6d17c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:52.002198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1052/2083] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:51 2022] DELETE /identity/v3/projects/f5104ec21457452392cca9b11dc290a5 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:52.004436 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b58eab-87f9-492d-a504-b28d36e6d17c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:52.007246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d6b58eab-87f9-492d-a504-b28d36e6d17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:52.076053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bfa33-8852-4ce9-ac10-f672d180bec0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:52.083516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f7cbe-8e64-4abf-964c-93dc6b89975c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:52.084707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f7cbe-8e64-4abf-964c-93dc6b89975c service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:52.085357 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f7cbe-8e64-4abf-964c-93dc6b89975c service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:52.085866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f7cbe-8e64-4abf-964c-93dc6b89975c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:52.089311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-109f7cbe-8e64-4abf-964c-93dc6b89975c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:52.117508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b58eab-87f9-492d-a504-b28d36e6d17c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:52.224701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f7cbe-8e64-4abf-964c-93dc6b89975c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:52.226487 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f7cbe-8e64-4abf-964c-93dc6b89975c service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:52.244008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae177ad-4fd9-41c9-b376-5f1361265581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:52.246581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae177ad-4fd9-41c9-b376-5f1361265581 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:52.246581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae177ad-4fd9-41c9-b376-5f1361265581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:52.246581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae177ad-4fd9-41c9-b376-5f1361265581 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:52.248068 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae177ad-4fd9-41c9-b376-5f1361265581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:52.252782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae177ad-4fd9-41c9-b376-5f1361265581 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:52.254606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1032/2084] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:52.255186 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f7cbe-8e64-4abf-964c-93dc6b89975c service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:52.261165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-109f7cbe-8e64-4abf-964c-93dc6b89975c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:52.288473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f7cbe-8e64-4abf-964c-93dc6b89975c service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:52.297839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c716ce-36e3-46b4-883a-ca200bf073d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:52.301571 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c716ce-36e3-46b4-883a-ca200bf073d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:52.302849 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c716ce-36e3-46b4-883a-ca200bf073d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:52.304368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c716ce-36e3-46b4-883a-ca200bf073d8 admin admin] PATH_INFO: `/v3/users/d69cc1a0ae30457383b00758286714dc` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:52.308183 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:52.309929 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c716ce-36e3-46b4-883a-ca200bf073d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69cc1a0ae30457383b00758286714dc)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:52.314679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c716ce-36e3-46b4-883a-ca200bf073d8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:52.356502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:52.374529 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1053/2085] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:52 2022] POST /identity/v3/users => generated 290 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:52.376293 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae177ad-4fd9-41c9-b376-5f1361265581 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:52.390765 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae177ad-4fd9-41c9-b376-5f1361265581 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:52.404840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c7bce-c663-41d6-ae75-9a6a774bb711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:52.404840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c7bce-c663-41d6-ae75-9a6a774bb711 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:52.404840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c7bce-c663-41d6-ae75-9a6a774bb711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:52.404840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c7bce-c663-41d6-ae75-9a6a774bb711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:52.405366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c7bce-c663-41d6-ae75-9a6a774bb711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:52.405366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c7bce-c663-41d6-ae75-9a6a774bb711 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:52.433421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1054/2086] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:52.440625 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c7bce-c663-41d6-ae75-9a6a774bb711 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:52.462648 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c7bce-c663-41d6-ae75-9a6a774bb711 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:52.473426 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be6d96-3f1e-4f85-8a1d-e759225307fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:52.481378 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be6d96-3f1e-4f85-8a1d-e759225307fc admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:52.481695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be6d96-3f1e-4f85-8a1d-e759225307fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:52.482488 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be6d96-3f1e-4f85-8a1d-e759225307fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:52.484314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be6d96-3f1e-4f85-8a1d-e759225307fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:52.490865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be6d96-3f1e-4f85-8a1d-e759225307fc admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:52.526401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1055/2087] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:52.535254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be6d96-3f1e-4f85-8a1d-e759225307fc admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:52.560573 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be6d96-3f1e-4f85-8a1d-e759225307fc admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:52.569482 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b0f75-02e2-4fb0-a36a-204022dccd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:52.570022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b0f75-02e2-4fb0-a36a-204022dccd04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:52.570344 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b0f75-02e2-4fb0-a36a-204022dccd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:52.570701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b0f75-02e2-4fb0-a36a-204022dccd04 admin admin] PATH_INFO: `/v3/projects/d4009f4fd41a4b24be7b46eda3b35775/users/19ebefbffbd7485f96bc6072c4e2fb49/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:52.591781 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b0f75-02e2-4fb0-a36a-204022dccd04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4009f4fd41a4b24be7b46eda3b35775, user_id=19ebefbffbd7485f96bc6072c4e2fb49, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:52.595756 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b0f75-02e2-4fb0-a36a-204022dccd04 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:52.634829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-67c716ce-36e3-46b4-883a-ca200bf073d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69cc1a0ae30457383b00758286714dc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:52.733477 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1056/2088] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:52 2022] PUT /identity/v3/projects/d4009f4fd41a4b24be7b46eda3b35775/users/19ebefbffbd7485f96bc6072c4e2fb49/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:52.754858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5900294-7171-4b83-8017-ef73c81f5684 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:52.755897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5900294-7171-4b83-8017-ef73c81f5684 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:52.756698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5900294-7171-4b83-8017-ef73c81f5684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:52.788818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-67c716ce-36e3-46b4-883a-ca200bf073d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69cc1a0ae30457383b00758286714dc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:52.802565 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-67c716ce-36e3-46b4-883a-ca200bf073d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69cc1a0ae30457383b00758286714dc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:52.803379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-67c716ce-36e3-46b4-883a-ca200bf073d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69cc1a0ae30457383b00758286714dc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:52.811732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b5900294-7171-4b83-8017-ef73c81f5684 None None] MFA Rules not processed for user `19ebefbffbd7485f96bc6072c4e2fb49`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:52.814190 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b5900294-7171-4b83-8017-ef73c81f5684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:52.831725 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-67c716ce-36e3-46b4-883a-ca200bf073d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69cc1a0ae30457383b00758286714dc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:52.866594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1033/2089] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:52 2022] DELETE /identity/v3/users/d69cc1a0ae30457383b00758286714dc => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:52.949945 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1057/2090] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:41:52.955714 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c716ce-36e3-46b4-883a-ca200bf073d8 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:52.963074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-67c716ce-36e3-46b4-883a-ca200bf073d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:53.083844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c716ce-36e3-46b4-883a-ca200bf073d8 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:53.092950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f766294-910f-47a1-9aee-6c72f0915e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:53.093769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f766294-910f-47a1-9aee-6c72f0915e31 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:53.094136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f766294-910f-47a1-9aee-6c72f0915e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:53.095177 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f766294-910f-47a1-9aee-6c72f0915e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:53.096183 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f766294-910f-47a1-9aee-6c72f0915e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:53.098825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f766294-910f-47a1-9aee-6c72f0915e31 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:53.108163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:53.207713 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:53.255982 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1034/2091] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:52 2022] POST /identity/v3/projects => generated 377 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:53.260136 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5900294-7171-4b83-8017-ef73c81f5684 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:53.359292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5900294-7171-4b83-8017-ef73c81f5684 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:53.476774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5927ed-a19f-4a8a-8526-a9a21d32dc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:53.477475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5927ed-a19f-4a8a-8526-a9a21d32dc0a admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:53.477840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5927ed-a19f-4a8a-8526-a9a21d32dc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:53.478095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5927ed-a19f-4a8a-8526-a9a21d32dc0a admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:53.478859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5927ed-a19f-4a8a-8526-a9a21d32dc0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:53.481350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5927ed-a19f-4a8a-8526-a9a21d32dc0a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:53.580230 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f766294-910f-47a1-9aee-6c72f0915e31 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:53.582812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7f766294-910f-47a1-9aee-6c72f0915e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:53.603316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1058/2092] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:53 2022] POST /identity/v3/users => generated 295 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:41:53.610007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5927ed-a19f-4a8a-8526-a9a21d32dc0a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:53.615152 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f766294-910f-47a1-9aee-6c72f0915e31 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:53.630239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:53.632298 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:53.633179 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:53.635818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048 admin admin] PATH_INFO: `/v3/projects/488ab7a9b1f04ad09bedf464c9f3ebb2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:53.648378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488ab7a9b1f04ad09bedf464c9f3ebb2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:53.651308 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5927ed-a19f-4a8a-8526-a9a21d32dc0a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:53.652167 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:53.661987 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4d68-8d27-40d8-b2cc-c38ea45beaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:53.663187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4d68-8d27-40d8-b2cc-c38ea45beaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:53.663667 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4d68-8d27-40d8-b2cc-c38ea45beaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:53.664144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4d68-8d27-40d8-b2cc-c38ea45beaf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:53.666639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc4d68-8d27-40d8-b2cc-c38ea45beaf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:53.671469 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc4d68-8d27-40d8-b2cc-c38ea45beaf3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:53.698378 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1059/2093] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:53.703298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4d68-8d27-40d8-b2cc-c38ea45beaf3 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:53.726781 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4d68-8d27-40d8-b2cc-c38ea45beaf3 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:53.734913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4349b2-e0ff-4060-8a4b-46e7e39a024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:53.736670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4349b2-e0ff-4060-8a4b-46e7e39a024a admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:53.736960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4349b2-e0ff-4060-8a4b-46e7e39a024a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:53.737235 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4349b2-e0ff-4060-8a4b-46e7e39a024a admin admin] PATH_INFO: `/v3/projects/741284cc949a46329624eef1adea2771/users/206fdb91bc084353809c3c19f1e029c8/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:53.762678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4349b2-e0ff-4060-8a4b-46e7e39a024a admin admin] RBAC: Authorizing `identity:create_grant(project_id=741284cc949a46329624eef1adea2771, user_id=206fdb91bc084353809c3c19f1e029c8, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:53.768745 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4349b2-e0ff-4060-8a4b-46e7e39a024a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:53.918502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1060/2094] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:53 2022] PUT /identity/v3/projects/741284cc949a46329624eef1adea2771/users/206fdb91bc084353809c3c19f1e029c8/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:53.919947 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4349b2-e0ff-4060-8a4b-46e7e39a024a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:53.926841 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fb4349b2-e0ff-4060-8a4b-46e7e39a024a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:53.932946 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488ab7a9b1f04ad09bedf464c9f3ebb2', 'request_id': 'req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:53.947552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488ab7a9b1f04ad09bedf464c9f3ebb2', 'request_id': 'req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:53.990287 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488ab7a9b1f04ad09bedf464c9f3ebb2', 'request_id': 'req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.062460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4349b2-e0ff-4060-8a4b-46e7e39a024a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:54.109274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048 admin admin] The token cache is being invalidate because project 488ab7a9b1f04ad09bedf464c9f3ebb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:54.111045 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.113947 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.120947 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1035/2095] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:53 2022] DELETE /identity/v3/projects/488ab7a9b1f04ad09bedf464c9f3ebb2 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:54.123389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:54.130848 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:54.154688 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08799f1-db93-4122-9ca3-e172fda93830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:54.155581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08799f1-db93-4122-9ca3-e172fda93830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:54.155869 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08799f1-db93-4122-9ca3-e172fda93830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:54.156149 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08799f1-db93-4122-9ca3-e172fda93830 admin admin] PATH_INFO: `/v3/projects/299b0ffd71c24478beb3aa1c11b97e53` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:54.158419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08799f1-db93-4122-9ca3-e172fda93830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=299b0ffd71c24478beb3aa1c11b97e53)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:54.167172 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08799f1-db93-4122-9ca3-e172fda93830 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:54.235313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee393a-f0f3-494b-99f0-9a0c9e4a2048 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:54.243049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4365b9c-0a19-4720-a8d0-70451485a714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:54.244222 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4365b9c-0a19-4720-a8d0-70451485a714 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:54.246098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4365b9c-0a19-4720-a8d0-70451485a714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:54.247943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4365b9c-0a19-4720-a8d0-70451485a714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:54.253191 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4365b9c-0a19-4720-a8d0-70451485a714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:54.256263 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4365b9c-0a19-4720-a8d0-70451485a714 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:54.278208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1036/2096] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:54.279767 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4365b9c-0a19-4720-a8d0-70451485a714 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:54.288494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b4365b9c-0a19-4720-a8d0-70451485a714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:54.307119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4365b9c-0a19-4720-a8d0-70451485a714 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:54.314164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2529baf-c540-420a-9cf0-5fb9ff855ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:54.315200 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2529baf-c540-420a-9cf0-5fb9ff855ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:54.315487 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2529baf-c540-420a-9cf0-5fb9ff855ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:54.315878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2529baf-c540-420a-9cf0-5fb9ff855ec8 admin admin] PATH_INFO: `/v3/users/37fca0d9e6b3455e8ff57cf6cd60f8fe` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:54.317259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2529baf-c540-420a-9cf0-5fb9ff855ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37fca0d9e6b3455e8ff57cf6cd60f8fe)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:54.319567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2529baf-c540-420a-9cf0-5fb9ff855ec8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:54.370097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f08799f1-db93-4122-9ca3-e172fda93830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299b0ffd71c24478beb3aa1c11b97e53', 'request_id': 'req-f08799f1-db93-4122-9ca3-e172fda93830'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.383121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f08799f1-db93-4122-9ca3-e172fda93830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299b0ffd71c24478beb3aa1c11b97e53', 'request_id': 'req-f08799f1-db93-4122-9ca3-e172fda93830'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.395385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f08799f1-db93-4122-9ca3-e172fda93830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299b0ffd71c24478beb3aa1c11b97e53', 'request_id': 'req-f08799f1-db93-4122-9ca3-e172fda93830'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.475386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f08799f1-db93-4122-9ca3-e172fda93830 admin admin] The token cache is being invalidate because project 299b0ffd71c24478beb3aa1c11b97e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:54.475386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f08799f1-db93-4122-9ca3-e172fda93830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.481416 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f08799f1-db93-4122-9ca3-e172fda93830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.483765 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1061/2097] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:53 2022] DELETE /identity/v3/projects/299b0ffd71c24478beb3aa1c11b97e53 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:54.484906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08799f1-db93-4122-9ca3-e172fda93830 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:54.491425 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f08799f1-db93-4122-9ca3-e172fda93830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:54.556280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:54.571836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d2529baf-c540-420a-9cf0-5fb9ff855ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37fca0d9e6b3455e8ff57cf6cd60f8fe'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.658829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d2529baf-c540-420a-9cf0-5fb9ff855ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37fca0d9e6b3455e8ff57cf6cd60f8fe'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.678732 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d2529baf-c540-420a-9cf0-5fb9ff855ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37fca0d9e6b3455e8ff57cf6cd60f8fe'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.680431 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d2529baf-c540-420a-9cf0-5fb9ff855ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37fca0d9e6b3455e8ff57cf6cd60f8fe'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.716164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d2529baf-c540-420a-9cf0-5fb9ff855ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37fca0d9e6b3455e8ff57cf6cd60f8fe'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.719911 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08799f1-db93-4122-9ca3-e172fda93830 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:54.733852 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1037/2098] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:54 2022] DELETE /identity/v3/users/37fca0d9e6b3455e8ff57cf6cd60f8fe => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:54.736737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:54.739760 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280d4d1-20fc-461e-9f7a-bbfb90169a8a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:54.740279 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280d4d1-20fc-461e-9f7a-bbfb90169a8a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:54.744195 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ccc24-c2a2-4e41-80b5-55e850ecd636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:54.746833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280d4d1-20fc-461e-9f7a-bbfb90169a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:54.747805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ccc24-c2a2-4e41-80b5-55e850ecd636 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:54.748427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ccc24-c2a2-4e41-80b5-55e850ecd636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:54.748949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ccc24-c2a2-4e41-80b5-55e850ecd636 admin admin] PATH_INFO: `/v3/projects/741284cc949a46329624eef1adea2771/users/206fdb91bc084353809c3c19f1e029c8/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:54.764868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ccc24-c2a2-4e41-80b5-55e850ecd636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=741284cc949a46329624eef1adea2771, user_id=206fdb91bc084353809c3c19f1e029c8, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:54.768830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ccc24-c2a2-4e41-80b5-55e850ecd636 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:54.785800 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b280d4d1-20fc-461e-9f7a-bbfb90169a8a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:54.791381 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b280d4d1-20fc-461e-9f7a-bbfb90169a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:54.798401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1062/2099] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:54 2022] PUT /identity/v3/projects/741284cc949a46329624eef1adea2771/users/206fdb91bc084353809c3c19f1e029c8/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:54.798401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ccc24-c2a2-4e41-80b5-55e850ecd636 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:54.804877 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-753ccc24-c2a2-4e41-80b5-55e850ecd636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:54.942693 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1038/2100] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:54.945613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58f7ba-c627-4b16-9733-b8d70f122393 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:54.946493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58f7ba-c627-4b16-9733-b8d70f122393 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:54.947018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58f7ba-c627-4b16-9733-b8d70f122393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:54.983817 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ccc24-c2a2-4e41-80b5-55e850ecd636 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:54.992979 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e051de-a0a8-47ce-b8aa-70f2e800db49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:54.994547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e051de-a0a8-47ce-b8aa-70f2e800db49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:54.995229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e051de-a0a8-47ce-b8aa-70f2e800db49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:54.995655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e051de-a0a8-47ce-b8aa-70f2e800db49 admin admin] PATH_INFO: `/v3/users/4363a5c6920244e29060a300949b5ed0` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:54.998931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e051de-a0a8-47ce-b8aa-70f2e800db49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4363a5c6920244e29060a300949b5ed0)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:55.002514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ef58f7ba-c627-4b16-9733-b8d70f122393 None None] MFA Rules not processed for user `206fdb91bc084353809c3c19f1e029c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:55.008974 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e051de-a0a8-47ce-b8aa-70f2e800db49 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:55.009262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ef58f7ba-c627-4b16-9733-b8d70f122393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:55.119180 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1039/2101] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:55.121758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31c49-2ebf-44fd-b4eb-c052fb83447c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:55.121758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31c49-2ebf-44fd-b4eb-c052fb83447c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:55.122540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31c49-2ebf-44fd-b4eb-c052fb83447c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:55.166688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d2a31c49-2ebf-44fd-b4eb-c052fb83447c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:55.174642 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d2a31c49-2ebf-44fd-b4eb-c052fb83447c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:55.185817 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1040/2102] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:55.188327 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31c49-2ebf-44fd-b4eb-c052fb83447c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:55.192609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d2a31c49-2ebf-44fd-b4eb-c052fb83447c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:55.265665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-39e051de-a0a8-47ce-b8aa-70f2e800db49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4363a5c6920244e29060a300949b5ed0'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:55.311709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31c49-2ebf-44fd-b4eb-c052fb83447c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:55.319074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3a0a0-1d8f-4060-9b8e-686c214fbfcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:55.320251 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3a0a0-1d8f-4060-9b8e-686c214fbfcf service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:55.320764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3a0a0-1d8f-4060-9b8e-686c214fbfcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:55.321278 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3a0a0-1d8f-4060-9b8e-686c214fbfcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:55.341048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3a0a0-1d8f-4060-9b8e-686c214fbfcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:55.346252 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3a0a0-1d8f-4060-9b8e-686c214fbfcf service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:55.374226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1041/2103] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:55.376547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3a0a0-1d8f-4060-9b8e-686c214fbfcf service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:55.384472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-39e051de-a0a8-47ce-b8aa-70f2e800db49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4363a5c6920244e29060a300949b5ed0'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:55.405032 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3a0a0-1d8f-4060-9b8e-686c214fbfcf service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:55.410381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-39e051de-a0a8-47ce-b8aa-70f2e800db49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4363a5c6920244e29060a300949b5ed0'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:55.413663 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-39e051de-a0a8-47ce-b8aa-70f2e800db49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4363a5c6920244e29060a300949b5ed0'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:55.420883 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae31430-446e-4470-8388-93e12a230d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:55.422042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae31430-446e-4470-8388-93e12a230d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:55.423862 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae31430-446e-4470-8388-93e12a230d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:55.424376 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae31430-446e-4470-8388-93e12a230d4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:55.427265 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae31430-446e-4470-8388-93e12a230d4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:55.427861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae31430-446e-4470-8388-93e12a230d4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:55.431046 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae31430-446e-4470-8388-93e12a230d4d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:55.451275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1042/2104] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:55.457715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae31430-446e-4470-8388-93e12a230d4d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:55.462927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6ae31430-446e-4470-8388-93e12a230d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:55.465136 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-39e051de-a0a8-47ce-b8aa-70f2e800db49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4363a5c6920244e29060a300949b5ed0'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:55.477155 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1063/2105] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:54 2022] DELETE /identity/v3/users/4363a5c6920244e29060a300949b5ed0 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:55.485164 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74107a9-b2f7-4497-889b-a3131e63c94a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:55.486112 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74107a9-b2f7-4497-889b-a3131e63c94a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:55.486265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74107a9-b2f7-4497-889b-a3131e63c94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:55.509168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae31430-446e-4470-8388-93e12a230d4d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:55.525655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a74107a9-b2f7-4497-889b-a3131e63c94a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:55.528577 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a74107a9-b2f7-4497-889b-a3131e63c94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:55.550282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:55.633364 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:55.675249 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1064/2106] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:55.677247 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74107a9-b2f7-4497-889b-a3131e63c94a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:55.680272 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a74107a9-b2f7-4497-889b-a3131e63c94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:55.723755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567dd59-3cd2-4e8f-b54b-91e5fedba399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:55.724602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567dd59-3cd2-4e8f-b54b-91e5fedba399 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:55.724802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567dd59-3cd2-4e8f-b54b-91e5fedba399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:55.725215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567dd59-3cd2-4e8f-b54b-91e5fedba399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:55.726153 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567dd59-3cd2-4e8f-b54b-91e5fedba399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:55.728407 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567dd59-3cd2-4e8f-b54b-91e5fedba399 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:55.817442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74107a9-b2f7-4497-889b-a3131e63c94a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:55.822693 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261feade-d35d-48ff-9611-24780d3e7424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:55.823842 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261feade-d35d-48ff-9611-24780d3e7424 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:55.824334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261feade-d35d-48ff-9611-24780d3e7424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:55.824831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261feade-d35d-48ff-9611-24780d3e7424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:55.833820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-261feade-d35d-48ff-9611-24780d3e7424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:55.892015 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1043/2107] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:55 2022] POST /identity/v3/projects => generated 409 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:55.893317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567dd59-3cd2-4e8f-b54b-91e5fedba399 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:55.900964 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b567dd59-3cd2-4e8f-b54b-91e5fedba399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:55.950577 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261feade-d35d-48ff-9611-24780d3e7424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:55.953804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261feade-d35d-48ff-9611-24780d3e7424 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:55.974805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1065/2108] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:56.002808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261feade-d35d-48ff-9611-24780d3e7424 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:56.031236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261feade-d35d-48ff-9611-24780d3e7424 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:56.132584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567dd59-3cd2-4e8f-b54b-91e5fedba399 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:56.137752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab07277-8f97-4695-a4fb-89153972aa02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:56.144011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab07277-8f97-4695-a4fb-89153972aa02 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:56.144011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab07277-8f97-4695-a4fb-89153972aa02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:56.144011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab07277-8f97-4695-a4fb-89153972aa02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:56.175143 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382339e9-ef49-428c-9084-2ecc010f5a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:56.176305 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382339e9-ef49-428c-9084-2ecc010f5a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:56.176823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382339e9-ef49-428c-9084-2ecc010f5a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:56.177828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382339e9-ef49-428c-9084-2ecc010f5a25 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:56.179351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382339e9-ef49-428c-9084-2ecc010f5a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:56.182216 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382339e9-ef49-428c-9084-2ecc010f5a25 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:56.239830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:56.326737 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab07277-8f97-4695-a4fb-89153972aa02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:56.329302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab07277-8f97-4695-a4fb-89153972aa02 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:56.341130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1066/2109] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:55 2022] POST /identity/v3/users => generated 305 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:56.342815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382339e9-ef49-428c-9084-2ecc010f5a25 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:56.348797 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-382339e9-ef49-428c-9084-2ecc010f5a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:56.362367 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1044/2110] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:56.363526 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab07277-8f97-4695-a4fb-89153972aa02 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:56.376482 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382339e9-ef49-428c-9084-2ecc010f5a25 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:56.388405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab07277-8f97-4695-a4fb-89153972aa02 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:56.394290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf9988-e680-43d6-98c6-0a4537262367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:56.398599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf9988-e680-43d6-98c6-0a4537262367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:56.399963 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf9988-e680-43d6-98c6-0a4537262367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:56.402364 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf9988-e680-43d6-98c6-0a4537262367 admin admin] PATH_INFO: `/v3/projects/31510ebe134a4e8cb7369a4193333f04` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:56.403333 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570b8fb-5977-4fed-b78e-87743cddb590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:56.404329 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570b8fb-5977-4fed-b78e-87743cddb590 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:56.404781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570b8fb-5977-4fed-b78e-87743cddb590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:56.405225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570b8fb-5977-4fed-b78e-87743cddb590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:56.407625 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf9988-e680-43d6-98c6-0a4537262367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31510ebe134a4e8cb7369a4193333f04)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:56.408562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570b8fb-5977-4fed-b78e-87743cddb590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:56.410760 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570b8fb-5977-4fed-b78e-87743cddb590 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:56.414092 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf9988-e680-43d6-98c6-0a4537262367 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:56.443595 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1045/2111] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:56.447763 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570b8fb-5977-4fed-b78e-87743cddb590 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:56.474422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570b8fb-5977-4fed-b78e-87743cddb590 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:56.480950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dd723-41ea-4e59-96d2-1c276c412aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:56.481687 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dd723-41ea-4e59-96d2-1c276c412aea admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:56.482005 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dd723-41ea-4e59-96d2-1c276c412aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:56.482453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dd723-41ea-4e59-96d2-1c276c412aea admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:56.483164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dd723-41ea-4e59-96d2-1c276c412aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:56.486512 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dd723-41ea-4e59-96d2-1c276c412aea admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:56.502282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1046/2112] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:56.506875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dd723-41ea-4e59-96d2-1c276c412aea admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:56.524174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dd723-41ea-4e59-96d2-1c276c412aea admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:56.544712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f3d7f-df8f-4e98-aa23-c545b32a099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:56.546152 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f3d7f-df8f-4e98-aa23-c545b32a099a admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:56.546152 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f3d7f-df8f-4e98-aa23-c545b32a099a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:56.546660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f3d7f-df8f-4e98-aa23-c545b32a099a admin admin] PATH_INFO: `/v3/projects/3fbcccaf6561411b8ed955d89cc94e7b/users/b08f79b30b21410cad0415efee3be014/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:56.573901 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f3d7f-df8f-4e98-aa23-c545b32a099a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fbcccaf6561411b8ed955d89cc94e7b, user_id=b08f79b30b21410cad0415efee3be014, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:56.577238 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f3d7f-df8f-4e98-aa23-c545b32a099a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:56.733138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:56.739899 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1047/2113] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:56 2022] PUT /identity/v3/projects/3fbcccaf6561411b8ed955d89cc94e7b/users/b08f79b30b21410cad0415efee3be014/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:56.756378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbce2b-dc3c-4b73-951b-10f27b68fa7e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:56.757658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbce2b-dc3c-4b73-951b-10f27b68fa7e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:56.759203 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbce2b-dc3c-4b73-951b-10f27b68fa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:56.807233 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-00cf9988-e680-43d6-98c6-0a4537262367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31510ebe134a4e8cb7369a4193333f04', 'request_id': 'req-00cf9988-e680-43d6-98c6-0a4537262367'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:56.822885 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-00cf9988-e680-43d6-98c6-0a4537262367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31510ebe134a4e8cb7369a4193333f04', 'request_id': 'req-00cf9988-e680-43d6-98c6-0a4537262367'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:56.833954 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-00cf9988-e680-43d6-98c6-0a4537262367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31510ebe134a4e8cb7369a4193333f04', 'request_id': 'req-00cf9988-e680-43d6-98c6-0a4537262367'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:56.849903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-79dbce2b-dc3c-4b73-951b-10f27b68fa7e None None] MFA Rules not processed for user `b08f79b30b21410cad0415efee3be014`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:56.851372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-79dbce2b-dc3c-4b73-951b-10f27b68fa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:56.945751 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-00cf9988-e680-43d6-98c6-0a4537262367 admin admin] The token cache is being invalidate because project 31510ebe134a4e8cb7369a4193333f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:56.946986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-00cf9988-e680-43d6-98c6-0a4537262367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:56.947858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-00cf9988-e680-43d6-98c6-0a4537262367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:56.958748 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1067/2114] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:56 2022] DELETE /identity/v3/projects/31510ebe134a4e8cb7369a4193333f04 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:56.958748 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1d63-93f8-4ebe-9ec9-13d628291d37 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:56.958748 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1d63-93f8-4ebe-9ec9-13d628291d37 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:56.958748 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1d63-93f8-4ebe-9ec9-13d628291d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:56.995645 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-224e1d63-93f8-4ebe-9ec9-13d628291d37 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:56.997308 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-224e1d63-93f8-4ebe-9ec9-13d628291d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:57.101954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1048/2115] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:57.104900 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbce2b-dc3c-4b73-951b-10f27b68fa7e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:57.108094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-79dbce2b-dc3c-4b73-951b-10f27b68fa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:57.171284 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1068/2116] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:41:57.181090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b63ad-89a7-45eb-8b92-aad985db608e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:57.181416 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b63ad-89a7-45eb-8b92-aad985db608e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:57.181703 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b63ad-89a7-45eb-8b92-aad985db608e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:57.235811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a39b63ad-89a7-45eb-8b92-aad985db608e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:57.242600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a39b63ad-89a7-45eb-8b92-aad985db608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:57.269753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1069/2117] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:57.275705 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b63ad-89a7-45eb-8b92-aad985db608e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:57.294418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b63ad-89a7-45eb-8b92-aad985db608e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:57.309449 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbce2b-dc3c-4b73-951b-10f27b68fa7e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:57.318891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cc548-38ec-41c6-9f4a-526f74c66694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:57.319478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cc548-38ec-41c6-9f4a-526f74c66694 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:57.319773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cc548-38ec-41c6-9f4a-526f74c66694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:57.320235 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cc548-38ec-41c6-9f4a-526f74c66694 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:57.320984 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cc548-38ec-41c6-9f4a-526f74c66694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:57.321302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cc548-38ec-41c6-9f4a-526f74c66694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:57.323069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cc548-38ec-41c6-9f4a-526f74c66694 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:57.323734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111954e-7004-4e00-887d-a15353ac9c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:57.325193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111954e-7004-4e00-887d-a15353ac9c25 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:57.325926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111954e-7004-4e00-887d-a15353ac9c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:57.326780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111954e-7004-4e00-887d-a15353ac9c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:57.346864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111954e-7004-4e00-887d-a15353ac9c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:57.360242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111954e-7004-4e00-887d-a15353ac9c25 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:57.381489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1070/2118] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:57.393269 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cc548-38ec-41c6-9f4a-526f74c66694 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:57.433495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cc548-38ec-41c6-9f4a-526f74c66694 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:57.446097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660a101-74de-4d22-998f-9dc49c1d3d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:57.447515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660a101-74de-4d22-998f-9dc49c1d3d92 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:57.447810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660a101-74de-4d22-998f-9dc49c1d3d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:57.448228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660a101-74de-4d22-998f-9dc49c1d3d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:57.449490 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660a101-74de-4d22-998f-9dc49c1d3d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:57.451690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660a101-74de-4d22-998f-9dc49c1d3d92 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:57.578085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1049/2119] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:57 2022] POST /identity/v3/projects => generated 407 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:57.580446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111954e-7004-4e00-887d-a15353ac9c25 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:57.600112 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1071/2120] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:57 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:57.607412 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660a101-74de-4d22-998f-9dc49c1d3d92 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:57.676805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:57.771311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660a101-74de-4d22-998f-9dc49c1d3d92 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:57.780328 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062304d3-1410-4c18-a58e-4e05f176fee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:57.782681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062304d3-1410-4c18-a58e-4e05f176fee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:57.784274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062304d3-1410-4c18-a58e-4e05f176fee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:57.784854 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062304d3-1410-4c18-a58e-4e05f176fee0 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:57.785920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062304d3-1410-4c18-a58e-4e05f176fee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:57.788584 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062304d3-1410-4c18-a58e-4e05f176fee0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:57.815022 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111954e-7004-4e00-887d-a15353ac9c25 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:57.829021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f9581-aa6e-4012-879e-c7ad730b6660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:57.830474 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9581-aa6e-4012-879e-c7ad730b6660 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:57.831595 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9581-aa6e-4012-879e-c7ad730b6660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:57.832029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9581-aa6e-4012-879e-c7ad730b6660 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:57.832906 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f9581-aa6e-4012-879e-c7ad730b6660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:57.835409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f9581-aa6e-4012-879e-c7ad730b6660 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:57.950268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1050/2121] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:57 2022] POST /identity/v3/users => generated 310 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:57.956046 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f9581-aa6e-4012-879e-c7ad730b6660 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:57.961814 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1072/2122] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:57 2022] POST /identity/v3/users => generated 294 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:57.961814 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062304d3-1410-4c18-a58e-4e05f176fee0 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:57.967325 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-294f9581-aa6e-4012-879e-c7ad730b6660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:57.983572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062304d3-1410-4c18-a58e-4e05f176fee0 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:57.989706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f9581-aa6e-4012-879e-c7ad730b6660 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:57.996079 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750ece2-6072-4e87-8890-14f12111785c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:57.996996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750ece2-6072-4e87-8890-14f12111785c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:57.997285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750ece2-6072-4e87-8890-14f12111785c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:57.997582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750ece2-6072-4e87-8890-14f12111785c admin admin] PATH_INFO: `/v3/projects/0b19b4d4f73f486ba6a9051f4472720b` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:57.997955 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77211d-aa5e-4717-be64-265b9b61a86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:57.999111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750ece2-6072-4e87-8890-14f12111785c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b19b4d4f73f486ba6a9051f4472720b)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:58.000273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77211d-aa5e-4717-be64-265b9b61a86a admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:58.000792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77211d-aa5e-4717-be64-265b9b61a86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:58.001419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77211d-aa5e-4717-be64-265b9b61a86a admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:58.001681 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750ece2-6072-4e87-8890-14f12111785c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:58.003904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77211d-aa5e-4717-be64-265b9b61a86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:58.008858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77211d-aa5e-4717-be64-265b9b61a86a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:58.048150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1073/2123] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:58.049632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77211d-aa5e-4717-be64-265b9b61a86a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:58.066219 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77211d-aa5e-4717-be64-265b9b61a86a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:58.073958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24c9d7-c4bb-4fbd-887f-397f6e89ad3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:58.074901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24c9d7-c4bb-4fbd-887f-397f6e89ad3b admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:58.075215 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24c9d7-c4bb-4fbd-887f-397f6e89ad3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:58.075537 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24c9d7-c4bb-4fbd-887f-397f6e89ad3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:58.076679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24c9d7-c4bb-4fbd-887f-397f6e89ad3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:58.079147 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24c9d7-c4bb-4fbd-887f-397f6e89ad3b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:58.092189 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1074/2124] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:58.093033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24c9d7-c4bb-4fbd-887f-397f6e89ad3b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:58.104970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24c9d7-c4bb-4fbd-887f-397f6e89ad3b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:58.110724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fb6fa-cb58-4461-91e3-0e67c5323e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:58.111634 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fb6fa-cb58-4461-91e3-0e67c5323e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:58.111912 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fb6fa-cb58-4461-91e3-0e67c5323e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:58.112290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fb6fa-cb58-4461-91e3-0e67c5323e81 admin admin] PATH_INFO: `/v3/projects/8cca9cb830ef4a86b1fc24a5fb8a50d5/users/d9fce56bbe5f4f53beaeeb81e91d947c/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:58.131823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fb6fa-cb58-4461-91e3-0e67c5323e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cca9cb830ef4a86b1fc24a5fb8a50d5, user_id=d9fce56bbe5f4f53beaeeb81e91d947c, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:58.134759 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fb6fa-cb58-4461-91e3-0e67c5323e81 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:58.252847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1075/2125] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:58 2022] PUT /identity/v3/projects/8cca9cb830ef4a86b1fc24a5fb8a50d5/users/d9fce56bbe5f4f53beaeeb81e91d947c/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:58.259209 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fb6fa-cb58-4461-91e3-0e67c5323e81 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:58.280614 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1750ece2-6072-4e87-8890-14f12111785c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b19b4d4f73f486ba6a9051f4472720b', 'request_id': 'req-1750ece2-6072-4e87-8890-14f12111785c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.289825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1750ece2-6072-4e87-8890-14f12111785c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b19b4d4f73f486ba6a9051f4472720b', 'request_id': 'req-1750ece2-6072-4e87-8890-14f12111785c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.301448 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1750ece2-6072-4e87-8890-14f12111785c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b19b4d4f73f486ba6a9051f4472720b', 'request_id': 'req-1750ece2-6072-4e87-8890-14f12111785c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.371224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fb6fa-cb58-4461-91e3-0e67c5323e81 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:58.463599 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1750ece2-6072-4e87-8890-14f12111785c admin admin] The token cache is being invalidate because project 0b19b4d4f73f486ba6a9051f4472720b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:58.463973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d7289-67dd-4900-88ec-419583838f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:58.464752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1750ece2-6072-4e87-8890-14f12111785c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.465136 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d7289-67dd-4900-88ec-419583838f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:58.465629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d7289-67dd-4900-88ec-419583838f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:58.465820 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1750ece2-6072-4e87-8890-14f12111785c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.466182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d7289-67dd-4900-88ec-419583838f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:58.467312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d7289-67dd-4900-88ec-419583838f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:58.471309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d7289-67dd-4900-88ec-419583838f16 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:58.478464 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1051/2126] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:57 2022] DELETE /identity/v3/projects/0b19b4d4f73f486ba6a9051f4472720b => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:58.486513 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750ece2-6072-4e87-8890-14f12111785c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:58.486513 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1750ece2-6072-4e87-8890-14f12111785c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:58.493185 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1076/2127] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:58.495341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d7289-67dd-4900-88ec-419583838f16 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:58.497241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-387d7289-67dd-4900-88ec-419583838f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:58.508881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750ece2-6072-4e87-8890-14f12111785c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:58.513396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d7289-67dd-4900-88ec-419583838f16 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:58.517833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1ba39-0f06-428b-a6b5-4f11b9e86f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:58.519375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1ba39-0f06-428b-a6b5-4f11b9e86f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:58.519853 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1ba39-0f06-428b-a6b5-4f11b9e86f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:58.520355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1ba39-0f06-428b-a6b5-4f11b9e86f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:58.523105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1ba39-0f06-428b-a6b5-4f11b9e86f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:58.524124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9467146-001b-43e1-95f1-ac7f0d2023b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:58.524944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1ba39-0f06-428b-a6b5-4f11b9e86f0c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:58.525416 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9467146-001b-43e1-95f1-ac7f0d2023b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:58.525921 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9467146-001b-43e1-95f1-ac7f0d2023b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:58.526360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9467146-001b-43e1-95f1-ac7f0d2023b9 admin admin] PATH_INFO: `/v3/users/ec0b1c56749546e8bef6d4c33a7a5e07` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:58.528098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9467146-001b-43e1-95f1-ac7f0d2023b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec0b1c56749546e8bef6d4c33a7a5e07)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:58.530288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9467146-001b-43e1-95f1-ac7f0d2023b9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:58.554770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1052/2128] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:58.554770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1ba39-0f06-428b-a6b5-4f11b9e86f0c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:58.555822 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-50d1ba39-0f06-428b-a6b5-4f11b9e86f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:58.590219 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1ba39-0f06-428b-a6b5-4f11b9e86f0c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:58.604686 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83665dae-1239-4b4e-8d81-254c0347b014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:58.606248 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83665dae-1239-4b4e-8d81-254c0347b014 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:58.606813 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83665dae-1239-4b4e-8d81-254c0347b014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:58.607310 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83665dae-1239-4b4e-8d81-254c0347b014 admin admin] PATH_INFO: `/v3/projects/fee9d5428a98494b94983288b164b547/users/20f9f25c8acb47dba706892bca5a0ce8/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:58.644701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83665dae-1239-4b4e-8d81-254c0347b014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee9d5428a98494b94983288b164b547, user_id=20f9f25c8acb47dba706892bca5a0ce8, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:58.651720 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83665dae-1239-4b4e-8d81-254c0347b014 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:58.653892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:58.744963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:58.779855 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1053/2129] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:58 2022] PUT /identity/v3/projects/fee9d5428a98494b94983288b164b547/users/20f9f25c8acb47dba706892bca5a0ce8/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:58.792176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83665dae-1239-4b4e-8d81-254c0347b014 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:58.818468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b9467146-001b-43e1-95f1-ac7f0d2023b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0b1c56749546e8bef6d4c33a7a5e07'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.942753 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83665dae-1239-4b4e-8d81-254c0347b014 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:58.955808 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def1326-9b68-4a7f-9f7d-d1e8f78e3793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:58.955808 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def1326-9b68-4a7f-9f7d-d1e8f78e3793 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:58.955808 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def1326-9b68-4a7f-9f7d-d1e8f78e3793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:58.955808 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def1326-9b68-4a7f-9f7d-d1e8f78e3793 admin admin] PATH_INFO: `/v3/projects/8cca9cb830ef4a86b1fc24a5fb8a50d5/users/d9fce56bbe5f4f53beaeeb81e91d947c/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:58.974312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def1326-9b68-4a7f-9f7d-d1e8f78e3793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cca9cb830ef4a86b1fc24a5fb8a50d5, user_id=d9fce56bbe5f4f53beaeeb81e91d947c, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:58.974312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def1326-9b68-4a7f-9f7d-d1e8f78e3793 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:58.994362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1054/2130] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:58 2022] PUT /identity/v3/projects/8cca9cb830ef4a86b1fc24a5fb8a50d5/users/d9fce56bbe5f4f53beaeeb81e91d947c/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:58.994362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648ffcd-aa9e-4158-86ef-9e9f8fd76248 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:58.994362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648ffcd-aa9e-4158-86ef-9e9f8fd76248 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:58.994362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648ffcd-aa9e-4158-86ef-9e9f8fd76248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:59.006182 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b9467146-001b-43e1-95f1-ac7f0d2023b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0b1c56749546e8bef6d4c33a7a5e07'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.043465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b9467146-001b-43e1-95f1-ac7f0d2023b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0b1c56749546e8bef6d4c33a7a5e07'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.045620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b9467146-001b-43e1-95f1-ac7f0d2023b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0b1c56749546e8bef6d4c33a7a5e07'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.053633 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f648ffcd-aa9e-4158-86ef-9e9f8fd76248 None None] MFA Rules not processed for user `20f9f25c8acb47dba706892bca5a0ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:59.056630 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f648ffcd-aa9e-4158-86ef-9e9f8fd76248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:59.088392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b9467146-001b-43e1-95f1-ac7f0d2023b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0b1c56749546e8bef6d4c33a7a5e07'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.105672 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1077/2131] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:58 2022] DELETE /identity/v3/users/ec0b1c56749546e8bef6d4c33a7a5e07 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:59.108995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2766073-b54c-4a89-ac28-fac9250eeca3 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:59.110885 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2766073-b54c-4a89-ac28-fac9250eeca3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:59.113089 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2766073-b54c-4a89-ac28-fac9250eeca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:59.225037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c2766073-b54c-4a89-ac28-fac9250eeca3 None None] MFA Rules not processed for user `d9fce56bbe5f4f53beaeeb81e91d947c`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:59.228754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c2766073-b54c-4a89-ac28-fac9250eeca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:59.331629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1055/2132] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:59.339846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648ffcd-aa9e-4158-86ef-9e9f8fd76248 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:59.345172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f648ffcd-aa9e-4158-86ef-9e9f8fd76248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:59.511715 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1078/2133] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:41:59 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:59.535111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2766073-b54c-4a89-ac28-fac9250eeca3 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:59.537662 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c2766073-b54c-4a89-ac28-fac9250eeca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:59.599743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648ffcd-aa9e-4158-86ef-9e9f8fd76248 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:59.739518 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2766073-b54c-4a89-ac28-fac9250eeca3 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:59.752404 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d870d1-5ebe-464d-b9af-dc2bfc3eb4cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:59.755096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d870d1-5ebe-464d-b9af-dc2bfc3eb4cc service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:59.755440 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d870d1-5ebe-464d-b9af-dc2bfc3eb4cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:59.758448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d870d1-5ebe-464d-b9af-dc2bfc3eb4cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:59.758791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:59.787316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d870d1-5ebe-464d-b9af-dc2bfc3eb4cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:59.791573 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d870d1-5ebe-464d-b9af-dc2bfc3eb4cc service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:59.808092 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8457a-98ae-45e3-9a89-5bc3fcb9b129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:59.809701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8457a-98ae-45e3-9a89-5bc3fcb9b129 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:59.810466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8457a-98ae-45e3-9a89-5bc3fcb9b129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:59.812391 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8457a-98ae-45e3-9a89-5bc3fcb9b129 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:59.815623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8457a-98ae-45e3-9a89-5bc3fcb9b129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:59.818764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1079/2134] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:59 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:59.823126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8457a-98ae-45e3-9a89-5bc3fcb9b129 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:59.975503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1056/2135] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:59 2022] POST /identity/v3/projects => generated 387 bytes in 633 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:59.979334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d870d1-5ebe-464d-b9af-dc2bfc3eb4cc service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:00.010371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d870d1-5ebe-464d-b9af-dc2bfc3eb4cc service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:00.133257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a56c0f-b6e2-44e0-a207-d557058ce407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:00.134064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a56c0f-b6e2-44e0-a207-d557058ce407 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:00.134405 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a56c0f-b6e2-44e0-a207-d557058ce407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:00.134804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a56c0f-b6e2-44e0-a207-d557058ce407 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:00.135692 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a56c0f-b6e2-44e0-a207-d557058ce407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:00.137937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a56c0f-b6e2-44e0-a207-d557058ce407 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:00.270493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1080/2136] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:59 2022] POST /identity/v3/users => generated 300 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:00.277693 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8457a-98ae-45e3-9a89-5bc3fcb9b129 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:00.300271 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8457a-98ae-45e3-9a89-5bc3fcb9b129 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:00.318601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6824a-3170-4cbc-94c8-2c198f6d0fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:00.325177 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6824a-3170-4cbc-94c8-2c198f6d0fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:00.325889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6824a-3170-4cbc-94c8-2c198f6d0fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:00.326546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6824a-3170-4cbc-94c8-2c198f6d0fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:00.328720 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6824a-3170-4cbc-94c8-2c198f6d0fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:00.333655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6824a-3170-4cbc-94c8-2c198f6d0fc6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:00.360480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1057/2137] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:00.369350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:00.370680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a56c0f-b6e2-44e0-a207-d557058ce407 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:00.389981 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a56c0f-b6e2-44e0-a207-d557058ce407 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:00.402877 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec40e9-edc4-469d-97f0-2c15eada441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:00.404804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec40e9-edc4-469d-97f0-2c15eada441c admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:00.405194 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec40e9-edc4-469d-97f0-2c15eada441c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:00.405670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec40e9-edc4-469d-97f0-2c15eada441c admin admin] PATH_INFO: `/v3/projects/7324bf537b09440cb682dc87b4b9c445/users/091d8473188c4d7484fd486d2fd610a0/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:00.439005 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec40e9-edc4-469d-97f0-2c15eada441c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7324bf537b09440cb682dc87b4b9c445, user_id=091d8473188c4d7484fd486d2fd610a0, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:00.444993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec40e9-edc4-469d-97f0-2c15eada441c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:00.458898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06fe78-0043-4fa6-8727-fb0e28d748ad None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:00.459671 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06fe78-0043-4fa6-8727-fb0e28d748ad None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:00.460182 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06fe78-0043-4fa6-8727-fb0e28d748ad None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:00.464152 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1058/2138] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 18 10:42:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:42:00.486112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6886e-609b-4ec9-970c-c9fa60d1ffc2 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:00.486685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6886e-609b-4ec9-970c-c9fa60d1ffc2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:00.487081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6886e-609b-4ec9-970c-c9fa60d1ffc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:00.515293 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-eab6886e-609b-4ec9-970c-c9fa60d1ffc2 None None] MFA Rules not processed for user `b8fd088faaba4d5c9745638c14f1a7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:00.517830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-eab6886e-609b-4ec9-970c-c9fa60d1ffc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:00.555958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1081/2139] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:00 2022] PUT /identity/v3/projects/7324bf537b09440cb682dc87b4b9c445/users/091d8473188c4d7484fd486d2fd610a0/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:00.558048 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec40e9-edc4-469d-97f0-2c15eada441c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:00.691649 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec40e9-edc4-469d-97f0-2c15eada441c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:00.696671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d230b-32e6-4587-93fe-abb2d796f665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:00.697933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d230b-32e6-4587-93fe-abb2d796f665 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:00.697933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d230b-32e6-4587-93fe-abb2d796f665 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:00.698246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d230b-32e6-4587-93fe-abb2d796f665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:00.700716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6a3d230b-32e6-4587-93fe-abb2d796f665 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:00.701277 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1059/2140] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 18 10:42:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:00.703140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6886e-609b-4ec9-970c-c9fa60d1ffc2 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:00.733275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6886e-609b-4ec9-970c-c9fa60d1ffc2 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:00.802420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d230b-32e6-4587-93fe-abb2d796f665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:00.802420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d230b-32e6-4587-93fe-abb2d796f665 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:00.816260 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1082/2141] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:00 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:00.817253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d230b-32e6-4587-93fe-abb2d796f665 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:00.819533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6a3d230b-32e6-4587-93fe-abb2d796f665 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:00.856328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4833f-ff98-44b8-b039-da4b13658f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:00.862854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4833f-ff98-44b8-b039-da4b13658f7e admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:00.862854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4833f-ff98-44b8-b039-da4b13658f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:00.862854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4833f-ff98-44b8-b039-da4b13658f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:00.862854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4833f-ff98-44b8-b039-da4b13658f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:00.862854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4833f-ff98-44b8-b039-da4b13658f7e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:00.872658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1060/2142] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:00.873844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4833f-ff98-44b8-b039-da4b13658f7e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:00.876541 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2bc4833f-ff98-44b8-b039-da4b13658f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:00.944816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d230b-32e6-4587-93fe-abb2d796f665 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:00.952377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a2670-a313-442e-8298-1803fdd65a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:00.955006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a2670-a313-442e-8298-1803fdd65a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:00.955506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a2670-a313-442e-8298-1803fdd65a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:00.955998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a2670-a313-442e-8298-1803fdd65a90 admin admin] PATH_INFO: `/v3/projects/eea1d736ad804ec9a903e5b4cb474e42` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:00.957681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a2670-a313-442e-8298-1803fdd65a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea1d736ad804ec9a903e5b4cb474e42)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:00.960263 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a2670-a313-442e-8298-1803fdd65a90 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:00.991394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4833f-ff98-44b8-b039-da4b13658f7e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:00.999775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ec5d7-cc5f-4a78-94e9-a077c7d7ab7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fd088faaba4d5c9745638c14f1a7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:01.000934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ec5d7-cc5f-4a78-94e9-a077c7d7ab7b service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.001244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ec5d7-cc5f-4a78-94e9-a077c7d7ab7b service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.001632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ec5d7-cc5f-4a78-94e9-a077c7d7ab7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.013280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ec5d7-cc5f-4a78-94e9-a077c7d7ab7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:01.015464 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ec5d7-cc5f-4a78-94e9-a077c7d7ab7b service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:01.027239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1061/2143] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:01.035168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ec5d7-cc5f-4a78-94e9-a077c7d7ab7b service placement] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:01.037091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-df7ec5d7-cc5f-4a78-94e9-a077c7d7ab7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:01.059541 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ec5d7-cc5f-4a78-94e9-a077c7d7ab7b service placement] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:01.063503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21339b10-5016-431a-ac3a-27eacf8b174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:01.064676 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339b10-5016-431a-ac3a-27eacf8b174d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.065040 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339b10-5016-431a-ac3a-27eacf8b174d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.065408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339b10-5016-431a-ac3a-27eacf8b174d admin admin] PATH_INFO: `/v3/users/cac2f73bfa37460ebe4438fce527b1db` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.067080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21339b10-5016-431a-ac3a-27eacf8b174d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cac2f73bfa37460ebe4438fce527b1db)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:01.069369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21339b10-5016-431a-ac3a-27eacf8b174d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:01.119755 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f90a2670-a313-442e-8298-1803fdd65a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea1d736ad804ec9a903e5b4cb474e42', 'request_id': 'req-f90a2670-a313-442e-8298-1803fdd65a90'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.129483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f90a2670-a313-442e-8298-1803fdd65a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea1d736ad804ec9a903e5b4cb474e42', 'request_id': 'req-f90a2670-a313-442e-8298-1803fdd65a90'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.135862 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f90a2670-a313-442e-8298-1803fdd65a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea1d736ad804ec9a903e5b4cb474e42', 'request_id': 'req-f90a2670-a313-442e-8298-1803fdd65a90'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.261482 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f90a2670-a313-442e-8298-1803fdd65a90 admin admin] The token cache is being invalidate because project eea1d736ad804ec9a903e5b4cb474e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:01.261780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f90a2670-a313-442e-8298-1803fdd65a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.262546 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f90a2670-a313-442e-8298-1803fdd65a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.264299 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1083/2144] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:00 2022] DELETE /identity/v3/projects/eea1d736ad804ec9a903e5b4cb474e42 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:01.265767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a2670-a313-442e-8298-1803fdd65a90 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:01.267465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f90a2670-a313-442e-8298-1803fdd65a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:01.369335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a2670-a313-442e-8298-1803fdd65a90 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:01.376514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119194d-e36f-4cfe-a22b-a1c8b718404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:01.377428 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119194d-e36f-4cfe-a22b-a1c8b718404b admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.377852 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119194d-e36f-4cfe-a22b-a1c8b718404b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.378002 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119194d-e36f-4cfe-a22b-a1c8b718404b admin admin] PATH_INFO: `/v3/projects/7324bf537b09440cb682dc87b4b9c445/users/091d8473188c4d7484fd486d2fd610a0/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.380144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119194d-e36f-4cfe-a22b-a1c8b718404b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7324bf537b09440cb682dc87b4b9c445, user_id=091d8473188c4d7484fd486d2fd610a0, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:01.383110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119194d-e36f-4cfe-a22b-a1c8b718404b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:01.393563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-21339b10-5016-431a-ac3a-27eacf8b174d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac2f73bfa37460ebe4438fce527b1db'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.402156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1084/2145] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:01 2022] PUT /identity/v3/projects/7324bf537b09440cb682dc87b4b9c445/users/091d8473188c4d7484fd486d2fd610a0/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:01.408453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17c8a1-a109-4586-bdd6-0890f5f33069 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.408453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17c8a1-a109-4586-bdd6-0890f5f33069 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.408453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17c8a1-a109-4586-bdd6-0890f5f33069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.437324 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ad17c8a1-a109-4586-bdd6-0890f5f33069 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:01.440100 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ad17c8a1-a109-4586-bdd6-0890f5f33069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:01.474378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-21339b10-5016-431a-ac3a-27eacf8b174d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac2f73bfa37460ebe4438fce527b1db'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.485969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-21339b10-5016-431a-ac3a-27eacf8b174d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac2f73bfa37460ebe4438fce527b1db'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.486935 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-21339b10-5016-431a-ac3a-27eacf8b174d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac2f73bfa37460ebe4438fce527b1db'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.505599 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-21339b10-5016-431a-ac3a-27eacf8b174d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac2f73bfa37460ebe4438fce527b1db'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.513427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1062/2146] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:01 2022] DELETE /identity/v3/users/cac2f73bfa37460ebe4438fce527b1db => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:01.514941 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01c283-56f1-494e-81a2-e81b5a8b0a46 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.515237 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01c283-56f1-494e-81a2-e81b5a8b0a46 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.517740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01c283-56f1-494e-81a2-e81b5a8b0a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.541450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1085/2147] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:01.551956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34615e-a6ef-493f-9735-1dd8ff2a5ab4 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.552222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34615e-a6ef-493f-9735-1dd8ff2a5ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.552521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34615e-a6ef-493f-9735-1dd8ff2a5ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.580429 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5b34615e-a6ef-493f-9735-1dd8ff2a5ab4 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:01.581100 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ed01c283-56f1-494e-81a2-e81b5a8b0a46 None None] MFA Rules not processed for user `091d8473188c4d7484fd486d2fd610a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:01.587680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5b34615e-a6ef-493f-9735-1dd8ff2a5ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:01.587847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ed01c283-56f1-494e-81a2-e81b5a8b0a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:01.718592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1086/2148] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:01.720493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34615e-a6ef-493f-9735-1dd8ff2a5ab4 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:01.748881 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34615e-a6ef-493f-9735-1dd8ff2a5ab4 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:01.762922 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1063/2149] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:01.764757 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e236652-96a7-44db-9339-16523ff3c955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:01.765365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e236652-96a7-44db-9339-16523ff3c955 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.766396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e236652-96a7-44db-9339-16523ff3c955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.767438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e236652-96a7-44db-9339-16523ff3c955 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.768219 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e236652-96a7-44db-9339-16523ff3c955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:01.768536 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e236652-96a7-44db-9339-16523ff3c955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:01.770356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e236652-96a7-44db-9339-16523ff3c955 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:01.788889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01c283-56f1-494e-81a2-e81b5a8b0a46 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:01.792050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ed01c283-56f1-494e-81a2-e81b5a8b0a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:01.802992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1087/2150] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:01.812469 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e236652-96a7-44db-9339-16523ff3c955 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:01.841157 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e236652-96a7-44db-9339-16523ff3c955 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:01.849992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a649d9-e2ff-4df6-b943-dc75f12b7bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:01.851367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a649d9-e2ff-4df6-b943-dc75f12b7bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.852016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a649d9-e2ff-4df6-b943-dc75f12b7bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.852516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a649d9-e2ff-4df6-b943-dc75f12b7bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.853918 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a649d9-e2ff-4df6-b943-dc75f12b7bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:01.856569 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a649d9-e2ff-4df6-b943-dc75f12b7bb1 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:01.924943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01c283-56f1-494e-81a2-e81b5a8b0a46 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:01.935391 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713a5bd-291f-4016-b210-a8b77e888c0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:01.936660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713a5bd-291f-4016-b210-a8b77e888c0a service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.937274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713a5bd-291f-4016-b210-a8b77e888c0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.938430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713a5bd-291f-4016-b210-a8b77e888c0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.960925 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713a5bd-291f-4016-b210-a8b77e888c0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:01.969817 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713a5bd-291f-4016-b210-a8b77e888c0a service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:01.990525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1088/2151] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:01 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:42:01.991865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a649d9-e2ff-4df6-b943-dc75f12b7bb1 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:01.996464 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1064/2152] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:01.998812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713a5bd-291f-4016-b210-a8b77e888c0a service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:01.999023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-72a649d9-e2ff-4df6-b943-dc75f12b7bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:02.028108 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713a5bd-291f-4016-b210-a8b77e888c0a service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:02.152213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a649d9-e2ff-4df6-b943-dc75f12b7bb1 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:02.158248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645824c-6b95-4410-a083-785c0be4537c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:02.159718 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645824c-6b95-4410-a083-785c0be4537c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:02.160250 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645824c-6b95-4410-a083-785c0be4537c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:02.160684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645824c-6b95-4410-a083-785c0be4537c admin admin] PATH_INFO: `/v3/projects/93d0f52b257c48c19cc77fc605729abf` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:02.164380 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645824c-6b95-4410-a083-785c0be4537c admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d0f52b257c48c19cc77fc605729abf)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:02.167308 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645824c-6b95-4410-a083-785c0be4537c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:02.198672 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90715678-46a5-4c35-92d9-d9365f2aecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:02.199878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90715678-46a5-4c35-92d9-d9365f2aecc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:02.200380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90715678-46a5-4c35-92d9-d9365f2aecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:02.200880 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90715678-46a5-4c35-92d9-d9365f2aecc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:02.202195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90715678-46a5-4c35-92d9-d9365f2aecc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:02.206586 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90715678-46a5-4c35-92d9-d9365f2aecc5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:02.304940 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1065/2153] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:01 2022] POST /identity/v3/users => generated 286 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:02.311204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90715678-46a5-4c35-92d9-d9365f2aecc5 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:02.314619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-90715678-46a5-4c35-92d9-d9365f2aecc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:02.345242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90715678-46a5-4c35-92d9-d9365f2aecc5 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:02.348321 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4645824c-6b95-4410-a083-785c0be4537c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d0f52b257c48c19cc77fc605729abf', 'request_id': 'req-4645824c-6b95-4410-a083-785c0be4537c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.359325 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4645824c-6b95-4410-a083-785c0be4537c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d0f52b257c48c19cc77fc605729abf', 'request_id': 'req-4645824c-6b95-4410-a083-785c0be4537c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.372385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4645824c-6b95-4410-a083-785c0be4537c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d0f52b257c48c19cc77fc605729abf', 'request_id': 'req-4645824c-6b95-4410-a083-785c0be4537c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.436794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8ecdb-c01f-4a4c-afd6-fc49d7adec99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:02.438689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8ecdb-c01f-4a4c-afd6-fc49d7adec99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:02.438999 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8ecdb-c01f-4a4c-afd6-fc49d7adec99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:02.439384 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8ecdb-c01f-4a4c-afd6-fc49d7adec99 admin admin] PATH_INFO: `/v3/users/de0b90efb3484146ac0b8b1bbaafc053` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:02.441295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8ecdb-c01f-4a4c-afd6-fc49d7adec99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0b90efb3484146ac0b8b1bbaafc053)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:02.443869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8ecdb-c01f-4a4c-afd6-fc49d7adec99 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:02.511445 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4645824c-6b95-4410-a083-785c0be4537c admin admin] The token cache is being invalidate because project 93d0f52b257c48c19cc77fc605729abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:02.511787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4645824c-6b95-4410-a083-785c0be4537c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.512656 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4645824c-6b95-4410-a083-785c0be4537c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.514722 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1089/2154] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:01 2022] DELETE /identity/v3/projects/93d0f52b257c48c19cc77fc605729abf => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:02.516758 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645824c-6b95-4410-a083-785c0be4537c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:02.519164 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4645824c-6b95-4410-a083-785c0be4537c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:02.536495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645824c-6b95-4410-a083-785c0be4537c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:02.545669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9dcff-225b-40a7-a03b-f9775304a594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:02.546607 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9dcff-225b-40a7-a03b-f9775304a594 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:02.547120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9dcff-225b-40a7-a03b-f9775304a594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:02.547901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9dcff-225b-40a7-a03b-f9775304a594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:02.549507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9dcff-225b-40a7-a03b-f9775304a594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:02.552820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9dcff-225b-40a7-a03b-f9775304a594 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:02.576707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1090/2155] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:02.576707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9dcff-225b-40a7-a03b-f9775304a594 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:02.576707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-86a9dcff-225b-40a7-a03b-f9775304a594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:02.598438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9dcff-225b-40a7-a03b-f9775304a594 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:02.604204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6b2a0-567f-42fc-9993-2a82732f6140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:02.605117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6b2a0-567f-42fc-9993-2a82732f6140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:02.605401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6b2a0-567f-42fc-9993-2a82732f6140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:02.605686 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6b2a0-567f-42fc-9993-2a82732f6140 admin admin] PATH_INFO: `/v3/users/20f9f25c8acb47dba706892bca5a0ce8` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:02.607348 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6b2a0-567f-42fc-9993-2a82732f6140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f9f25c8acb47dba706892bca5a0ce8)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:02.609813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6b2a0-567f-42fc-9993-2a82732f6140 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:02.738240 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:02.855749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a0a8ecdb-c01f-4a4c-afd6-fc49d7adec99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0b90efb3484146ac0b8b1bbaafc053'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.921181 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3ef6b2a0-567f-42fc-9993-2a82732f6140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f9f25c8acb47dba706892bca5a0ce8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:03.018873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a0a8ecdb-c01f-4a4c-afd6-fc49d7adec99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0b90efb3484146ac0b8b1bbaafc053'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:03.030622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a0a8ecdb-c01f-4a4c-afd6-fc49d7adec99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0b90efb3484146ac0b8b1bbaafc053'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:03.034365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a0a8ecdb-c01f-4a4c-afd6-fc49d7adec99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0b90efb3484146ac0b8b1bbaafc053'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:03.052479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a0a8ecdb-c01f-4a4c-afd6-fc49d7adec99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0b90efb3484146ac0b8b1bbaafc053'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:03.061963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1066/2156] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:02 2022] DELETE /identity/v3/users/de0b90efb3484146ac0b8b1bbaafc053 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:03.063669 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96563fb-f334-4b81-883d-593dc369531b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.063959 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96563fb-f334-4b81-883d-593dc369531b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.064575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96563fb-f334-4b81-883d-593dc369531b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.094460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f96563fb-f334-4b81-883d-593dc369531b None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:03.096089 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f96563fb-f334-4b81-883d-593dc369531b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:03.147060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3ef6b2a0-567f-42fc-9993-2a82732f6140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f9f25c8acb47dba706892bca5a0ce8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:03.159938 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3ef6b2a0-567f-42fc-9993-2a82732f6140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f9f25c8acb47dba706892bca5a0ce8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:03.160929 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3ef6b2a0-567f-42fc-9993-2a82732f6140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f9f25c8acb47dba706892bca5a0ce8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:03.191070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3ef6b2a0-567f-42fc-9993-2a82732f6140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f9f25c8acb47dba706892bca5a0ce8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:03.212857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1091/2157] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:02 2022] DELETE /identity/v3/users/20f9f25c8acb47dba706892bca5a0ce8 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:03.214923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6b2a0-567f-42fc-9993-2a82732f6140 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.216610 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1067/2158] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:03.218056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3ef6b2a0-567f-42fc-9993-2a82732f6140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:03.221014 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b1f85-19a9-40a1-8a94-f408a347a09e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.221468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b1f85-19a9-40a1-8a94-f408a347a09e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.225145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b1f85-19a9-40a1-8a94-f408a347a09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.251569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-cc6b1f85-19a9-40a1-8a94-f408a347a09e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:03.253713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cc6b1f85-19a9-40a1-8a94-f408a347a09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:03.356797 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6b2a0-567f-42fc-9993-2a82732f6140 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.358259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1068/2159] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:03.365369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a72b23-e0ad-4ef5-8175-75a7992408a3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.365369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a72b23-e0ad-4ef5-8175-75a7992408a3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.365369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a72b23-e0ad-4ef5-8175-75a7992408a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.373223 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365f0c9-def9-4852-ac0f-48e9d4e8cdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.375631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365f0c9-def9-4852-ac0f-48e9d4e8cdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.376730 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365f0c9-def9-4852-ac0f-48e9d4e8cdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.376730 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365f0c9-def9-4852-ac0f-48e9d4e8cdc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.378222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365f0c9-def9-4852-ac0f-48e9d4e8cdc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.381526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365f0c9-def9-4852-ac0f-48e9d4e8cdc2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:03.403692 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1092/2160] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:03.403692 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82bc73-51a2-41e8-b07b-f262ef101170 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.403692 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82bc73-51a2-41e8-b07b-f262ef101170 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.404260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-81a72b23-e0ad-4ef5-8175-75a7992408a3 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:03.404418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82bc73-51a2-41e8-b07b-f262ef101170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.404554 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-81a72b23-e0ad-4ef5-8175-75a7992408a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:03.417551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1069/2161] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:03.421043 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a72b23-e0ad-4ef5-8175-75a7992408a3 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.421043 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-81a72b23-e0ad-4ef5-8175-75a7992408a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:03.435048 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3d82bc73-51a2-41e8-b07b-f262ef101170 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:03.437205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3d82bc73-51a2-41e8-b07b-f262ef101170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:03.456360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1093/2162] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:03.456360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82bc73-51a2-41e8-b07b-f262ef101170 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.475945 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82bc73-51a2-41e8-b07b-f262ef101170 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.482376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b0b93-0fdb-4482-9f49-6df00ba196ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.483505 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b0b93-0fdb-4482-9f49-6df00ba196ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.484232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b0b93-0fdb-4482-9f49-6df00ba196ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.484537 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b0b93-0fdb-4482-9f49-6df00ba196ca admin admin] PATH_INFO: `/v3/projects/fc194617d91a4604ad9ae5491fd061ec/users/217b7f5e31d849b389b1d2fbcda68332/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.504291 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b0b93-0fdb-4482-9f49-6df00ba196ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc194617d91a4604ad9ae5491fd061ec, user_id=217b7f5e31d849b389b1d2fbcda68332, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.507999 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b0b93-0fdb-4482-9f49-6df00ba196ca admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:03.533174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a72b23-e0ad-4ef5-8175-75a7992408a3 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.539636 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884176c1-7f23-41b9-82eb-4c6fa91891e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.540831 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884176c1-7f23-41b9-82eb-4c6fa91891e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.541320 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884176c1-7f23-41b9-82eb-4c6fa91891e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.541804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884176c1-7f23-41b9-82eb-4c6fa91891e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.549496 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:03.559713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884176c1-7f23-41b9-82eb-4c6fa91891e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.561381 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884176c1-7f23-41b9-82eb-4c6fa91891e7 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:03.573773 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1070/2163] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:03.575610 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884176c1-7f23-41b9-82eb-4c6fa91891e7 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.593992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884176c1-7f23-41b9-82eb-4c6fa91891e7 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.599742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccca8e-ac1d-46ba-9da9-30a5a3b6749a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.600749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccca8e-ac1d-46ba-9da9-30a5a3b6749a service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.601366 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccca8e-ac1d-46ba-9da9-30a5a3b6749a service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.601718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccca8e-ac1d-46ba-9da9-30a5a3b6749a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.620346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccca8e-ac1d-46ba-9da9-30a5a3b6749a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.623404 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1094/2164] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:03 2022] PUT /identity/v3/projects/fc194617d91a4604ad9ae5491fd061ec/users/217b7f5e31d849b389b1d2fbcda68332/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:03.624258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccca8e-ac1d-46ba-9da9-30a5a3b6749a service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:03.625556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b0b93-0fdb-4482-9f49-6df00ba196ca admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.644574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1071/2165] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:03.647083 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891087-a41d-4eb0-85e3-4181a6829169 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.647464 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891087-a41d-4eb0-85e3-4181a6829169 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.647890 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891087-a41d-4eb0-85e3-4181a6829169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.679545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-88891087-a41d-4eb0-85e3-4181a6829169 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:03.681745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-88891087-a41d-4eb0-85e3-4181a6829169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:03.769311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b0b93-0fdb-4482-9f49-6df00ba196ca admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.776225 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a302fa0-50de-4567-9f35-15486e1b1d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.777166 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a302fa0-50de-4567-9f35-15486e1b1d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.777646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a302fa0-50de-4567-9f35-15486e1b1d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.778022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a302fa0-50de-4567-9f35-15486e1b1d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.778997 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a302fa0-50de-4567-9f35-15486e1b1d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:03.779557 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a302fa0-50de-4567-9f35-15486e1b1d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.782351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a302fa0-50de-4567-9f35-15486e1b1d50 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:03.802429 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1095/2166] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:03.805494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1072/2167] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:03.806836 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a302fa0-50de-4567-9f35-15486e1b1d50 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.818731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88891087-a41d-4eb0-85e3-4181a6829169 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.821543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-88891087-a41d-4eb0-85e3-4181a6829169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:03.831476 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a302fa0-50de-4567-9f35-15486e1b1d50 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.854462 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb774f-c76c-4238-a73b-bfcae207b66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.856031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb774f-c76c-4238-a73b-bfcae207b66c admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.856699 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb774f-c76c-4238-a73b-bfcae207b66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.857115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb774f-c76c-4238-a73b-bfcae207b66c admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.858476 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb774f-c76c-4238-a73b-bfcae207b66c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.862606 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb774f-c76c-4238-a73b-bfcae207b66c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:03.953079 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88891087-a41d-4eb0-85e3-4181a6829169 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.959864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299f8ce-ba79-4e0a-8a1c-e7e2d2e5b101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.961004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299f8ce-ba79-4e0a-8a1c-e7e2d2e5b101 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.961518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299f8ce-ba79-4e0a-8a1c-e7e2d2e5b101 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.962017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299f8ce-ba79-4e0a-8a1c-e7e2d2e5b101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.979883 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299f8ce-ba79-4e0a-8a1c-e7e2d2e5b101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.982817 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299f8ce-ba79-4e0a-8a1c-e7e2d2e5b101 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:04.004817 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1073/2168] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:04.023255 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1096/2169] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:03 2022] POST /identity/v3/projects => generated 393 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:04.024147 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299f8ce-ba79-4e0a-8a1c-e7e2d2e5b101 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:04.042568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299f8ce-ba79-4e0a-8a1c-e7e2d2e5b101 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:04.138599 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027e136-c16a-41eb-afec-f98d5331f844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:04.139697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027e136-c16a-41eb-afec-f98d5331f844 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:04.140169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027e136-c16a-41eb-afec-f98d5331f844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:04.140614 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027e136-c16a-41eb-afec-f98d5331f844 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:04.141455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027e136-c16a-41eb-afec-f98d5331f844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:04.143731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027e136-c16a-41eb-afec-f98d5331f844 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:04.291568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1074/2170] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:04 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:04.299412 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb774f-c76c-4238-a73b-bfcae207b66c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:04.320899 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb774f-c76c-4238-a73b-bfcae207b66c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:04.330161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b20a4-0f74-40e7-9d63-2d0bbcac7ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:04.331456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b20a4-0f74-40e7-9d63-2d0bbcac7ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:04.331958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b20a4-0f74-40e7-9d63-2d0bbcac7ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:04.332478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b20a4-0f74-40e7-9d63-2d0bbcac7ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:04.333842 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b20a4-0f74-40e7-9d63-2d0bbcac7ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:04.337090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b20a4-0f74-40e7-9d63-2d0bbcac7ee9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:04.362510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1097/2171] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:04.368385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027e136-c16a-41eb-afec-f98d5331f844 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:04.394673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027e136-c16a-41eb-afec-f98d5331f844 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:04.405455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689c555-7050-4fc0-b3ec-29424a554c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:04.406692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c555-7050-4fc0-b3ec-29424a554c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:04.407446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c555-7050-4fc0-b3ec-29424a554c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:04.407962 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c555-7050-4fc0-b3ec-29424a554c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:04.409431 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689c555-7050-4fc0-b3ec-29424a554c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:04.413720 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689c555-7050-4fc0-b3ec-29424a554c8b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:04.426180 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b20a4-0f74-40e7-9d63-2d0bbcac7ee9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:04.430847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-158b20a4-0f74-40e7-9d63-2d0bbcac7ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:04.446632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1075/2172] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:04.448258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689c555-7050-4fc0-b3ec-29424a554c8b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:04.460483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9689c555-7050-4fc0-b3ec-29424a554c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:04.494009 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689c555-7050-4fc0-b3ec-29424a554c8b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:04.506369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:04.508182 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:04.510480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:04.513511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3 admin admin] PATH_INFO: `/v3/projects/5c99faea63f04268b8ae7e7f9c9d9124` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:04.516041 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b20a4-0f74-40e7-9d63-2d0bbcac7ee9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:04.517297 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c99faea63f04268b8ae7e7f9c9d9124)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:04.524483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:04.525416 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:04.526263 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:04.527396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:04.527396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa admin admin] PATH_INFO: `/v3/projects/fee9d5428a98494b94983288b164b547` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:04.529609 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee9d5428a98494b94983288b164b547)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:04.535001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:04.726675 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c99faea63f04268b8ae7e7f9c9d9124', 'request_id': 'req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:04.746372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c99faea63f04268b8ae7e7f9c9d9124', 'request_id': 'req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:04.760281 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee9d5428a98494b94983288b164b547', 'request_id': 'req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:04.762128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c99faea63f04268b8ae7e7f9c9d9124', 'request_id': 'req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:04.779379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee9d5428a98494b94983288b164b547', 'request_id': 'req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:04.791875 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee9d5428a98494b94983288b164b547', 'request_id': 'req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:04.841551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3 admin admin] The token cache is being invalidate because project 5c99faea63f04268b8ae7e7f9c9d9124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:04.842133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:04.843110 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:04.845737 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1076/2173] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:04 2022] DELETE /identity/v3/projects/5c99faea63f04268b8ae7e7f9c9d9124 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:04.847187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:04.849839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:04.945518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674c0f8-6ed6-4f7c-815b-da3d922b52d3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:04.991008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa admin admin] The token cache is being invalidate because project fee9d5428a98494b94983288b164b547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:04.993420 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:04.995046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:05.006232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1098/2174] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:04 2022] DELETE /identity/v3/projects/fee9d5428a98494b94983288b164b547 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:05.008256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:05.010882 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:05.115365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826dbe3e-7e7b-4c73-b55d-c3e262419a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:05.117611 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826dbe3e-7e7b-4c73-b55d-c3e262419a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:05.118422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826dbe3e-7e7b-4c73-b55d-c3e262419a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:05.118910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826dbe3e-7e7b-4c73-b55d-c3e262419a2a admin admin] PATH_INFO: `/v3/projects/c9f11131027a40f88664d560e215481d/users/d4be9b38bc54460c8e8a0c08f8c6efed/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:05.149091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826dbe3e-7e7b-4c73-b55d-c3e262419a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f11131027a40f88664d560e215481d, user_id=d4be9b38bc54460c8e8a0c08f8c6efed, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:05.154344 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a59ebe-07ac-4bb5-a316-414cb334e2aa admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:05.159165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826dbe3e-7e7b-4c73-b55d-c3e262419a2a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:05.159455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:05.171655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744c98f-d633-414a-b9f3-276782a5fccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:05.172780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744c98f-d633-414a-b9f3-276782a5fccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:05.173061 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744c98f-d633-414a-b9f3-276782a5fccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:05.173522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744c98f-d633-414a-b9f3-276782a5fccf admin admin] PATH_INFO: `/v3/users/19ebefbffbd7485f96bc6072c4e2fb49` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:05.175955 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744c98f-d633-414a-b9f3-276782a5fccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ebefbffbd7485f96bc6072c4e2fb49)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:05.179008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744c98f-d633-414a-b9f3-276782a5fccf admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:05.326071 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1077/2175] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:04 2022] PUT /identity/v3/projects/c9f11131027a40f88664d560e215481d/users/d4be9b38bc54460c8e8a0c08f8c6efed/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:05.327979 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826dbe3e-7e7b-4c73-b55d-c3e262419a2a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:05.332038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-826dbe3e-7e7b-4c73-b55d-c3e262419a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:05.448946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d744c98f-d633-414a-b9f3-276782a5fccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ebefbffbd7485f96bc6072c4e2fb49'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:05.466345 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826dbe3e-7e7b-4c73-b55d-c3e262419a2a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:05.476657 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71a736-cab7-4c6e-8f88-102404667d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:05.478204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71a736-cab7-4c6e-8f88-102404667d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:05.478862 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71a736-cab7-4c6e-8f88-102404667d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:05.479243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71a736-cab7-4c6e-8f88-102404667d9d admin admin] PATH_INFO: `/v3/users/091d8473188c4d7484fd486d2fd610a0` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:05.481689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71a736-cab7-4c6e-8f88-102404667d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=091d8473188c4d7484fd486d2fd610a0)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:05.485410 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71a736-cab7-4c6e-8f88-102404667d9d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:05.540094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:05.571841 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d744c98f-d633-414a-b9f3-276782a5fccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ebefbffbd7485f96bc6072c4e2fb49'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:05.588899 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d744c98f-d633-414a-b9f3-276782a5fccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ebefbffbd7485f96bc6072c4e2fb49'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:05.590139 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d744c98f-d633-414a-b9f3-276782a5fccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ebefbffbd7485f96bc6072c4e2fb49'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:05.617410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d744c98f-d633-414a-b9f3-276782a5fccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ebefbffbd7485f96bc6072c4e2fb49'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:05.630081 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1099/2176] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:05 2022] DELETE /identity/v3/users/19ebefbffbd7485f96bc6072c4e2fb49 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:05.637083 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ba31e-8fd6-4c6f-974a-b1b03b4b2120 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:05.637587 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ba31e-8fd6-4c6f-974a-b1b03b4b2120 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:05.637985 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ba31e-8fd6-4c6f-974a-b1b03b4b2120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:05.674165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a10ba31e-8fd6-4c6f-974a-b1b03b4b2120 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:05.676507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a10ba31e-8fd6-4c6f-974a-b1b03b4b2120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:05.839021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ef71a736-cab7-4c6e-8f88-102404667d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091d8473188c4d7484fd486d2fd610a0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:05.861046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1100/2177] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:05.878887 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ba31e-8fd6-4c6f-974a-b1b03b4b2120 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:05.882411 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a10ba31e-8fd6-4c6f-974a-b1b03b4b2120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:05.966653 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ef71a736-cab7-4c6e-8f88-102404667d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091d8473188c4d7484fd486d2fd610a0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:05.996525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ef71a736-cab7-4c6e-8f88-102404667d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091d8473188c4d7484fd486d2fd610a0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:05.998249 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ef71a736-cab7-4c6e-8f88-102404667d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091d8473188c4d7484fd486d2fd610a0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:06.021395 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ba31e-8fd6-4c6f-974a-b1b03b4b2120 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:06.032270 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104de3b-a03c-40c5-886b-19d5434d1566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:06.041353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104de3b-a03c-40c5-886b-19d5434d1566 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:06.041353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104de3b-a03c-40c5-886b-19d5434d1566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:06.041353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104de3b-a03c-40c5-886b-19d5434d1566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:06.041353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6104de3b-a03c-40c5-886b-19d5434d1566 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:06.059780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ef71a736-cab7-4c6e-8f88-102404667d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091d8473188c4d7484fd486d2fd610a0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:06.091080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1078/2178] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:05 2022] DELETE /identity/v3/users/091d8473188c4d7484fd486d2fd610a0 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:06.116644 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104de3b-a03c-40c5-886b-19d5434d1566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:06.120431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104de3b-a03c-40c5-886b-19d5434d1566 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:06.144686 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1101/2179] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:06.802826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71a736-cab7-4c6e-8f88-102404667d9d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:06.806725 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ef71a736-cab7-4c6e-8f88-102404667d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:06.998172 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104de3b-a03c-40c5-886b-19d5434d1566 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:07.001909 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6104de3b-a03c-40c5-886b-19d5434d1566 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:07.026466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71a736-cab7-4c6e-8f88-102404667d9d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:07.048447 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104de3b-a03c-40c5-886b-19d5434d1566 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:07.051291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971dd66-03f1-4a2c-87ee-0a79276cb66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:07.053931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971dd66-03f1-4a2c-87ee-0a79276cb66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:07.054503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971dd66-03f1-4a2c-87ee-0a79276cb66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:07.055017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971dd66-03f1-4a2c-87ee-0a79276cb66f admin admin] PATH_INFO: `/v3/projects/d4009f4fd41a4b24be7b46eda3b35775` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:07.058416 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971dd66-03f1-4a2c-87ee-0a79276cb66f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4009f4fd41a4b24be7b46eda3b35775)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:07.065695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971dd66-03f1-4a2c-87ee-0a79276cb66f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:07.071879 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d7ebd-71e1-463e-bf09-5d36f38e8189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:07.074027 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d7ebd-71e1-463e-bf09-5d36f38e8189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:07.074589 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d7ebd-71e1-463e-bf09-5d36f38e8189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:07.075089 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d7ebd-71e1-463e-bf09-5d36f38e8189 admin admin] PATH_INFO: `/v3/projects/7324bf537b09440cb682dc87b4b9c445` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:07.082638 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d7ebd-71e1-463e-bf09-5d36f38e8189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7324bf537b09440cb682dc87b4b9c445)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:07.091072 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d7ebd-71e1-463e-bf09-5d36f38e8189 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:07.323167 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1971dd66-03f1-4a2c-87ee-0a79276cb66f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4009f4fd41a4b24be7b46eda3b35775', 'request_id': 'req-1971dd66-03f1-4a2c-87ee-0a79276cb66f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:07.338608 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1971dd66-03f1-4a2c-87ee-0a79276cb66f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4009f4fd41a4b24be7b46eda3b35775', 'request_id': 'req-1971dd66-03f1-4a2c-87ee-0a79276cb66f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:07.350581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1971dd66-03f1-4a2c-87ee-0a79276cb66f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4009f4fd41a4b24be7b46eda3b35775', 'request_id': 'req-1971dd66-03f1-4a2c-87ee-0a79276cb66f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:07.366919 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d77d7ebd-71e1-463e-bf09-5d36f38e8189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7324bf537b09440cb682dc87b4b9c445', 'request_id': 'req-d77d7ebd-71e1-463e-bf09-5d36f38e8189'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:07.375678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d77d7ebd-71e1-463e-bf09-5d36f38e8189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7324bf537b09440cb682dc87b4b9c445', 'request_id': 'req-d77d7ebd-71e1-463e-bf09-5d36f38e8189'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:07.383655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d77d7ebd-71e1-463e-bf09-5d36f38e8189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7324bf537b09440cb682dc87b4b9c445', 'request_id': 'req-d77d7ebd-71e1-463e-bf09-5d36f38e8189'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:07.429643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1971dd66-03f1-4a2c-87ee-0a79276cb66f admin admin] The token cache is being invalidate because project d4009f4fd41a4b24be7b46eda3b35775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:07.430015 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1971dd66-03f1-4a2c-87ee-0a79276cb66f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:07.431663 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1971dd66-03f1-4a2c-87ee-0a79276cb66f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:07.437008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1079/2180] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:06 2022] DELETE /identity/v3/projects/d4009f4fd41a4b24be7b46eda3b35775 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:07.443947 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971dd66-03f1-4a2c-87ee-0a79276cb66f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:07.446057 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1971dd66-03f1-4a2c-87ee-0a79276cb66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:07.525510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d77d7ebd-71e1-463e-bf09-5d36f38e8189 admin admin] The token cache is being invalidate because project 7324bf537b09440cb682dc87b4b9c445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:07.525904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d77d7ebd-71e1-463e-bf09-5d36f38e8189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:07.527647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d77d7ebd-71e1-463e-bf09-5d36f38e8189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:07.539166 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1102/2181] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:06 2022] DELETE /identity/v3/projects/7324bf537b09440cb682dc87b4b9c445 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:07.541890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7c530-1fdd-4f3c-9250-8f9b4a2ea658 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:07.542181 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7c530-1fdd-4f3c-9250-8f9b4a2ea658 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:07.542486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7c530-1fdd-4f3c-9250-8f9b4a2ea658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:07.602583 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1fb7c530-1fdd-4f3c-9250-8f9b4a2ea658 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:07.605218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1fb7c530-1fdd-4f3c-9250-8f9b4a2ea658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:07.641164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971dd66-03f1-4a2c-87ee-0a79276cb66f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:07.757705 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1103/2182] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:07.766586 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3f22b-9c46-4901-8158-96c28c78c85d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:07.767267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3f22b-9c46-4901-8158-96c28c78c85d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:07.767901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3f22b-9c46-4901-8158-96c28c78c85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:07.792409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98894e1-5a97-498f-81b8-a896e3e24874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:07.792409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98894e1-5a97-498f-81b8-a896e3e24874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:07.794791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98894e1-5a97-498f-81b8-a896e3e24874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:07.797572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98894e1-5a97-498f-81b8-a896e3e24874 admin admin] PATH_INFO: `/v3/users/206fdb91bc084353809c3c19f1e029c8` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:07.800697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98894e1-5a97-498f-81b8-a896e3e24874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=206fdb91bc084353809c3c19f1e029c8)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:07.804799 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98894e1-5a97-498f-81b8-a896e3e24874 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:07.808421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a5e3f22b-9c46-4901-8158-96c28c78c85d None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:07.810836 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a5e3f22b-9c46-4901-8158-96c28c78c85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:07.833557 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1104/2183] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:07.835323 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3f22b-9c46-4901-8158-96c28c78c85d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:07.858428 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3f22b-9c46-4901-8158-96c28c78c85d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:07.870690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8f00f-3047-4094-9297-73510f77c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:07.872332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8f00f-3047-4094-9297-73510f77c06b admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:07.873533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8f00f-3047-4094-9297-73510f77c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:07.874272 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8f00f-3047-4094-9297-73510f77c06b admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:07.886664 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8f00f-3047-4094-9297-73510f77c06b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:07.886664 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8f00f-3047-4094-9297-73510f77c06b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:07.886664 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8f00f-3047-4094-9297-73510f77c06b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:07.910891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1105/2184] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:07.923219 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8f00f-3047-4094-9297-73510f77c06b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:07.958708 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8f00f-3047-4094-9297-73510f77c06b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:07.966010 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f727869-c39d-49e9-8c1d-75c762325c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:07.966287 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f727869-c39d-49e9-8c1d-75c762325c13 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:07.966647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f727869-c39d-49e9-8c1d-75c762325c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:07.967032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f727869-c39d-49e9-8c1d-75c762325c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:07.968067 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f727869-c39d-49e9-8c1d-75c762325c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:07.970537 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f727869-c39d-49e9-8c1d-75c762325c13 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:08.057173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c98894e1-5a97-498f-81b8-a896e3e24874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '206fdb91bc084353809c3c19f1e029c8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:08.085674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1106/2185] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:07 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:42:08.092207 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f727869-c39d-49e9-8c1d-75c762325c13 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:08.178370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c98894e1-5a97-498f-81b8-a896e3e24874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '206fdb91bc084353809c3c19f1e029c8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:08.206725 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c98894e1-5a97-498f-81b8-a896e3e24874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '206fdb91bc084353809c3c19f1e029c8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:08.208034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c98894e1-5a97-498f-81b8-a896e3e24874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '206fdb91bc084353809c3c19f1e029c8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:08.225331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f727869-c39d-49e9-8c1d-75c762325c13 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:08.245854 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca95c1-14fa-4eef-ac9f-18b59030b8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:08.247034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca95c1-14fa-4eef-ac9f-18b59030b8ef admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:08.248381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca95c1-14fa-4eef-ac9f-18b59030b8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:08.249510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca95c1-14fa-4eef-ac9f-18b59030b8ef admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:08.250764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c98894e1-5a97-498f-81b8-a896e3e24874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '206fdb91bc084353809c3c19f1e029c8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:08.255991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca95c1-14fa-4eef-ac9f-18b59030b8ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:08.260462 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca95c1-14fa-4eef-ac9f-18b59030b8ef admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:08.271008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1080/2186] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:07 2022] DELETE /identity/v3/users/206fdb91bc084353809c3c19f1e029c8 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:08.379423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:08.392715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98894e1-5a97-498f-81b8-a896e3e24874 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:08.396660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c98894e1-5a97-498f-81b8-a896e3e24874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:08.408896 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1107/2187] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:08 2022] POST /identity/v3/users => generated 286 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:08.562783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98894e1-5a97-498f-81b8-a896e3e24874 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:08.572135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ec151-c69f-44a6-a628-3c9d1afb59e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:08.574209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ec151-c69f-44a6-a628-3c9d1afb59e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:08.574607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ec151-c69f-44a6-a628-3c9d1afb59e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:08.577476 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ec151-c69f-44a6-a628-3c9d1afb59e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:08.577476 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ec151-c69f-44a6-a628-3c9d1afb59e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:08.582154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ec151-c69f-44a6-a628-3c9d1afb59e9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:08.625686 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1081/2188] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:08.635193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca95c1-14fa-4eef-ac9f-18b59030b8ef admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:08.670946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca95c1-14fa-4eef-ac9f-18b59030b8ef admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:08.681377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221044f-05cc-42ad-a110-d8f266c6b46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:08.682954 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221044f-05cc-42ad-a110-d8f266c6b46f admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:08.683516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221044f-05cc-42ad-a110-d8f266c6b46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:08.684485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221044f-05cc-42ad-a110-d8f266c6b46f admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:08.686810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221044f-05cc-42ad-a110-d8f266c6b46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:08.691464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221044f-05cc-42ad-a110-d8f266c6b46f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:08.717983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1108/2189] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:08.724568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ec151-c69f-44a6-a628-3c9d1afb59e9 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:08.748417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ec151-c69f-44a6-a628-3c9d1afb59e9 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:08.769956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd277212-38fe-4404-bc35-f9170c7b3c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:08.771318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd277212-38fe-4404-bc35-f9170c7b3c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:08.771927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd277212-38fe-4404-bc35-f9170c7b3c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:08.772388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd277212-38fe-4404-bc35-f9170c7b3c47 admin admin] PATH_INFO: `/v3/projects/d04d1d5762024f3a9ffe2ec28ab4e666/users/2e2d0f23c6304c6aae8fbb92c5907745/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:08.797472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd277212-38fe-4404-bc35-f9170c7b3c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04d1d5762024f3a9ffe2ec28ab4e666, user_id=2e2d0f23c6304c6aae8fbb92c5907745, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:08.800915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd277212-38fe-4404-bc35-f9170c7b3c47 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:08.955033 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1082/2190] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:08 2022] PUT /identity/v3/projects/d04d1d5762024f3a9ffe2ec28ab4e666/users/2e2d0f23c6304c6aae8fbb92c5907745/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:08.960973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00acff-1109-4433-9abe-3a2ad09db5da None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:08.961459 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00acff-1109-4433-9abe-3a2ad09db5da None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:08.967906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00acff-1109-4433-9abe-3a2ad09db5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:09.039917 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5e00acff-1109-4433-9abe-3a2ad09db5da None None] MFA Rules not processed for user `2e2d0f23c6304c6aae8fbb92c5907745`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:09.042980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5e00acff-1109-4433-9abe-3a2ad09db5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:09.064513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:09.158983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1109/2191] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:09.174909 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd277212-38fe-4404-bc35-f9170c7b3c47 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:09.180066 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-dd277212-38fe-4404-bc35-f9170c7b3c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:09.282137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd277212-38fe-4404-bc35-f9170c7b3c47 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:09.288649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf504f-8f45-494c-b8b5-c8c476b32524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:09.289797 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf504f-8f45-494c-b8b5-c8c476b32524 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:09.290388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf504f-8f45-494c-b8b5-c8c476b32524 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:09.290923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf504f-8f45-494c-b8b5-c8c476b32524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:09.308967 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf504f-8f45-494c-b8b5-c8c476b32524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:09.312126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf504f-8f45-494c-b8b5-c8c476b32524 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:09.320131 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00acff-1109-4433-9abe-3a2ad09db5da None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:09.322805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5e00acff-1109-4433-9abe-3a2ad09db5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:09.334718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1083/2192] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:09.383086 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf504f-8f45-494c-b8b5-c8c476b32524 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:09.562865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00acff-1109-4433-9abe-3a2ad09db5da None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:09.595165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e1ee9-39be-42b0-8334-993ef40b2cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:09.595165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e1ee9-39be-42b0-8334-993ef40b2cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:09.595165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e1ee9-39be-42b0-8334-993ef40b2cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:09.595165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e1ee9-39be-42b0-8334-993ef40b2cf4 admin admin] PATH_INFO: `/v3/projects/741284cc949a46329624eef1adea2771` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:09.604863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e1ee9-39be-42b0-8334-993ef40b2cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=741284cc949a46329624eef1adea2771)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:09.612087 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf504f-8f45-494c-b8b5-c8c476b32524 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:09.617892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e1ee9-39be-42b0-8334-993ef40b2cf4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:09.629496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9d36b-7b8e-4177-ad70-9895c059e717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:09.629496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9d36b-7b8e-4177-ad70-9895c059e717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:09.630021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9d36b-7b8e-4177-ad70-9895c059e717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:09.630562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9d36b-7b8e-4177-ad70-9895c059e717 admin admin] PATH_INFO: `/v3/users/2e2d0f23c6304c6aae8fbb92c5907745` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:09.633046 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9d36b-7b8e-4177-ad70-9895c059e717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e2d0f23c6304c6aae8fbb92c5907745)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:09.637453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9d36b-7b8e-4177-ad70-9895c059e717 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:09.925265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-942e1ee9-39be-42b0-8334-993ef40b2cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '741284cc949a46329624eef1adea2771', 'request_id': 'req-942e1ee9-39be-42b0-8334-993ef40b2cf4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:09.943294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-942e1ee9-39be-42b0-8334-993ef40b2cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '741284cc949a46329624eef1adea2771', 'request_id': 'req-942e1ee9-39be-42b0-8334-993ef40b2cf4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:09.978950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-942e1ee9-39be-42b0-8334-993ef40b2cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '741284cc949a46329624eef1adea2771', 'request_id': 'req-942e1ee9-39be-42b0-8334-993ef40b2cf4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:10.026929 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1bc9d36b-7b8e-4177-ad70-9895c059e717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e2d0f23c6304c6aae8fbb92c5907745'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:10.111021 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-942e1ee9-39be-42b0-8334-993ef40b2cf4 admin admin] The token cache is being invalidate because project 741284cc949a46329624eef1adea2771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:10.112091 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-942e1ee9-39be-42b0-8334-993ef40b2cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:10.112799 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-942e1ee9-39be-42b0-8334-993ef40b2cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:10.115510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1110/2193] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:09 2022] DELETE /identity/v3/projects/741284cc949a46329624eef1adea2771 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:10.117714 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e1ee9-39be-42b0-8334-993ef40b2cf4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:10.127699 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-942e1ee9-39be-42b0-8334-993ef40b2cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:10.201101 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1bc9d36b-7b8e-4177-ad70-9895c059e717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e2d0f23c6304c6aae8fbb92c5907745'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:10.244625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1bc9d36b-7b8e-4177-ad70-9895c059e717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e2d0f23c6304c6aae8fbb92c5907745'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:10.252026 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1bc9d36b-7b8e-4177-ad70-9895c059e717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e2d0f23c6304c6aae8fbb92c5907745'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:10.269597 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e1ee9-39be-42b0-8334-993ef40b2cf4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:10.291454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628dfd5-a148-4170-a611-b2953fb340ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:10.292920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628dfd5-a148-4170-a611-b2953fb340ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:10.294341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628dfd5-a148-4170-a611-b2953fb340ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:10.294882 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628dfd5-a148-4170-a611-b2953fb340ac admin admin] PATH_INFO: `/v3/users/b08f79b30b21410cad0415efee3be014` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:10.298122 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628dfd5-a148-4170-a611-b2953fb340ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08f79b30b21410cad0415efee3be014)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:10.302828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628dfd5-a148-4170-a611-b2953fb340ac admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:10.313163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1bc9d36b-7b8e-4177-ad70-9895c059e717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e2d0f23c6304c6aae8fbb92c5907745'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:10.329803 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1084/2194] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:09 2022] DELETE /identity/v3/users/2e2d0f23c6304c6aae8fbb92c5907745 => generated 0 bytes in 948 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:10.335859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd28c-d5e1-447e-9052-4aa93f25160a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:10.339306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd28c-d5e1-447e-9052-4aa93f25160a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:10.340063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd28c-d5e1-447e-9052-4aa93f25160a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:10.394810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6b9dd28c-d5e1-447e-9052-4aa93f25160a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:10.396978 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6b9dd28c-d5e1-447e-9052-4aa93f25160a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:10.593696 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1085/2195] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:10.596146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4d127-e4d1-4f3d-ba21-d409588e5ac3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:10.597004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4d127-e4d1-4f3d-ba21-d409588e5ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:10.597749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4d127-e4d1-4f3d-ba21-d409588e5ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:10.654278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0628dfd5-a148-4170-a611-b2953fb340ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08f79b30b21410cad0415efee3be014'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:10.726053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a9d4d127-e4d1-4f3d-ba21-d409588e5ac3 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:10.728773 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a9d4d127-e4d1-4f3d-ba21-d409588e5ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:10.747499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1086/2196] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:10.747499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16136a-f1ac-482d-923e-0f117b291feb None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:10.747499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16136a-f1ac-482d-923e-0f117b291feb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:10.747499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16136a-f1ac-482d-923e-0f117b291feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:10.754771 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0628dfd5-a148-4170-a611-b2953fb340ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08f79b30b21410cad0415efee3be014'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:10.768941 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0628dfd5-a148-4170-a611-b2953fb340ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08f79b30b21410cad0415efee3be014'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:10.771121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0628dfd5-a148-4170-a611-b2953fb340ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08f79b30b21410cad0415efee3be014'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:10.820106 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-da16136a-f1ac-482d-923e-0f117b291feb None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:10.822833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-da16136a-f1ac-482d-923e-0f117b291feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:10.824228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0628dfd5-a148-4170-a611-b2953fb340ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08f79b30b21410cad0415efee3be014'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:10.846659 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1111/2197] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:10 2022] DELETE /identity/v3/users/b08f79b30b21410cad0415efee3be014 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:10.853201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628dfd5-a148-4170-a611-b2953fb340ac admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:10.856171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0628dfd5-a148-4170-a611-b2953fb340ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:10.866958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1087/2198] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:10.871542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573612df-71a7-4e9c-b8f2-9d110bddb097 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:10.871542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573612df-71a7-4e9c-b8f2-9d110bddb097 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:10.871542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573612df-71a7-4e9c-b8f2-9d110bddb097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:10.933840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-573612df-71a7-4e9c-b8f2-9d110bddb097 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:10.936131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-573612df-71a7-4e9c-b8f2-9d110bddb097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:11.099840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628dfd5-a148-4170-a611-b2953fb340ac admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:11.104011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614382e2-22d6-4aa8-a255-71a5931830fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:11.104679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614382e2-22d6-4aa8-a255-71a5931830fb service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:11.104959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614382e2-22d6-4aa8-a255-71a5931830fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:11.105232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614382e2-22d6-4aa8-a255-71a5931830fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:11.120971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-614382e2-22d6-4aa8-a255-71a5931830fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:11.135491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614382e2-22d6-4aa8-a255-71a5931830fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:11.137055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614382e2-22d6-4aa8-a255-71a5931830fb service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:11.147905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1088/2199] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:11.149842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573612df-71a7-4e9c-b8f2-9d110bddb097 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:11.151451 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1112/2200] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:11.163885 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614382e2-22d6-4aa8-a255-71a5931830fb service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:11.170226 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-614382e2-22d6-4aa8-a255-71a5931830fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:11.175454 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573612df-71a7-4e9c-b8f2-9d110bddb097 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:11.187497 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e778ac-d335-4e9d-b37f-e13d4ba7d0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:11.188669 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e778ac-d335-4e9d-b37f-e13d4ba7d0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:11.190748 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614382e2-22d6-4aa8-a255-71a5931830fb service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:11.191331 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e778ac-d335-4e9d-b37f-e13d4ba7d0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:11.191627 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e778ac-d335-4e9d-b37f-e13d4ba7d0b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:11.192864 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e778ac-d335-4e9d-b37f-e13d4ba7d0b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:11.193798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e778ac-d335-4e9d-b37f-e13d4ba7d0b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:11.196100 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e778ac-d335-4e9d-b37f-e13d4ba7d0b4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:11.200813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fddc8-d13c-497e-a576-ba3a6eb6b424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:11.201486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fddc8-d13c-497e-a576-ba3a6eb6b424 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:11.201767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fddc8-d13c-497e-a576-ba3a6eb6b424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:11.202093 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fddc8-d13c-497e-a576-ba3a6eb6b424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:11.235102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fddc8-d13c-497e-a576-ba3a6eb6b424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:11.235385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1089/2201] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:11.238451 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fddc8-d13c-497e-a576-ba3a6eb6b424 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:11.246549 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=18,keystone:SELECT=79,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:11.246549 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e778ac-d335-4e9d-b37f-e13d4ba7d0b4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:11.261592 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e778ac-d335-4e9d-b37f-e13d4ba7d0b4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:11.266681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1113/2202] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:11.274984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e54b9f-4c96-4a94-961c-11a7d66d757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:11.279256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e54b9f-4c96-4a94-961c-11a7d66d757f admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:11.279256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e54b9f-4c96-4a94-961c-11a7d66d757f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:11.279256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e54b9f-4c96-4a94-961c-11a7d66d757f admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:11.279256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e54b9f-4c96-4a94-961c-11a7d66d757f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:11.279897 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e54b9f-4c96-4a94-961c-11a7d66d757f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:11.403563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1090/2203] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:11 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:11.410043 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fddc8-d13c-497e-a576-ba3a6eb6b424 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:11.434089 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fddc8-d13c-497e-a576-ba3a6eb6b424 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:11.545863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af982f8-4cdc-4122-b92e-df769206b5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:11.550006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af982f8-4cdc-4122-b92e-df769206b5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:11.550006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af982f8-4cdc-4122-b92e-df769206b5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:11.550006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af982f8-4cdc-4122-b92e-df769206b5d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:11.550499 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af982f8-4cdc-4122-b92e-df769206b5d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:11.556386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af982f8-4cdc-4122-b92e-df769206b5d5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:11.714113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:11.783193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e54b9f-4c96-4a94-961c-11a7d66d757f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:11.791375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1114/2204] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:11 2022] POST /identity/v3/users => generated 293 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:11.810696 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e54b9f-4c96-4a94-961c-11a7d66d757f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:11.834699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2307c0f-3fde-443c-9ff0-ca74e3928073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:11.836135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2307c0f-3fde-443c-9ff0-ca74e3928073 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:11.836875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2307c0f-3fde-443c-9ff0-ca74e3928073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:11.837536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2307c0f-3fde-443c-9ff0-ca74e3928073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:11.839018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2307c0f-3fde-443c-9ff0-ca74e3928073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:11.844449 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2307c0f-3fde-443c-9ff0-ca74e3928073 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:11.901218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af982f8-4cdc-4122-b92e-df769206b5d5 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:11.925073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1091/2205] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:11.950888 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af982f8-4cdc-4122-b92e-df769206b5d5 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:11.965698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81663d9-624f-4528-811f-d69a4440d7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:11.967042 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81663d9-624f-4528-811f-d69a4440d7ac admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:11.967690 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81663d9-624f-4528-811f-d69a4440d7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:11.968356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81663d9-624f-4528-811f-d69a4440d7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:11.969915 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81663d9-624f-4528-811f-d69a4440d7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:11.973401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81663d9-624f-4528-811f-d69a4440d7ac admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:11.998989 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1115/2206] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:12.002544 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2307c0f-3fde-443c-9ff0-ca74e3928073 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:12.017477 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2307c0f-3fde-443c-9ff0-ca74e3928073 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:12.024967 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f738853-c5be-44c1-bffb-5eb3a2b78067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:12.027441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f738853-c5be-44c1-bffb-5eb3a2b78067 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:12.028015 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f738853-c5be-44c1-bffb-5eb3a2b78067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:12.048655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f738853-c5be-44c1-bffb-5eb3a2b78067 admin admin] PATH_INFO: `/v3/projects/02965800a3774664bf1652fe426858fe/users/c0ded60bccab47f4978b87794a9ef9fd/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:12.101514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f738853-c5be-44c1-bffb-5eb3a2b78067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02965800a3774664bf1652fe426858fe, user_id=c0ded60bccab47f4978b87794a9ef9fd, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:12.105833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f738853-c5be-44c1-bffb-5eb3a2b78067 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:12.213918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1092/2207] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:12 2022] PUT /identity/v3/projects/02965800a3774664bf1652fe426858fe/users/c0ded60bccab47f4978b87794a9ef9fd/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:12.242129 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4950e1-203b-402b-936a-6f5c756115d4 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:12.244585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4950e1-203b-402b-936a-6f5c756115d4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:12.245830 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4950e1-203b-402b-936a-6f5c756115d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:12.317066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ef4950e1-203b-402b-936a-6f5c756115d4 None None] MFA Rules not processed for user `c0ded60bccab47f4978b87794a9ef9fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:12.320952 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ef4950e1-203b-402b-936a-6f5c756115d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:12.536813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1116/2208] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:12.555803 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f738853-c5be-44c1-bffb-5eb3a2b78067 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:12.559333 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0f738853-c5be-44c1-bffb-5eb3a2b78067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:12.664140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4950e1-203b-402b-936a-6f5c756115d4 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:12.666375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ef4950e1-203b-402b-936a-6f5c756115d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:12.785043 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:12.795575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f738853-c5be-44c1-bffb-5eb3a2b78067 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:12.816242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78f827-06f4-4917-b5d2-7a6c17e58ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:12.817532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78f827-06f4-4917-b5d2-7a6c17e58ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:12.818160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78f827-06f4-4917-b5d2-7a6c17e58ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:12.819459 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78f827-06f4-4917-b5d2-7a6c17e58ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:12.855541 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78f827-06f4-4917-b5d2-7a6c17e58ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:12.858216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78f827-06f4-4917-b5d2-7a6c17e58ed6 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:12.907658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4950e1-203b-402b-936a-6f5c756115d4 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:12.915443 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1093/2209] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:12.918074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3b48b-ee82-4091-900b-98f0310e5d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:12.919847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b48b-ee82-4091-900b-98f0310e5d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:12.920329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b48b-ee82-4091-900b-98f0310e5d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:12.920631 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b48b-ee82-4091-900b-98f0310e5d9e admin admin] PATH_INFO: `/v3/projects/d04d1d5762024f3a9ffe2ec28ab4e666` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:12.923568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3b48b-ee82-4091-900b-98f0310e5d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04d1d5762024f3a9ffe2ec28ab4e666)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:12.925664 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3b48b-ee82-4091-900b-98f0310e5d9e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:12.956427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78f827-06f4-4917-b5d2-7a6c17e58ed6 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:12.999781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:13.004245 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78f827-06f4-4917-b5d2-7a6c17e58ed6 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:13.025759 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fc7c9-f5f9-4659-b114-d107dac2150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:13.028292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fc7c9-f5f9-4659-b114-d107dac2150a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:13.028969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fc7c9-f5f9-4659-b114-d107dac2150a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:13.029798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fc7c9-f5f9-4659-b114-d107dac2150a admin admin] PATH_INFO: `/v3/users/c0ded60bccab47f4978b87794a9ef9fd` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:13.045009 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fc7c9-f5f9-4659-b114-d107dac2150a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ded60bccab47f4978b87794a9ef9fd)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:13.053429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fc7c9-f5f9-4659-b114-d107dac2150a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:13.200157 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-cdc3b48b-ee82-4091-900b-98f0310e5d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04d1d5762024f3a9ffe2ec28ab4e666', 'request_id': 'req-cdc3b48b-ee82-4091-900b-98f0310e5d9e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:13.220538 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-cdc3b48b-ee82-4091-900b-98f0310e5d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04d1d5762024f3a9ffe2ec28ab4e666', 'request_id': 'req-cdc3b48b-ee82-4091-900b-98f0310e5d9e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:13.235723 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-cdc3b48b-ee82-4091-900b-98f0310e5d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04d1d5762024f3a9ffe2ec28ab4e666', 'request_id': 'req-cdc3b48b-ee82-4091-900b-98f0310e5d9e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:13.333443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-cdc3b48b-ee82-4091-900b-98f0310e5d9e admin admin] The token cache is being invalidate because project d04d1d5762024f3a9ffe2ec28ab4e666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:13.333932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-cdc3b48b-ee82-4091-900b-98f0310e5d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:13.335188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-cdc3b48b-ee82-4091-900b-98f0310e5d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:13.348250 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1117/2210] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:12 2022] DELETE /identity/v3/projects/d04d1d5762024f3a9ffe2ec28ab4e666 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:13.351265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d1ca4-c075-432f-a626-74972fdb8247 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:13.352170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d1ca4-c075-432f-a626-74972fdb8247 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:13.356480 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d1ca4-c075-432f-a626-74972fdb8247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:13.378776 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-548fc7c9-f5f9-4659-b114-d107dac2150a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ded60bccab47f4978b87794a9ef9fd'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:13.435715 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-523d1ca4-c075-432f-a626-74972fdb8247 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:13.448677 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-523d1ca4-c075-432f-a626-74972fdb8247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:13.474987 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-548fc7c9-f5f9-4659-b114-d107dac2150a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ded60bccab47f4978b87794a9ef9fd'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:13.510302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-548fc7c9-f5f9-4659-b114-d107dac2150a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ded60bccab47f4978b87794a9ef9fd'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:13.513396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-548fc7c9-f5f9-4659-b114-d107dac2150a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ded60bccab47f4978b87794a9ef9fd'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:13.591011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-548fc7c9-f5f9-4659-b114-d107dac2150a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ded60bccab47f4978b87794a9ef9fd'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:13.621194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1094/2211] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:12 2022] DELETE /identity/v3/users/c0ded60bccab47f4978b87794a9ef9fd => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:13.644051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdba34-45fa-40fe-9a6a-ccb30211c5db None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:13.646176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdba34-45fa-40fe-9a6a-ccb30211c5db None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:13.647208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdba34-45fa-40fe-9a6a-ccb30211c5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:13.705246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1118/2212] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:13.721200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14222f49-9637-416c-a149-2d03df263e52 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:13.722218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14222f49-9637-416c-a149-2d03df263e52 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:13.722809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14222f49-9637-416c-a149-2d03df263e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:13.734094 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-14cdba34-45fa-40fe-9a6a-ccb30211c5db None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:13.744449 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-14cdba34-45fa-40fe-9a6a-ccb30211c5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:13.747476 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:13.815055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-14222f49-9637-416c-a149-2d03df263e52 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:13.821166 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-14222f49-9637-416c-a149-2d03df263e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:13.996823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1095/2213] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:13.997905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdba34-45fa-40fe-9a6a-ccb30211c5db None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:14.002302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-14cdba34-45fa-40fe-9a6a-ccb30211c5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:14.028055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdba34-45fa-40fe-9a6a-ccb30211c5db None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:14.041203 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1119/2214] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:14.043579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14222f49-9637-416c-a149-2d03df263e52 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:14.045622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-14222f49-9637-416c-a149-2d03df263e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:14.047455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2be744-4113-4eca-beae-79d2eb47a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:14.048422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2be744-4113-4eca-beae-79d2eb47a1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:14.048709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2be744-4113-4eca-beae-79d2eb47a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:14.048985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2be744-4113-4eca-beae-79d2eb47a1f6 admin admin] PATH_INFO: `/v3/projects/3fbcccaf6561411b8ed955d89cc94e7b` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:14.051270 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2be744-4113-4eca-beae-79d2eb47a1f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fbcccaf6561411b8ed955d89cc94e7b)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:14.053830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2be744-4113-4eca-beae-79d2eb47a1f6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:14.210477 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14222f49-9637-416c-a149-2d03df263e52 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:14.250629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ab2be744-4113-4eca-beae-79d2eb47a1f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fbcccaf6561411b8ed955d89cc94e7b', 'request_id': 'req-ab2be744-4113-4eca-beae-79d2eb47a1f6'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:14.263367 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ab2be744-4113-4eca-beae-79d2eb47a1f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fbcccaf6561411b8ed955d89cc94e7b', 'request_id': 'req-ab2be744-4113-4eca-beae-79d2eb47a1f6'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:14.278209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ab2be744-4113-4eca-beae-79d2eb47a1f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fbcccaf6561411b8ed955d89cc94e7b', 'request_id': 'req-ab2be744-4113-4eca-beae-79d2eb47a1f6'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:14.342117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc98bf-1cac-42ad-a56f-ef81be98de5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:14.343226 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc98bf-1cac-42ad-a56f-ef81be98de5d service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:14.343961 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc98bf-1cac-42ad-a56f-ef81be98de5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:14.344505 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc98bf-1cac-42ad-a56f-ef81be98de5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:14.392397 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ab2be744-4113-4eca-beae-79d2eb47a1f6 admin admin] The token cache is being invalidate because project 3fbcccaf6561411b8ed955d89cc94e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:14.393106 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ab2be744-4113-4eca-beae-79d2eb47a1f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:14.395059 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ab2be744-4113-4eca-beae-79d2eb47a1f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:14.398234 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1096/2215] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:13 2022] DELETE /identity/v3/projects/3fbcccaf6561411b8ed955d89cc94e7b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:14.402193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2be744-4113-4eca-beae-79d2eb47a1f6 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:14.409505 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ab2be744-4113-4eca-beae-79d2eb47a1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:14.509165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc98bf-1cac-42ad-a56f-ef81be98de5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:14.516407 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc98bf-1cac-42ad-a56f-ef81be98de5d service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:14.544110 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2be744-4113-4eca-beae-79d2eb47a1f6 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:14.545032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1120/2216] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:14.547877 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc98bf-1cac-42ad-a56f-ef81be98de5d service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:14.566794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa303d6-14d2-478d-b52d-796fd6d99e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:14.567674 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa303d6-14d2-478d-b52d-796fd6d99e60 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:14.567964 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa303d6-14d2-478d-b52d-796fd6d99e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:14.568259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa303d6-14d2-478d-b52d-796fd6d99e60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:14.569029 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa303d6-14d2-478d-b52d-796fd6d99e60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:14.569416 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa303d6-14d2-478d-b52d-796fd6d99e60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:14.575709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa303d6-14d2-478d-b52d-796fd6d99e60 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:14.576449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc98bf-1cac-42ad-a56f-ef81be98de5d service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:14.590472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428bda6-2ddd-41b2-b004-77b3d193eabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:14.592744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428bda6-2ddd-41b2-b004-77b3d193eabd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:14.592744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428bda6-2ddd-41b2-b004-77b3d193eabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:14.592744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428bda6-2ddd-41b2-b004-77b3d193eabd admin admin] PATH_INFO: `/v3/users/d9fce56bbe5f4f53beaeeb81e91d947c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:14.602044 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428bda6-2ddd-41b2-b004-77b3d193eabd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9fce56bbe5f4f53beaeeb81e91d947c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:14.602044 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428bda6-2ddd-41b2-b004-77b3d193eabd admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:14.611688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:14.622055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1097/2217] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:14.628779 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa303d6-14d2-478d-b52d-796fd6d99e60 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:14.652938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa303d6-14d2-478d-b52d-796fd6d99e60 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:14.667605 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319ae33-04f3-43c2-89e5-ef545e12a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:14.670570 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319ae33-04f3-43c2-89e5-ef545e12a92a admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:14.676750 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319ae33-04f3-43c2-89e5-ef545e12a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:14.676750 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319ae33-04f3-43c2-89e5-ef545e12a92a admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:14.676750 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319ae33-04f3-43c2-89e5-ef545e12a92a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:14.681347 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319ae33-04f3-43c2-89e5-ef545e12a92a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:14.799688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1098/2218] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:14 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:14.806375 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319ae33-04f3-43c2-89e5-ef545e12a92a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:14.892302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8428bda6-2ddd-41b2-b004-77b3d193eabd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9fce56bbe5f4f53beaeeb81e91d947c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:14.971891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8428bda6-2ddd-41b2-b004-77b3d193eabd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9fce56bbe5f4f53beaeeb81e91d947c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:14.989079 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8428bda6-2ddd-41b2-b004-77b3d193eabd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9fce56bbe5f4f53beaeeb81e91d947c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:14.991647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8428bda6-2ddd-41b2-b004-77b3d193eabd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9fce56bbe5f4f53beaeeb81e91d947c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:15.039640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8428bda6-2ddd-41b2-b004-77b3d193eabd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9fce56bbe5f4f53beaeeb81e91d947c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:15.083513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1121/2219] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:14 2022] DELETE /identity/v3/users/d9fce56bbe5f4f53beaeeb81e91d947c => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:15.126441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319ae33-04f3-43c2-89e5-ef545e12a92a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:15.323957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6ab50-cb54-4328-babe-839636412f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:15.324735 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6ab50-cb54-4328-babe-839636412f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:15.327854 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6ab50-cb54-4328-babe-839636412f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:15.329103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6ab50-cb54-4328-babe-839636412f89 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:15.331292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6ab50-cb54-4328-babe-839636412f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:15.338892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6ab50-cb54-4328-babe-839636412f89 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:15.463758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1099/2220] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:14 2022] POST /identity/v3/users => generated 288 bytes in 664 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:15.472948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428bda6-2ddd-41b2-b004-77b3d193eabd admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:15.487962 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8428bda6-2ddd-41b2-b004-77b3d193eabd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:15.544717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428bda6-2ddd-41b2-b004-77b3d193eabd admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:15.571131 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec4431-0399-4b3b-9113-51b43c876805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:15.575049 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:15.581837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec4431-0399-4b3b-9113-51b43c876805 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:15.581837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec4431-0399-4b3b-9113-51b43c876805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:15.581837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec4431-0399-4b3b-9113-51b43c876805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:15.581837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec4431-0399-4b3b-9113-51b43c876805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:15.581837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec4431-0399-4b3b-9113-51b43c876805 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:15.597788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1122/2221] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:15.608256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6ab50-cb54-4328-babe-839636412f89 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:15.628196 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6ab50-cb54-4328-babe-839636412f89 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:15.637684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e571df-c134-4362-90ff-bb98f6e66b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:15.639417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e571df-c134-4362-90ff-bb98f6e66b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:15.639417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e571df-c134-4362-90ff-bb98f6e66b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:15.639417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e571df-c134-4362-90ff-bb98f6e66b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:15.640478 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e571df-c134-4362-90ff-bb98f6e66b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:15.643778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e571df-c134-4362-90ff-bb98f6e66b22 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:15.674144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1100/2222] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:15.677455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec4431-0399-4b3b-9113-51b43c876805 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:15.692682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec4431-0399-4b3b-9113-51b43c876805 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:15.700105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f8e60-e298-4392-b1c5-33e82ca1e23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:15.701187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f8e60-e298-4392-b1c5-33e82ca1e23a admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:15.701669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f8e60-e298-4392-b1c5-33e82ca1e23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:15.702064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f8e60-e298-4392-b1c5-33e82ca1e23a admin admin] PATH_INFO: `/v3/projects/bc89152384de437899d1e32d217e516a/users/f9ad882f6bbd4c388a63a0fe23873d11/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:15.743648 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f8e60-e298-4392-b1c5-33e82ca1e23a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc89152384de437899d1e32d217e516a, user_id=f9ad882f6bbd4c388a63a0fe23873d11, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:15.750792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f8e60-e298-4392-b1c5-33e82ca1e23a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:15.913584 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1123/2223] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:15 2022] PUT /identity/v3/projects/bc89152384de437899d1e32d217e516a/users/f9ad882f6bbd4c388a63a0fe23873d11/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:15.915550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d46fb-e89e-43bb-bb82-e2923da56f44 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:15.915923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d46fb-e89e-43bb-bb82-e2923da56f44 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:15.916258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d46fb-e89e-43bb-bb82-e2923da56f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:16.047254 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-812d46fb-e89e-43bb-bb82-e2923da56f44 None None] MFA Rules not processed for user `f9ad882f6bbd4c388a63a0fe23873d11`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:16.048608 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-812d46fb-e89e-43bb-bb82-e2923da56f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:16.238435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1101/2224] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:16.254512 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f8e60-e298-4392-b1c5-33e82ca1e23a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:16.258202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-791f8e60-e298-4392-b1c5-33e82ca1e23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:16.373540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d46fb-e89e-43bb-bb82-e2923da56f44 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:16.375965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-812d46fb-e89e-43bb-bb82-e2923da56f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:16.387734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f8e60-e298-4392-b1c5-33e82ca1e23a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:16.393041 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a11694-5cb2-4023-8c7b-b7ecb86001b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:16.393733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a11694-5cb2-4023-8c7b-b7ecb86001b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:16.393999 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a11694-5cb2-4023-8c7b-b7ecb86001b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:16.394276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a11694-5cb2-4023-8c7b-b7ecb86001b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:16.404686 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a11694-5cb2-4023-8c7b-b7ecb86001b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:16.407487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a11694-5cb2-4023-8c7b-b7ecb86001b8 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:16.434710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1124/2225] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:16.461247 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a11694-5cb2-4023-8c7b-b7ecb86001b8 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:16.461512 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:16.472261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-49a11694-5cb2-4023-8c7b-b7ecb86001b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:16.567506 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d46fb-e89e-43bb-bb82-e2923da56f44 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:16.591568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a1b8f-6b43-4616-820b-a6732ab368bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:16.595214 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a1b8f-6b43-4616-820b-a6732ab368bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:16.595644 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a1b8f-6b43-4616-820b-a6732ab368bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:16.595936 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a1b8f-6b43-4616-820b-a6732ab368bf admin admin] PATH_INFO: `/v3/projects/02965800a3774664bf1652fe426858fe` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:16.602868 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a1b8f-6b43-4616-820b-a6732ab368bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=02965800a3774664bf1652fe426858fe)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:16.609985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a1b8f-6b43-4616-820b-a6732ab368bf admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:16.711381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a11694-5cb2-4023-8c7b-b7ecb86001b8 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:16.729923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2c33c-9fa7-4bee-9d1a-f4ee2e3e23d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:16.731200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2c33c-9fa7-4bee-9d1a-f4ee2e3e23d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:16.731578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2c33c-9fa7-4bee-9d1a-f4ee2e3e23d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:16.732469 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2c33c-9fa7-4bee-9d1a-f4ee2e3e23d7 admin admin] PATH_INFO: `/v3/projects/8cca9cb830ef4a86b1fc24a5fb8a50d5` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:16.736445 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2c33c-9fa7-4bee-9d1a-f4ee2e3e23d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cca9cb830ef4a86b1fc24a5fb8a50d5)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:16.739933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2c33c-9fa7-4bee-9d1a-f4ee2e3e23d7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:16.823919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-479a1b8f-6b43-4616-820b-a6732ab368bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02965800a3774664bf1652fe426858fe', 'request_id': 'req-479a1b8f-6b43-4616-820b-a6732ab368bf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:16.854370 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-479a1b8f-6b43-4616-820b-a6732ab368bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02965800a3774664bf1652fe426858fe', 'request_id': 'req-479a1b8f-6b43-4616-820b-a6732ab368bf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:16.867523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-479a1b8f-6b43-4616-820b-a6732ab368bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02965800a3774664bf1652fe426858fe', 'request_id': 'req-479a1b8f-6b43-4616-820b-a6732ab368bf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:16.921856 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:16.974028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b4d2c33c-9fa7-4bee-9d1a-f4ee2e3e23d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cca9cb830ef4a86b1fc24a5fb8a50d5', 'request_id': 'req-b4d2c33c-9fa7-4bee-9d1a-f4ee2e3e23d7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:16.985208 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b4d2c33c-9fa7-4bee-9d1a-f4ee2e3e23d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cca9cb830ef4a86b1fc24a5fb8a50d5', 'request_id': 'req-b4d2c33c-9fa7-4bee-9d1a-f4ee2e3e23d7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:17.006835 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b4d2c33c-9fa7-4bee-9d1a-f4ee2e3e23d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cca9cb830ef4a86b1fc24a5fb8a50d5', 'request_id': 'req-b4d2c33c-9fa7-4bee-9d1a-f4ee2e3e23d7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:17.054974 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-479a1b8f-6b43-4616-820b-a6732ab368bf admin admin] The token cache is being invalidate because project 02965800a3774664bf1652fe426858fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:17.055807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-479a1b8f-6b43-4616-820b-a6732ab368bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:17.058442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-479a1b8f-6b43-4616-820b-a6732ab368bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:17.071301 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1102/2226] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:16 2022] DELETE /identity/v3/projects/02965800a3774664bf1652fe426858fe => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:17.073832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd1d43-6380-4902-b33d-a710975d8dd2 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:17.074380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd1d43-6380-4902-b33d-a710975d8dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:17.075195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd1d43-6380-4902-b33d-a710975d8dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:17.129398 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b4d2c33c-9fa7-4bee-9d1a-f4ee2e3e23d7 admin admin] The token cache is being invalidate because project 8cca9cb830ef4a86b1fc24a5fb8a50d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:17.129776 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b4d2c33c-9fa7-4bee-9d1a-f4ee2e3e23d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:17.130641 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b4d2c33c-9fa7-4bee-9d1a-f4ee2e3e23d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:17.149027 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1125/2227] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:16 2022] DELETE /identity/v3/projects/8cca9cb830ef4a86b1fc24a5fb8a50d5 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:17.150794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba6c38-83a0-4f14-9f58-8a8115b25939 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:17.151198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba6c38-83a0-4f14-9f58-8a8115b25939 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:17.151572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba6c38-83a0-4f14-9f58-8a8115b25939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:17.178386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-38bd1d43-6380-4902-b33d-a710975d8dd2 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:17.187130 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-38bd1d43-6380-4902-b33d-a710975d8dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:17.218871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2dba6c38-83a0-4f14-9f58-8a8115b25939 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:17.223297 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2dba6c38-83a0-4f14-9f58-8a8115b25939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:17.408915 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1126/2228] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:17.411770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639602a-8dfd-4e19-80d9-cda03b1c2dde None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:17.413869 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639602a-8dfd-4e19-80d9-cda03b1c2dde None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:17.414513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639602a-8dfd-4e19-80d9-cda03b1c2dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:17.475282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7639602a-8dfd-4e19-80d9-cda03b1c2dde None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:17.479015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7639602a-8dfd-4e19-80d9-cda03b1c2dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:17.490627 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1103/2229] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:17.492926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df81a3f-ee90-407d-9525-14af128534b3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:17.493436 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df81a3f-ee90-407d-9525-14af128534b3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:17.494175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df81a3f-ee90-407d-9525-14af128534b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:17.558243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9df81a3f-ee90-407d-9525-14af128534b3 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:17.565910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9df81a3f-ee90-407d-9525-14af128534b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:17.599717 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1104/2230] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:17.619374 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c014d-4040-4d07-9183-022e6385d70e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:17.620354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c014d-4040-4d07-9183-022e6385d70e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:17.621055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c014d-4040-4d07-9183-022e6385d70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:17.686181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-154c014d-4040-4d07-9183-022e6385d70e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:17.694896 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-154c014d-4040-4d07-9183-022e6385d70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:17.704470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1127/2231] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 18 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:17.706747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639602a-8dfd-4e19-80d9-cda03b1c2dde None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:17.745451 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1105/2232] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:17.769455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c014d-4040-4d07-9183-022e6385d70e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:17.808257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c014d-4040-4d07-9183-022e6385d70e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:17.820202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639602a-8dfd-4e19-80d9-cda03b1c2dde None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:17.832875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97824f1d-e073-41e7-8d3c-07a97083c1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:17.839298 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97824f1d-e073-41e7-8d3c-07a97083c1fb admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:17.839298 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97824f1d-e073-41e7-8d3c-07a97083c1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:17.839298 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97824f1d-e073-41e7-8d3c-07a97083c1fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:17.839298 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97824f1d-e073-41e7-8d3c-07a97083c1fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:17.839298 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97824f1d-e073-41e7-8d3c-07a97083c1fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:17.840189 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97824f1d-e073-41e7-8d3c-07a97083c1fb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:17.855396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795d6a6-9236-4795-87bf-0c6fc8acffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:17.856463 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795d6a6-9236-4795-87bf-0c6fc8acffed admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:17.856969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795d6a6-9236-4795-87bf-0c6fc8acffed admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:17.857452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795d6a6-9236-4795-87bf-0c6fc8acffed admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:17.859147 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795d6a6-9236-4795-87bf-0c6fc8acffed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:17.859516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795d6a6-9236-4795-87bf-0c6fc8acffed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:17.882404 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795d6a6-9236-4795-87bf-0c6fc8acffed admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:17.930651 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1106/2233] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:42:17.941446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97824f1d-e073-41e7-8d3c-07a97083c1fb admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:17.957475 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-97824f1d-e073-41e7-8d3c-07a97083c1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:17.966163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1128/2234] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:17.975942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795d6a6-9236-4795-87bf-0c6fc8acffed admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:18.084606 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795d6a6-9236-4795-87bf-0c6fc8acffed admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:18.111317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9774827-ccc8-4f23-a402-39e0d3c2ef95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:18.114920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9774827-ccc8-4f23-a402-39e0d3c2ef95 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:18.115336 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9774827-ccc8-4f23-a402-39e0d3c2ef95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:18.115624 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9774827-ccc8-4f23-a402-39e0d3c2ef95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:18.116360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9774827-ccc8-4f23-a402-39e0d3c2ef95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:18.118425 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9774827-ccc8-4f23-a402-39e0d3c2ef95 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:18.270848 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97824f1d-e073-41e7-8d3c-07a97083c1fb admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:18.283770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc299ac2-6144-47bb-a4b1-7d80bc2df328 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:18.285239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc299ac2-6144-47bb-a4b1-7d80bc2df328 service swift] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:18.285985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc299ac2-6144-47bb-a4b1-7d80bc2df328 service swift] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:18.286752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc299ac2-6144-47bb-a4b1-7d80bc2df328 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:18.306581 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc299ac2-6144-47bb-a4b1-7d80bc2df328 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:18.310603 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc299ac2-6144-47bb-a4b1-7d80bc2df328 service swift] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:18.362286 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:18.390678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1107/2235] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:42:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:42:18.401736 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc299ac2-6144-47bb-a4b1-7d80bc2df328 service swift] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:18.417476 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1129/2236] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:17 2022] POST /identity/v3/projects => generated 369 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:18.419208 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9774827-ccc8-4f23-a402-39e0d3c2ef95 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:18.447538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc299ac2-6144-47bb-a4b1-7d80bc2df328 service swift] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:18.629668 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea50793-78a5-4eec-8a9d-9be5b77b5a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:18.640691 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea50793-78a5-4eec-8a9d-9be5b77b5a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:18.645623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea50793-78a5-4eec-8a9d-9be5b77b5a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:18.646387 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea50793-78a5-4eec-8a9d-9be5b77b5a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:18.648079 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea50793-78a5-4eec-8a9d-9be5b77b5a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:18.660560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea50793-78a5-4eec-8a9d-9be5b77b5a4e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:18.776592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9774827-ccc8-4f23-a402-39e0d3c2ef95 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:18.785759 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be0dc3-b0e1-43e4-ad04-d26395d6937a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:18.786522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be0dc3-b0e1-43e4-ad04-d26395d6937a admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:18.786800 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be0dc3-b0e1-43e4-ad04-d26395d6937a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:18.787263 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be0dc3-b0e1-43e4-ad04-d26395d6937a admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:18.787969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be0dc3-b0e1-43e4-ad04-d26395d6937a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:18.789971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be0dc3-b0e1-43e4-ad04-d26395d6937a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:18.876970 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1108/2237] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:18 2022] POST /identity/v3/projects => generated 375 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:18.880529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22543f80-50ed-42a4-9197-76a1cd3bc21b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:18.885286 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22543f80-50ed-42a4-9197-76a1cd3bc21b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:18.885807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22543f80-50ed-42a4-9197-76a1cd3bc21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:18.922282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-22543f80-50ed-42a4-9197-76a1cd3bc21b None None] MFA Rules not processed for user `217b7f5e31d849b389b1d2fbcda68332`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:18.928991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-22543f80-50ed-42a4-9197-76a1cd3bc21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:19.005121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1130/2238] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:18 2022] POST /identity/v3/users => generated 285 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:19.006125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be0dc3-b0e1-43e4-ad04-d26395d6937a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:19.037667 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be0dc3-b0e1-43e4-ad04-d26395d6937a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:19.210826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1109/2239] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:19.212743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22543f80-50ed-42a4-9197-76a1cd3bc21b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:19.269785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b247b7-8745-4af6-a1e5-0ecd687efb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:19.272733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b247b7-8745-4af6-a1e5-0ecd687efb77 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:19.278201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b247b7-8745-4af6-a1e5-0ecd687efb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:19.278201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b247b7-8745-4af6-a1e5-0ecd687efb77 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:19.278201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b247b7-8745-4af6-a1e5-0ecd687efb77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:19.279891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b247b7-8745-4af6-a1e5-0ecd687efb77 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:19.314389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:19.439665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1131/2240] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:19 2022] POST /identity/v3/users => generated 288 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:19.440784 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b247b7-8745-4af6-a1e5-0ecd687efb77 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:19.453306 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-49b247b7-8745-4af6-a1e5-0ecd687efb77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:19.498598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22543f80-50ed-42a4-9197-76a1cd3bc21b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:19.520072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02aa53-16e9-4ab4-9131-adb3e91b0f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:19.521395 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b247b7-8745-4af6-a1e5-0ecd687efb77 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:19.524027 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02aa53-16e9-4ab4-9131-adb3e91b0f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:19.525921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02aa53-16e9-4ab4-9131-adb3e91b0f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:19.527235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02aa53-16e9-4ab4-9131-adb3e91b0f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:19.532002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02aa53-16e9-4ab4-9131-adb3e91b0f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:19.541987 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02aa53-16e9-4ab4-9131-adb3e91b0f14 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:19.549579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981bca2-f9ae-4207-b2ca-328b384f7883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:19.550246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981bca2-f9ae-4207-b2ca-328b384f7883 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:19.550858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981bca2-f9ae-4207-b2ca-328b384f7883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:19.551366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981bca2-f9ae-4207-b2ca-328b384f7883 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:19.552382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981bca2-f9ae-4207-b2ca-328b384f7883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:19.556380 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981bca2-f9ae-4207-b2ca-328b384f7883 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:19.588510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1110/2241] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:19.591606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02aa53-16e9-4ab4-9131-adb3e91b0f14 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:19.614057 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02aa53-16e9-4ab4-9131-adb3e91b0f14 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:19.633051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30aff5-29d2-455b-8c0f-0f4954f471cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:19.638268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30aff5-29d2-455b-8c0f-0f4954f471cc admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:19.638596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30aff5-29d2-455b-8c0f-0f4954f471cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:19.638886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30aff5-29d2-455b-8c0f-0f4954f471cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:19.648135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30aff5-29d2-455b-8c0f-0f4954f471cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:19.650839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30aff5-29d2-455b-8c0f-0f4954f471cc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:19.680427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1111/2242] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:19.682239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30aff5-29d2-455b-8c0f-0f4954f471cc admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:19.719194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30aff5-29d2-455b-8c0f-0f4954f471cc admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:19.732362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1c86d-5d28-4640-a565-fc540620e5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:19.739259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1c86d-5d28-4640-a565-fc540620e5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:19.739674 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1c86d-5d28-4640-a565-fc540620e5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:19.739961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1c86d-5d28-4640-a565-fc540620e5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:19.740760 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1c86d-5d28-4640-a565-fc540620e5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:19.749810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1c86d-5d28-4640-a565-fc540620e5e3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:19.767234 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1112/2243] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:19.768327 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1c86d-5d28-4640-a565-fc540620e5e3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:19.780637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1c86d-5d28-4640-a565-fc540620e5e3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:19.783808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1132/2244] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:19 2022] POST /identity/v3/projects => generated 371 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:19.792009 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981bca2-f9ae-4207-b2ca-328b384f7883 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:19.964245 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d39153-e574-46d2-b0a5-189113a7c6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:19.966104 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d39153-e574-46d2-b0a5-189113a7c6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:19.968298 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d39153-e574-46d2-b0a5-189113a7c6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:19.970645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d39153-e574-46d2-b0a5-189113a7c6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:19.971743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d39153-e574-46d2-b0a5-189113a7c6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:19.975499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d39153-e574-46d2-b0a5-189113a7c6f0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:19.999350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1113/2245] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:19.999350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d39153-e574-46d2-b0a5-189113a7c6f0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:20.018469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d39153-e574-46d2-b0a5-189113a7c6f0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:20.024494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795ac4b-57e2-49ee-8472-fb5e4ba5d83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:20.025625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795ac4b-57e2-49ee-8472-fb5e4ba5d83c admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:20.025960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795ac4b-57e2-49ee-8472-fb5e4ba5d83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:20.026667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795ac4b-57e2-49ee-8472-fb5e4ba5d83c admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:20.027536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795ac4b-57e2-49ee-8472-fb5e4ba5d83c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:20.029541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981bca2-f9ae-4207-b2ca-328b384f7883 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:20.030691 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795ac4b-57e2-49ee-8472-fb5e4ba5d83c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:20.063502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0504cb9-34dc-4a8f-8a99-775dedae5e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:20.071156 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0504cb9-34dc-4a8f-8a99-775dedae5e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:20.074002 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0504cb9-34dc-4a8f-8a99-775dedae5e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:20.076376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0504cb9-34dc-4a8f-8a99-775dedae5e73 admin admin] PATH_INFO: `/v3/projects/a8a7db5ad0254ea3bd770b654d8482c2/users/02d3cef27f3a4b7d83467fdd9b2aa020/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:20.143708 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0504cb9-34dc-4a8f-8a99-775dedae5e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a7db5ad0254ea3bd770b654d8482c2, user_id=02d3cef27f3a4b7d83467fdd9b2aa020, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:20.162435 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0504cb9-34dc-4a8f-8a99-775dedae5e73 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:20.166063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1114/2246] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:19 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:20.167598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795ac4b-57e2-49ee-8472-fb5e4ba5d83c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:20.191158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795ac4b-57e2-49ee-8472-fb5e4ba5d83c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:20.194188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970843fa-ff61-4239-aff2-e06c31cce6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:20.195409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970843fa-ff61-4239-aff2-e06c31cce6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:20.195713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970843fa-ff61-4239-aff2-e06c31cce6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:20.195996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970843fa-ff61-4239-aff2-e06c31cce6ea admin admin] PATH_INFO: `/v3/projects/0d1f1cc699ee47c8adfaae4671101280/users/f52882dfbe1c41109bd7b9b68f8ecb93/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:20.240556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970843fa-ff61-4239-aff2-e06c31cce6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1f1cc699ee47c8adfaae4671101280, user_id=f52882dfbe1c41109bd7b9b68f8ecb93, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:20.245891 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970843fa-ff61-4239-aff2-e06c31cce6ea admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:20.344421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1133/2247] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:19 2022] PUT /identity/v3/projects/a8a7db5ad0254ea3bd770b654d8482c2/users/02d3cef27f3a4b7d83467fdd9b2aa020/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:20.355277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0504cb9-34dc-4a8f-8a99-775dedae5e73 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:20.460857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1115/2248] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:20 2022] PUT /identity/v3/projects/0d1f1cc699ee47c8adfaae4671101280/users/f52882dfbe1c41109bd7b9b68f8ecb93/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:20.483085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3cfde-a8a1-482b-b33a-41774d10d460 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:20.487064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3cfde-a8a1-482b-b33a-41774d10d460 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:20.489372 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3cfde-a8a1-482b-b33a-41774d10d460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:20.583039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0504cb9-34dc-4a8f-8a99-775dedae5e73 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:20.600751 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1ff3cfde-a8a1-482b-b33a-41774d10d460 None None] MFA Rules not processed for user `02d3cef27f3a4b7d83467fdd9b2aa020`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:20.603018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1ff3cfde-a8a1-482b-b33a-41774d10d460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:20.836133 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5561b-8e76-4411-94ec-0c0d0fd442a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:20.837385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5561b-8e76-4411-94ec-0c0d0fd442a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:20.837867 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5561b-8e76-4411-94ec-0c0d0fd442a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:20.838351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5561b-8e76-4411-94ec-0c0d0fd442a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:20.862905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5561b-8e76-4411-94ec-0c0d0fd442a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:20.876026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:20.877056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5561b-8e76-4411-94ec-0c0d0fd442a3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:20.899431 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:20.930452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1134/2249] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 573 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:20.939787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d2bb5-50a8-49d4-a26d-8957a022bd9a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:20.940077 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d2bb5-50a8-49d4-a26d-8957a022bd9a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:20.940358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d2bb5-50a8-49d4-a26d-8957a022bd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:20.971599 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1116/2250] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:20.973912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6b842-d81f-4518-9436-63eb187e840e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:20.979033 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6b842-d81f-4518-9436-63eb187e840e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:20.982525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6b842-d81f-4518-9436-63eb187e840e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:21.015926 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-041d2bb5-50a8-49d4-a26d-8957a022bd9a None None] MFA Rules not processed for user `f52882dfbe1c41109bd7b9b68f8ecb93`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:21.017513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-041d2bb5-50a8-49d4-a26d-8957a022bd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:21.051563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2ba6b842-d81f-4518-9436-63eb187e840e None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:21.054528 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2ba6b842-d81f-4518-9436-63eb187e840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:21.241196 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1117/2251] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jul 18 10:42:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:21.251313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6b842-d81f-4518-9436-63eb187e840e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:21.256780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1135/2252] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:21.257989 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d2bb5-50a8-49d4-a26d-8957a022bd9a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:21.261484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-041d2bb5-50a8-49d4-a26d-8957a022bd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:21.281508 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6b842-d81f-4518-9436-63eb187e840e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:21.291567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227d4d6-488c-4775-8942-d607de028f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:21.293596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227d4d6-488c-4775-8942-d607de028f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:21.294110 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227d4d6-488c-4775-8942-d607de028f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:21.294655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227d4d6-488c-4775-8942-d607de028f91 admin admin] PATH_INFO: `/v3/projects/282f1948e2ad4e4b84bc80a5006dd3aa/users/50fbf833259c466d8d764fab65af0ac2/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:21.391209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227d4d6-488c-4775-8942-d607de028f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=282f1948e2ad4e4b84bc80a5006dd3aa, user_id=50fbf833259c466d8d764fab65af0ac2, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:21.409181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227d4d6-488c-4775-8942-d607de028f91 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:21.433237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d2bb5-50a8-49d4-a26d-8957a022bd9a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:21.446031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc876b-b3a4-4300-ae5b-87a92812e817 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:21.446743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc876b-b3a4-4300-ae5b-87a92812e817 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:21.447053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc876b-b3a4-4300-ae5b-87a92812e817 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:21.454141 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc876b-b3a4-4300-ae5b-87a92812e817 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:21.479348 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc876b-b3a4-4300-ae5b-87a92812e817 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:21.485457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc876b-b3a4-4300-ae5b-87a92812e817 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:21.512496 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1136/2253] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:21.513622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc876b-b3a4-4300-ae5b-87a92812e817 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:21.609942 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1118/2254] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:21 2022] PUT /identity/v3/projects/282f1948e2ad4e4b84bc80a5006dd3aa/users/50fbf833259c466d8d764fab65af0ac2/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:21.611575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227d4d6-488c-4775-8942-d607de028f91 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:21.649824 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e227d4d6-488c-4775-8942-d607de028f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:21.731168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:21.757138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc876b-b3a4-4300-ae5b-87a92812e817 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:22.052478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891abf4-63db-4fb5-9b35-c701552d9c5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:22.053406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891abf4-63db-4fb5-9b35-c701552d9c5d service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:22.053753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891abf4-63db-4fb5-9b35-c701552d9c5d service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:22.054122 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891abf4-63db-4fb5-9b35-c701552d9c5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:22.098778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227d4d6-488c-4775-8942-d607de028f91 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:22.121577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119a3a6-bc62-419a-ab4e-747e366817dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f93de99555742ca9bd99d707d1cdbee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:22.122695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119a3a6-bc62-419a-ab4e-747e366817dd service glance] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:22.123175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119a3a6-bc62-419a-ab4e-747e366817dd service glance] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:22.124433 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119a3a6-bc62-419a-ab4e-747e366817dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:22.154446 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891abf4-63db-4fb5-9b35-c701552d9c5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:22.157319 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891abf4-63db-4fb5-9b35-c701552d9c5d service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:22.172740 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1137/2255] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:42:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:42:22.177840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891abf4-63db-4fb5-9b35-c701552d9c5d service swift] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:22.290814 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891abf4-63db-4fb5-9b35-c701552d9c5d service swift] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:22.298083 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d2121-4396-438a-a0a1-9b412bbd72d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:22.299845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d2121-4396-438a-a0a1-9b412bbd72d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:22.300807 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d2121-4396-438a-a0a1-9b412bbd72d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:22.301285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d2121-4396-438a-a0a1-9b412bbd72d4 admin admin] PATH_INFO: `/v3/users/02d3cef27f3a4b7d83467fdd9b2aa020` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:22.303495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d2121-4396-438a-a0a1-9b412bbd72d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d3cef27f3a4b7d83467fdd9b2aa020)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:22.305743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d2121-4396-438a-a0a1-9b412bbd72d4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:22.426466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:22.440939 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119a3a6-bc62-419a-ab4e-747e366817dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:22.443893 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119a3a6-bc62-419a-ab4e-747e366817dd service glance] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:22.502758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1119/2256] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 892 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:22.509886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119a3a6-bc62-419a-ab4e-747e366817dd service glance] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:22.546872 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119a3a6-bc62-419a-ab4e-747e366817dd service glance] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:22.571273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7acdc5-ac18-415c-8021-0ca04b9b02bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:22.579046 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7acdc5-ac18-415c-8021-0ca04b9b02bd admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:22.582349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7acdc5-ac18-415c-8021-0ca04b9b02bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:22.583136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7acdc5-ac18-415c-8021-0ca04b9b02bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:22.590859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7acdc5-ac18-415c-8021-0ca04b9b02bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:22.593883 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7acdc5-ac18-415c-8021-0ca04b9b02bd admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:22.627283 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3f2d2121-4396-438a-a0a1-9b412bbd72d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d3cef27f3a4b7d83467fdd9b2aa020'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:22.654644 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1120/2257] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:22.663319 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7acdc5-ac18-415c-8021-0ca04b9b02bd admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:22.703275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7acdc5-ac18-415c-8021-0ca04b9b02bd admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:22.714202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3f2d2121-4396-438a-a0a1-9b412bbd72d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d3cef27f3a4b7d83467fdd9b2aa020'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:22.736962 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1a637-b5ec-4cb5-9bb6-28c1b812546c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:22.740635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1a637-b5ec-4cb5-9bb6-28c1b812546c admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:22.741160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1a637-b5ec-4cb5-9bb6-28c1b812546c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:22.741634 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1a637-b5ec-4cb5-9bb6-28c1b812546c admin admin] PATH_INFO: `/v3/projects/282f1948e2ad4e4b84bc80a5006dd3aa/users/50fbf833259c466d8d764fab65af0ac2/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:22.757019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3f2d2121-4396-438a-a0a1-9b412bbd72d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d3cef27f3a4b7d83467fdd9b2aa020'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:22.758107 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3f2d2121-4396-438a-a0a1-9b412bbd72d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d3cef27f3a4b7d83467fdd9b2aa020'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:22.772467 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1a637-b5ec-4cb5-9bb6-28c1b812546c admin admin] RBAC: Authorizing `identity:create_grant(project_id=282f1948e2ad4e4b84bc80a5006dd3aa, user_id=50fbf833259c466d8d764fab65af0ac2, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:22.779417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1a637-b5ec-4cb5-9bb6-28c1b812546c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:22.816526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3f2d2121-4396-438a-a0a1-9b412bbd72d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d3cef27f3a4b7d83467fdd9b2aa020'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:22.839023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1138/2258] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:22 2022] DELETE /identity/v3/users/02d3cef27f3a4b7d83467fdd9b2aa020 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:22.852138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca53ef-303a-477f-bbdb-7890b88c925e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:22.852641 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca53ef-303a-477f-bbdb-7890b88c925e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:22.853139 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca53ef-303a-477f-bbdb-7890b88c925e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:22.870617 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1121/2259] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:22 2022] PUT /identity/v3/projects/282f1948e2ad4e4b84bc80a5006dd3aa/users/50fbf833259c466d8d764fab65af0ac2/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:22.964201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8cca53ef-303a-477f-bbdb-7890b88c925e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:22.967038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8cca53ef-303a-477f-bbdb-7890b88c925e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:23.048515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:23.116929 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6d09-c313-4311-9d36-9ba6eb812114 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:23.117554 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6d09-c313-4311-9d36-9ba6eb812114 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:23.118420 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6d09-c313-4311-9d36-9ba6eb812114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:23.201088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1139/2260] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:23.212248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca53ef-303a-477f-bbdb-7890b88c925e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:23.215668 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8cca53ef-303a-477f-bbdb-7890b88c925e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:23.322288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d37e6d09-c313-4311-9d36-9ba6eb812114 None None] MFA Rules not processed for user `d4be9b38bc54460c8e8a0c08f8c6efed`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:23.324511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d37e6d09-c313-4311-9d36-9ba6eb812114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:23.587681 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1122/2261] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:23.595726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca53ef-303a-477f-bbdb-7890b88c925e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:23.596463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437ac3a-fe60-4f81-8ed9-6661925e56c9 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:23.596623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437ac3a-fe60-4f81-8ed9-6661925e56c9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:23.596871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437ac3a-fe60-4f81-8ed9-6661925e56c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:23.621468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eb0ff-7f30-46ff-a1b0-c8312e6bbc5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:23.622721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eb0ff-7f30-46ff-a1b0-c8312e6bbc5c service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:23.625195 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eb0ff-7f30-46ff-a1b0-c8312e6bbc5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:23.630866 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eb0ff-7f30-46ff-a1b0-c8312e6bbc5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:23.633712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:23.649059 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-7437ac3a-fe60-4f81-8ed9-6661925e56c9 None None] MFA Rules not processed for user `d4be9b38bc54460c8e8a0c08f8c6efed`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:23.651409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7437ac3a-fe60-4f81-8ed9-6661925e56c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:23.656425 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2eb0ff-7f30-46ff-a1b0-c8312e6bbc5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:23.672051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2eb0ff-7f30-46ff-a1b0-c8312e6bbc5c service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:23.678314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1123/2262] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:23.682153 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58381bd2-92b1-4462-9871-0b0941a85b98 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:23.683230 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58381bd2-92b1-4462-9871-0b0941a85b98 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:23.683230 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58381bd2-92b1-4462-9871-0b0941a85b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:23.725067 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1140/2263] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:23.737767 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-58381bd2-92b1-4462-9871-0b0941a85b98 None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:23.741369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-58381bd2-92b1-4462-9871-0b0941a85b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:23.948573 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1124/2264] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 18 10:42:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:23.983164 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eb0ff-7f30-46ff-a1b0-c8312e6bbc5c service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:23.987550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dc2eb0ff-7f30-46ff-a1b0-c8312e6bbc5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:24.023546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58381bd2-92b1-4462-9871-0b0941a85b98 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:24.025177 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-58381bd2-92b1-4462-9871-0b0941a85b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:24.208084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58381bd2-92b1-4462-9871-0b0941a85b98 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:24.227613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ea5bb-2459-4b35-89d3-9f596c074d7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:24.227613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ea5bb-2459-4b35-89d3-9f596c074d7d service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:24.227613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ea5bb-2459-4b35-89d3-9f596c074d7d service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:24.227613 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ea5bb-2459-4b35-89d3-9f596c074d7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:24.251927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ea5bb-2459-4b35-89d3-9f596c074d7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:24.256131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ea5bb-2459-4b35-89d3-9f596c074d7d service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:24.263782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eb0ff-7f30-46ff-a1b0-c8312e6bbc5c service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:24.278793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bccefa-a197-493a-bec4-ab11c54a9a88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:24.279514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bccefa-a197-493a-bec4-ab11c54a9a88 service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:24.279798 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bccefa-a197-493a-bec4-ab11c54a9a88 service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:24.280939 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bccefa-a197-493a-bec4-ab11c54a9a88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:24.282619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1125/2265] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:24.317242 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bccefa-a197-493a-bec4-ab11c54a9a88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:24.319625 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bccefa-a197-493a-bec4-ab11c54a9a88 service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:24.331030 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ea5bb-2459-4b35-89d3-9f596c074d7d service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:24.334125 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-919ea5bb-2459-4b35-89d3-9f596c074d7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:24.336104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1141/2266] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:42:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:42:24.360406 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ea5bb-2459-4b35-89d3-9f596c074d7d service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:24.365948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36375129-4989-4fca-9615-46510a408d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:24.367476 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36375129-4989-4fca-9615-46510a408d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:24.367908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36375129-4989-4fca-9615-46510a408d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:24.368347 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36375129-4989-4fca-9615-46510a408d0b admin admin] PATH_INFO: `/v3/users/f9ad882f6bbd4c388a63a0fe23873d11` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:24.371135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36375129-4989-4fca-9615-46510a408d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ad882f6bbd4c388a63a0fe23873d11)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:24.375454 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36375129-4989-4fca-9615-46510a408d0b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:24.661426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36375129-4989-4fca-9615-46510a408d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ad882f6bbd4c388a63a0fe23873d11'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:24.769194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36375129-4989-4fca-9615-46510a408d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ad882f6bbd4c388a63a0fe23873d11'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:24.781887 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36375129-4989-4fca-9615-46510a408d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ad882f6bbd4c388a63a0fe23873d11'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:24.784423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36375129-4989-4fca-9615-46510a408d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ad882f6bbd4c388a63a0fe23873d11'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:24.803955 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:24.822631 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36375129-4989-4fca-9615-46510a408d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ad882f6bbd4c388a63a0fe23873d11'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:24.845588 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1126/2267] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:24 2022] DELETE /identity/v3/users/f9ad882f6bbd4c388a63a0fe23873d11 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:24.848578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60c438-6ded-4759-943c-946a4bb0a271 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:24.850027 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60c438-6ded-4759-943c-946a4bb0a271 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:24.850312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60c438-6ded-4759-943c-946a4bb0a271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:24.910252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-9b60c438-6ded-4759-943c-946a4bb0a271 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:24.914194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36375129-4989-4fca-9615-46510a408d0b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:24.920030 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-36375129-4989-4fca-9615-46510a408d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:24.940139 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9b60c438-6ded-4759-943c-946a4bb0a271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:25.054849 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:25.214886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1142/2268] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:25.273920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36375129-4989-4fca-9615-46510a408d0b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:25.296232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac8d99-0d4a-415e-bc58-57bdb2491074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:25.302925 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac8d99-0d4a-415e-bc58-57bdb2491074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:25.304261 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac8d99-0d4a-415e-bc58-57bdb2491074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:25.306834 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac8d99-0d4a-415e-bc58-57bdb2491074 admin admin] PATH_INFO: `/v3/projects/a8a7db5ad0254ea3bd770b654d8482c2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:25.313598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac8d99-0d4a-415e-bc58-57bdb2491074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a7db5ad0254ea3bd770b654d8482c2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:25.327880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60c438-6ded-4759-943c-946a4bb0a271 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:25.328765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac8d99-0d4a-415e-bc58-57bdb2491074 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:25.339306 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9b60c438-6ded-4759-943c-946a4bb0a271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:25.677914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c1ac8d99-0d4a-415e-bc58-57bdb2491074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a7db5ad0254ea3bd770b654d8482c2', 'request_id': 'req-c1ac8d99-0d4a-415e-bc58-57bdb2491074'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:25.694749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c1ac8d99-0d4a-415e-bc58-57bdb2491074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a7db5ad0254ea3bd770b654d8482c2', 'request_id': 'req-c1ac8d99-0d4a-415e-bc58-57bdb2491074'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:25.696778 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60c438-6ded-4759-943c-946a4bb0a271 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:25.710963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c1ac8d99-0d4a-415e-bc58-57bdb2491074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a7db5ad0254ea3bd770b654d8482c2', 'request_id': 'req-c1ac8d99-0d4a-415e-bc58-57bdb2491074'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:25.879075 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c1ac8d99-0d4a-415e-bc58-57bdb2491074 admin admin] The token cache is being invalidate because project a8a7db5ad0254ea3bd770b654d8482c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:25.881520 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c1ac8d99-0d4a-415e-bc58-57bdb2491074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:25.888096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c1ac8d99-0d4a-415e-bc58-57bdb2491074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:25.903983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1127/2269] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:24 2022] DELETE /identity/v3/projects/a8a7db5ad0254ea3bd770b654d8482c2 => generated 0 bytes in 991 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:25.923132 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63eaf8-9b07-4ca2-9e67-4e977ac2aa5a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:25.925802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63eaf8-9b07-4ca2-9e67-4e977ac2aa5a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:25.928299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63eaf8-9b07-4ca2-9e67-4e977ac2aa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:26.036689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ed63eaf8-9b07-4ca2-9e67-4e977ac2aa5a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:26.039793 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ed63eaf8-9b07-4ca2-9e67-4e977ac2aa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:26.041760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e682b0a-427b-4776-a7fa-255201602d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:26.042600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e682b0a-427b-4776-a7fa-255201602d10 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:26.042818 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e682b0a-427b-4776-a7fa-255201602d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:26.043125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e682b0a-427b-4776-a7fa-255201602d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:26.048248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4e682b0a-427b-4776-a7fa-255201602d10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:26.274552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1128/2270] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:26.449374 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba38af-e0aa-4dbe-8f9a-5ff5719ee7b1 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:26.449374 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba38af-e0aa-4dbe-8f9a-5ff5719ee7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:26.449374 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba38af-e0aa-4dbe-8f9a-5ff5719ee7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:26.452444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e682b0a-427b-4776-a7fa-255201602d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:26.452444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e682b0a-427b-4776-a7fa-255201602d10 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:26.453174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d5ba38af-e0aa-4dbe-8f9a-5ff5719ee7b1 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:26.453174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d5ba38af-e0aa-4dbe-8f9a-5ff5719ee7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:26.453174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1129/2271] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:26.453174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea126217-7021-49ca-ae78-f421d973c988 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:26.453174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea126217-7021-49ca-ae78-f421d973c988 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:26.453174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea126217-7021-49ca-ae78-f421d973c988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:26.455100 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1143/2272] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 1091 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:26.458247 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e682b0a-427b-4776-a7fa-255201602d10 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:26.465026 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ea126217-7021-49ca-ae78-f421d973c988 None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:26.466528 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ea126217-7021-49ca-ae78-f421d973c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:26.498544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e682b0a-427b-4776-a7fa-255201602d10 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:26.556960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2f0e8-7474-41bb-9f08-9e7a4b045343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:26.566446 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2f0e8-7474-41bb-9f08-9e7a4b045343 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:26.567674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2f0e8-7474-41bb-9f08-9e7a4b045343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:26.568484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2f0e8-7474-41bb-9f08-9e7a4b045343 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:26.571118 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2f0e8-7474-41bb-9f08-9e7a4b045343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:26.573136 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2f0e8-7474-41bb-9f08-9e7a4b045343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:26.583813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2f0e8-7474-41bb-9f08-9e7a4b045343 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:26.618883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1144/2273] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:42:26.656984 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2f0e8-7474-41bb-9f08-9e7a4b045343 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:26.701403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2f0e8-7474-41bb-9f08-9e7a4b045343 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:26.714013 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b305b49-0b53-413c-8d4f-1c2ed31974b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:26.716187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b305b49-0b53-413c-8d4f-1c2ed31974b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:26.718231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b305b49-0b53-413c-8d4f-1c2ed31974b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:26.718943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b305b49-0b53-413c-8d4f-1c2ed31974b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:26.724557 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b305b49-0b53-413c-8d4f-1c2ed31974b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:26.729207 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b305b49-0b53-413c-8d4f-1c2ed31974b0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:26.760763 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:26.765840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1130/2274] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jul 18 10:42:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:26.817482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea126217-7021-49ca-ae78-f421d973c988 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:26.820903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ea126217-7021-49ca-ae78-f421d973c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:27.163490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea126217-7021-49ca-ae78-f421d973c988 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:27.216117 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9cc17-7222-4278-883f-b0e568417816 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:27.217779 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9cc17-7222-4278-883f-b0e568417816 service swift] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:27.217779 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9cc17-7222-4278-883f-b0e568417816 service swift] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:27.218145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9cc17-7222-4278-883f-b0e568417816 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:27.284499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9cc17-7222-4278-883f-b0e568417816 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:27.287573 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9cc17-7222-4278-883f-b0e568417816 service swift] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:27.380734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1131/2275] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:42:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 10:42:27.420704 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:27.641759 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bf17a-b2b5-4ab5-b1a2-18b59155c211 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:27.642261 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bf17a-b2b5-4ab5-b1a2-18b59155c211 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:27.645658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bf17a-b2b5-4ab5-b1a2-18b59155c211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:27.651005 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1145/2276] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:26 2022] POST /identity/v3/projects => generated 399 bytes in 997 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:27.661639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b305b49-0b53-413c-8d4f-1c2ed31974b0 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:27.698645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4c9bf17a-b2b5-4ab5-b1a2-18b59155c211 None None] MFA Rules not processed for user `d4be9b38bc54460c8e8a0c08f8c6efed`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:27.708472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4c9bf17a-b2b5-4ab5-b1a2-18b59155c211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:27.887498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1132/2277] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:27.934424 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b305b49-0b53-413c-8d4f-1c2ed31974b0 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:27.950571 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3c91a-4e69-4ec0-ac7b-5b23ceee95c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:27.951866 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3c91a-4e69-4ec0-ac7b-5b23ceee95c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:27.952927 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3c91a-4e69-4ec0-ac7b-5b23ceee95c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:27.953403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3c91a-4e69-4ec0-ac7b-5b23ceee95c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:27.954304 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3c91a-4e69-4ec0-ac7b-5b23ceee95c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:27.956564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3c91a-4e69-4ec0-ac7b-5b23ceee95c7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:28.133986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1146/2278] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:27 2022] POST /identity/v3/users => generated 300 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:28.143452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bf17a-b2b5-4ab5-b1a2-18b59155c211 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:28.221244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bf17a-b2b5-4ab5-b1a2-18b59155c211 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:28.285738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3620a6d-198d-47d8-9e22-b5654ea10242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:28.296195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3620a6d-198d-47d8-9e22-b5654ea10242 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:28.298870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3620a6d-198d-47d8-9e22-b5654ea10242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:28.304954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3620a6d-198d-47d8-9e22-b5654ea10242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:28.307648 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3620a6d-198d-47d8-9e22-b5654ea10242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:28.319665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3620a6d-198d-47d8-9e22-b5654ea10242 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:28.368148 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:28.392632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1133/2279] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:28.395344 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3c91a-4e69-4ec0-ac7b-5b23ceee95c7 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:28.414064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:28.429939 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3c91a-4e69-4ec0-ac7b-5b23ceee95c7 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:28.453606 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95f86f-3fda-4d08-8033-08cbf135b2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:28.459278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95f86f-3fda-4d08-8033-08cbf135b2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:28.459278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95f86f-3fda-4d08-8033-08cbf135b2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:28.459278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95f86f-3fda-4d08-8033-08cbf135b2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:28.459278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95f86f-3fda-4d08-8033-08cbf135b2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:28.467068 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95f86f-3fda-4d08-8033-08cbf135b2bc admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:28.545655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1147/2280] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:28.557432 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3620a6d-198d-47d8-9e22-b5654ea10242 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:28.605905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3620a6d-198d-47d8-9e22-b5654ea10242 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:28.629752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6f956-a6f6-4271-a659-c92fad90713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:28.640817 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6f956-a6f6-4271-a659-c92fad90713a admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:28.640817 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6f956-a6f6-4271-a659-c92fad90713a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:28.640817 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6f956-a6f6-4271-a659-c92fad90713a admin admin] PATH_INFO: `/v3/projects/aca947c2fc96479499531e243c701ff7/users/35f4defedd754e139ce4dd3f6a180110/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:28.723970 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6f956-a6f6-4271-a659-c92fad90713a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca947c2fc96479499531e243c701ff7, user_id=35f4defedd754e139ce4dd3f6a180110, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:28.736898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6f956-a6f6-4271-a659-c92fad90713a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:28.892547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86674a14-96c4-4cbe-b33a-82ced2996654 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:28.893359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86674a14-96c4-4cbe-b33a-82ced2996654 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:28.896078 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86674a14-96c4-4cbe-b33a-82ced2996654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:28.896341 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1134/2281] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:28 2022] PUT /identity/v3/projects/aca947c2fc96479499531e243c701ff7/users/35f4defedd754e139ce4dd3f6a180110/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:29.042176 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-86674a14-96c4-4cbe-b33a-82ced2996654 None None] MFA Rules not processed for user `35f4defedd754e139ce4dd3f6a180110`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:29.044551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-86674a14-96c4-4cbe-b33a-82ced2996654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:29.085626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:29.412138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1148/2282] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 523 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:29.479417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6f956-a6f6-4271-a659-c92fad90713a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:29.481212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-bae6f956-a6f6-4271-a659-c92fad90713a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:29.615547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86674a14-96c4-4cbe-b33a-82ced2996654 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:29.618181 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-86674a14-96c4-4cbe-b33a-82ced2996654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:29.697487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:29.788185 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:29.884879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6f956-a6f6-4271-a659-c92fad90713a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:29.919420 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898caea7-464e-4316-9d75-caef2752b608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:29.926580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898caea7-464e-4316-9d75-caef2752b608 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:29.928147 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898caea7-464e-4316-9d75-caef2752b608 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:29.928788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898caea7-464e-4316-9d75-caef2752b608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:30.015561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898caea7-464e-4316-9d75-caef2752b608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:30.076946 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898caea7-464e-4316-9d75-caef2752b608 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:30.119372 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86674a14-96c4-4cbe-b33a-82ced2996654 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:30.181286 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f89f5b-f37d-4353-8518-a9df545f05a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:30.184748 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f89f5b-f37d-4353-8518-a9df545f05a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:30.186643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1135/2283] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:30.187576 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f89f5b-f37d-4353-8518-a9df545f05a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:30.191674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f89f5b-f37d-4353-8518-a9df545f05a1 admin admin] PATH_INFO: `/v3/projects/bc89152384de437899d1e32d217e516a` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:30.197410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f89f5b-f37d-4353-8518-a9df545f05a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc89152384de437899d1e32d217e516a)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:30.216465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:30.222313 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f89f5b-f37d-4353-8518-a9df545f05a1 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:30.587282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-75f89f5b-f37d-4353-8518-a9df545f05a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc89152384de437899d1e32d217e516a', 'request_id': 'req-75f89f5b-f37d-4353-8518-a9df545f05a1'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:30.611954 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-75f89f5b-f37d-4353-8518-a9df545f05a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc89152384de437899d1e32d217e516a', 'request_id': 'req-75f89f5b-f37d-4353-8518-a9df545f05a1'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:30.621677 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-75f89f5b-f37d-4353-8518-a9df545f05a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc89152384de437899d1e32d217e516a', 'request_id': 'req-75f89f5b-f37d-4353-8518-a9df545f05a1'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:30.773937 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:30.807333 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-75f89f5b-f37d-4353-8518-a9df545f05a1 admin admin] The token cache is being invalidate because project bc89152384de437899d1e32d217e516a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:30.807797 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-75f89f5b-f37d-4353-8518-a9df545f05a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:30.830713 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-75f89f5b-f37d-4353-8518-a9df545f05a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:30.843656 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1149/2284] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:29 2022] DELETE /identity/v3/projects/bc89152384de437899d1e32d217e516a => generated 0 bytes in 1230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:30.851594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5e5ae-145f-4a11-b511-0d0228b0da56 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:30.852562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5e5ae-145f-4a11-b511-0d0228b0da56 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:30.853291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5e5ae-145f-4a11-b511-0d0228b0da56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:30.959195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-51d5e5ae-145f-4a11-b511-0d0228b0da56 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:30.962533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-51d5e5ae-145f-4a11-b511-0d0228b0da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:31.135561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:31.176023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1136/2285] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:31.178232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a5446-b9d0-4793-9a8e-d1c2baf07c69 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:31.178997 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a5446-b9d0-4793-9a8e-d1c2baf07c69 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:31.179753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a5446-b9d0-4793-9a8e-d1c2baf07c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:31.322583 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-844a5446-b9d0-4793-9a8e-d1c2baf07c69 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:31.333020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-844a5446-b9d0-4793-9a8e-d1c2baf07c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:31.392012 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1150/2286] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:31.396284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5e5ae-145f-4a11-b511-0d0228b0da56 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:31.453296 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5e5ae-145f-4a11-b511-0d0228b0da56 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:31.480507 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b40ef-59f5-41e5-8af2-d96399e8b644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:31.490102 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b40ef-59f5-41e5-8af2-d96399e8b644 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:31.491454 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b40ef-59f5-41e5-8af2-d96399e8b644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:31.492115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b40ef-59f5-41e5-8af2-d96399e8b644 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:31.494146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b40ef-59f5-41e5-8af2-d96399e8b644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:31.502366 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b40ef-59f5-41e5-8af2-d96399e8b644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:31.515815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b40ef-59f5-41e5-8af2-d96399e8b644 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:31.595313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1137/2287] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:31.595964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a5446-b9d0-4793-9a8e-d1c2baf07c69 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:31.635899 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a5446-b9d0-4793-9a8e-d1c2baf07c69 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:31.670452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:31.693735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18244de2-5ced-4801-b830-6108316094a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:31.694774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18244de2-5ced-4801-b830-6108316094a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:31.699133 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18244de2-5ced-4801-b830-6108316094a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:31.699133 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18244de2-5ced-4801-b830-6108316094a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:31.699133 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18244de2-5ced-4801-b830-6108316094a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:31.726595 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18244de2-5ced-4801-b830-6108316094a9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:31.759556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:32.051342 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:32.078560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b40ef-59f5-41e5-8af2-d96399e8b644 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:32.078800 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1151/2288] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:31 2022] POST /identity/v3/projects => generated 373 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:42:32.148860 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b40ef-59f5-41e5-8af2-d96399e8b644 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:32.263381 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f19ff-1d08-488e-a252-ea1bd0185aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:32.272701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f19ff-1d08-488e-a252-ea1bd0185aab admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:32.278002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f19ff-1d08-488e-a252-ea1bd0185aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:32.281705 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f19ff-1d08-488e-a252-ea1bd0185aab admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:32.282914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f19ff-1d08-488e-a252-ea1bd0185aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:32.286555 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f19ff-1d08-488e-a252-ea1bd0185aab admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:32.442295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1138/2289] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:32 2022] POST /identity/v3/users => generated 287 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:32.448632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18244de2-5ced-4801-b830-6108316094a9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:32.497322 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18244de2-5ced-4801-b830-6108316094a9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:32.525772 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d461a6a-affd-4735-9495-a02491b1fc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:32.527108 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d461a6a-affd-4735-9495-a02491b1fc16 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:32.527622 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d461a6a-affd-4735-9495-a02491b1fc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:32.530532 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d461a6a-affd-4735-9495-a02491b1fc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:32.533555 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d461a6a-affd-4735-9495-a02491b1fc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:32.545408 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d461a6a-affd-4735-9495-a02491b1fc16 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:32.606313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f19ff-1d08-488e-a252-ea1bd0185aab admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:32.606874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1152/2290] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:32.622005 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f19ff-1d08-488e-a252-ea1bd0185aab admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:32.642503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e45478-3a8a-481c-ba68-a32e3e7c4c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:32.647453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e45478-3a8a-481c-ba68-a32e3e7c4c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:32.648111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e45478-3a8a-481c-ba68-a32e3e7c4c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:32.648699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e45478-3a8a-481c-ba68-a32e3e7c4c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:32.649861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e45478-3a8a-481c-ba68-a32e3e7c4c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:32.663842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e45478-3a8a-481c-ba68-a32e3e7c4c7c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:32.695124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1139/2291] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:32.703874 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d461a6a-affd-4735-9495-a02491b1fc16 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:32.758218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d461a6a-affd-4735-9495-a02491b1fc16 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:32.779477 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e854ba-13ec-477c-9124-d0c789193c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:32.786200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e854ba-13ec-477c-9124-d0c789193c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:32.790694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e854ba-13ec-477c-9124-d0c789193c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:32.790694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e854ba-13ec-477c-9124-d0c789193c43 admin admin] PATH_INFO: `/v3/projects/03c2687260bf48f2a860854b45c7202f/users/b769fe84d79c4dda86000ddede4574e8/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:32.818139 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e854ba-13ec-477c-9124-d0c789193c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c2687260bf48f2a860854b45c7202f, user_id=b769fe84d79c4dda86000ddede4574e8, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:32.824059 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e854ba-13ec-477c-9124-d0c789193c43 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:32.940998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1153/2292] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:32 2022] PUT /identity/v3/projects/03c2687260bf48f2a860854b45c7202f/users/b769fe84d79c4dda86000ddede4574e8/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:32.952008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479a154-5f8e-4db8-86b1-0a0ed96a86dd None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:32.952008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479a154-5f8e-4db8-86b1-0a0ed96a86dd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:32.952362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479a154-5f8e-4db8-86b1-0a0ed96a86dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:32.992574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c479a154-5f8e-4db8-86b1-0a0ed96a86dd None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:33.016124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c479a154-5f8e-4db8-86b1-0a0ed96a86dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:33.097883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:33.211440 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1140/2293] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:33.278267 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e854ba-13ec-477c-9124-d0c789193c43 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:33.284078 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-00e854ba-13ec-477c-9124-d0c789193c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:33.289728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:33.559938 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e854ba-13ec-477c-9124-d0c789193c43 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:33.582058 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e9d06-f581-46dd-8e7a-926303222ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:33.587214 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e9d06-f581-46dd-8e7a-926303222ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:33.589021 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e9d06-f581-46dd-8e7a-926303222ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:33.589846 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e9d06-f581-46dd-8e7a-926303222ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:33.618696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e9d06-f581-46dd-8e7a-926303222ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:33.620789 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e9d06-f581-46dd-8e7a-926303222ec8 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:33.655375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1154/2294] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:33.899061 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:34.040410 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479a154-5f8e-4db8-86b1-0a0ed96a86dd None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:34.048461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c479a154-5f8e-4db8-86b1-0a0ed96a86dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:34.128477 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479a154-5f8e-4db8-86b1-0a0ed96a86dd None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:34.157270 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f92259-ace5-4aa4-b07d-ccc41229681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:34.158745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f92259-ace5-4aa4-b07d-ccc41229681a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:34.159509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f92259-ace5-4aa4-b07d-ccc41229681a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:34.160197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f92259-ace5-4aa4-b07d-ccc41229681a admin admin] PATH_INFO: `/v3/users/54db213074d342cd9954ba5acc3f22f5` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:34.163553 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f92259-ace5-4aa4-b07d-ccc41229681a admin admin] RBAC: Authorizing `identity:delete_user(user_id=54db213074d342cd9954ba5acc3f22f5)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:34.171282 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f92259-ace5-4aa4-b07d-ccc41229681a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:34.536268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:34.551348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-85f92259-ace5-4aa4-b07d-ccc41229681a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54db213074d342cd9954ba5acc3f22f5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.668541 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-85f92259-ace5-4aa4-b07d-ccc41229681a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54db213074d342cd9954ba5acc3f22f5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.692899 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-85f92259-ace5-4aa4-b07d-ccc41229681a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54db213074d342cd9954ba5acc3f22f5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.703311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-85f92259-ace5-4aa4-b07d-ccc41229681a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54db213074d342cd9954ba5acc3f22f5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.792014 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-85f92259-ace5-4aa4-b07d-ccc41229681a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54db213074d342cd9954ba5acc3f22f5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.831302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1141/2295] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:34 2022] DELETE /identity/v3/users/54db213074d342cd9954ba5acc3f22f5 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:34.839568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5542a6c-ae83-467a-bcc5-1d8b02739014 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:34.840639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5542a6c-ae83-467a-bcc5-1d8b02739014 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:34.841774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5542a6c-ae83-467a-bcc5-1d8b02739014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:34.914462 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a5542a6c-ae83-467a-bcc5-1d8b02739014 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:34.917997 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a5542a6c-ae83-467a-bcc5-1d8b02739014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:35.174518 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1155/2296] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:35.310175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f92259-ace5-4aa4-b07d-ccc41229681a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:35.313948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-85f92259-ace5-4aa4-b07d-ccc41229681a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:35.677628 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f92259-ace5-4aa4-b07d-ccc41229681a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:35.710219 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389596d-efa1-4a8b-a500-56bd85968485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:35.714289 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389596d-efa1-4a8b-a500-56bd85968485 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.715329 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389596d-efa1-4a8b-a500-56bd85968485 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.716090 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389596d-efa1-4a8b-a500-56bd85968485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.772194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389596d-efa1-4a8b-a500-56bd85968485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:35.777274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389596d-efa1-4a8b-a500-56bd85968485 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:35.833072 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1142/2297] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:35.881418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:35.965107 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:36.963947 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:37.334538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:37.756190 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:38.025106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5542a6c-ae83-467a-bcc5-1d8b02739014 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:38.026465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a5542a6c-ae83-467a-bcc5-1d8b02739014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:38.058375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5542a6c-ae83-467a-bcc5-1d8b02739014 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:38.069853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a258dc-ed56-4050-8e68-a61f8db7d93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:38.073467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a258dc-ed56-4050-8e68-a61f8db7d93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:38.073467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a258dc-ed56-4050-8e68-a61f8db7d93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:38.073467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a258dc-ed56-4050-8e68-a61f8db7d93e admin admin] PATH_INFO: `/v3/projects/5826d76956d74176b9e3407562a84462` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:38.074969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a258dc-ed56-4050-8e68-a61f8db7d93e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5826d76956d74176b9e3407562a84462)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:38.077967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a258dc-ed56-4050-8e68-a61f8db7d93e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:38.419600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-70a258dc-ed56-4050-8e68-a61f8db7d93e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5826d76956d74176b9e3407562a84462', 'request_id': 'req-70a258dc-ed56-4050-8e68-a61f8db7d93e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:38.432866 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-70a258dc-ed56-4050-8e68-a61f8db7d93e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5826d76956d74176b9e3407562a84462', 'request_id': 'req-70a258dc-ed56-4050-8e68-a61f8db7d93e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:38.458276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-70a258dc-ed56-4050-8e68-a61f8db7d93e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5826d76956d74176b9e3407562a84462', 'request_id': 'req-70a258dc-ed56-4050-8e68-a61f8db7d93e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:38.582624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389189b-fe5d-4426-ad8d-5931b1496cf6 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:38.583178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389189b-fe5d-4426-ad8d-5931b1496cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:38.584963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389189b-fe5d-4426-ad8d-5931b1496cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:38.597471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-70a258dc-ed56-4050-8e68-a61f8db7d93e admin admin] The token cache is being invalidate because project 5826d76956d74176b9e3407562a84462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:38.601620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-70a258dc-ed56-4050-8e68-a61f8db7d93e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:38.607288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-70a258dc-ed56-4050-8e68-a61f8db7d93e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:38.615384 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1156/2298] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:38 2022] DELETE /identity/v3/projects/5826d76956d74176b9e3407562a84462 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:38.627020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797e01e-a4a6-4c28-ba1d-615c85914696 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:38.627514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797e01e-a4a6-4c28-ba1d-615c85914696 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:38.640756 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797e01e-a4a6-4c28-ba1d-615c85914696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:38.676618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b797e01e-a4a6-4c28-ba1d-615c85914696 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:38.676618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b797e01e-a4a6-4c28-ba1d-615c85914696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:38.729953 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9389189b-fe5d-4426-ad8d-5931b1496cf6 None None] MFA Rules not processed for user `b769fe84d79c4dda86000ddede4574e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:38.742197 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9389189b-fe5d-4426-ad8d-5931b1496cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:38.817649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:39.132510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1157/2299] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:39.149435 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e1274-952e-4aa4-9396-3dd5d73f553a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:39.151242 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e1274-952e-4aa4-9396-3dd5d73f553a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:39.155121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e1274-952e-4aa4-9396-3dd5d73f553a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:39.188530 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1143/2300] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 609 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:39.215797 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389189b-fe5d-4426-ad8d-5931b1496cf6 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:39.220991 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9389189b-fe5d-4426-ad8d-5931b1496cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:39.255923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6c3e1274-952e-4aa4-9396-3dd5d73f553a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:39.258032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6c3e1274-952e-4aa4-9396-3dd5d73f553a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:39.290726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1158/2301] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:39.298084 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e1274-952e-4aa4-9396-3dd5d73f553a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:39.331727 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e1274-952e-4aa4-9396-3dd5d73f553a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:39.352132 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311278e-566e-42a0-8b5c-b027839ecff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:39.353512 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311278e-566e-42a0-8b5c-b027839ecff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:39.354242 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311278e-566e-42a0-8b5c-b027839ecff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:39.355013 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311278e-566e-42a0-8b5c-b027839ecff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:39.356888 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311278e-566e-42a0-8b5c-b027839ecff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:39.358379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311278e-566e-42a0-8b5c-b027839ecff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:39.361870 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311278e-566e-42a0-8b5c-b027839ecff1 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:39.414719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1159/2302] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:39.423458 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311278e-566e-42a0-8b5c-b027839ecff1 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:39.477508 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311278e-566e-42a0-8b5c-b027839ecff1 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:39.497104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ab7dd-983e-488b-8c2c-d765776a876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:39.498440 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ab7dd-983e-488b-8c2c-d765776a876c admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:39.499529 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ab7dd-983e-488b-8c2c-d765776a876c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:39.500375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ab7dd-983e-488b-8c2c-d765776a876c admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:39.502063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ab7dd-983e-488b-8c2c-d765776a876c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:39.507965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ab7dd-983e-488b-8c2c-d765776a876c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:39.516760 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389189b-fe5d-4426-ad8d-5931b1496cf6 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:39.536241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1918e-b43f-4dec-b5e3-ec7adacfa4eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:39.537384 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1918e-b43f-4dec-b5e3-ec7adacfa4eb service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:39.537884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1918e-b43f-4dec-b5e3-ec7adacfa4eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:39.538411 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1918e-b43f-4dec-b5e3-ec7adacfa4eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:39.582960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1918e-b43f-4dec-b5e3-ec7adacfa4eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:39.591006 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1918e-b43f-4dec-b5e3-ec7adacfa4eb service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:39.661339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1144/2303] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:39.667335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1160/2304] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:39 2022] POST /identity/v3/projects => generated 381 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:39.672761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1918e-b43f-4dec-b5e3-ec7adacfa4eb service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:39.676375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:39.712781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1918e-b43f-4dec-b5e3-ec7adacfa4eb service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:39.944490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96691b1e-d129-49a5-88f1-fa72010061e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:39.945741 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96691b1e-d129-49a5-88f1-fa72010061e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:39.950301 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96691b1e-d129-49a5-88f1-fa72010061e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:39.950829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96691b1e-d129-49a5-88f1-fa72010061e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:39.954443 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96691b1e-d129-49a5-88f1-fa72010061e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:39.966383 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96691b1e-d129-49a5-88f1-fa72010061e0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:40.011054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ab7dd-983e-488b-8c2c-d765776a876c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:40.014398 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-326ab7dd-983e-488b-8c2c-d765776a876c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:40.070967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ab7dd-983e-488b-8c2c-d765776a876c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:40.096029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ae0e6-2a75-45fa-a51b-5ade4a70668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:40.097996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1145/2305] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:39 2022] POST /identity/v3/users => generated 291 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:42:40.103273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ae0e6-2a75-45fa-a51b-5ade4a70668b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:40.103273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ae0e6-2a75-45fa-a51b-5ade4a70668b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:40.103273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ae0e6-2a75-45fa-a51b-5ade4a70668b admin admin] PATH_INFO: `/v3/users/35f4defedd754e139ce4dd3f6a180110` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:40.103273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ae0e6-2a75-45fa-a51b-5ade4a70668b admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f4defedd754e139ce4dd3f6a180110)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:40.105533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96691b1e-d129-49a5-88f1-fa72010061e0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:40.117943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ae0e6-2a75-45fa-a51b-5ade4a70668b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:40.131691 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96691b1e-d129-49a5-88f1-fa72010061e0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:40.159786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25795d55-72e9-4be8-82a1-c4c8ebe9c6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:40.161901 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25795d55-72e9-4be8-82a1-c4c8ebe9c6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:40.162443 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25795d55-72e9-4be8-82a1-c4c8ebe9c6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:40.163084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25795d55-72e9-4be8-82a1-c4c8ebe9c6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:40.166807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25795d55-72e9-4be8-82a1-c4c8ebe9c6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:40.169633 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25795d55-72e9-4be8-82a1-c4c8ebe9c6c6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:40.209879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1146/2306] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:40.211464 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25795d55-72e9-4be8-82a1-c4c8ebe9c6c6 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:40.230892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25795d55-72e9-4be8-82a1-c4c8ebe9c6c6 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:40.248744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5aa87-3042-431a-b6a0-6b7c890e103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:40.249977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5aa87-3042-431a-b6a0-6b7c890e103a admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:40.250798 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5aa87-3042-431a-b6a0-6b7c890e103a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:40.251299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5aa87-3042-431a-b6a0-6b7c890e103a admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:40.253967 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5aa87-3042-431a-b6a0-6b7c890e103a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:40.257175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5aa87-3042-431a-b6a0-6b7c890e103a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:40.288792 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1147/2307] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:40.291013 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5aa87-3042-431a-b6a0-6b7c890e103a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:40.311678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5aa87-3042-431a-b6a0-6b7c890e103a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:40.329470 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358e6c0-8c9b-4736-8890-81849a7cd93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:40.332045 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e6c0-8c9b-4736-8890-81849a7cd93c admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:40.332045 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e6c0-8c9b-4736-8890-81849a7cd93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:40.332496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e6c0-8c9b-4736-8890-81849a7cd93c admin admin] PATH_INFO: `/v3/projects/3642fdd5ab874f20bda2395313aa5509/users/c91494330c2843c3bea4baa263eb302a/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:40.385128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358e6c0-8c9b-4736-8890-81849a7cd93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3642fdd5ab874f20bda2395313aa5509, user_id=c91494330c2843c3bea4baa263eb302a, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:40.392795 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358e6c0-8c9b-4736-8890-81849a7cd93c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:40.401775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:40.402541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-399ae0e6-2a75-45fa-a51b-5ade4a70668b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f4defedd754e139ce4dd3f6a180110'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.491237 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-399ae0e6-2a75-45fa-a51b-5ade4a70668b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f4defedd754e139ce4dd3f6a180110'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.504523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-399ae0e6-2a75-45fa-a51b-5ade4a70668b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f4defedd754e139ce4dd3f6a180110'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.505787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-399ae0e6-2a75-45fa-a51b-5ade4a70668b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f4defedd754e139ce4dd3f6a180110'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.515401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1148/2308] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:40 2022] PUT /identity/v3/projects/3642fdd5ab874f20bda2395313aa5509/users/c91494330c2843c3bea4baa263eb302a/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:40.529968 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e2708-da16-4ddc-b233-0d2ad47077f4 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:40.531262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e2708-da16-4ddc-b233-0d2ad47077f4 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:40.531262 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e2708-da16-4ddc-b233-0d2ad47077f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:40.546458 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-399ae0e6-2a75-45fa-a51b-5ade4a70668b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f4defedd754e139ce4dd3f6a180110'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.567433 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1161/2309] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:40 2022] DELETE /identity/v3/users/35f4defedd754e139ce4dd3f6a180110 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:40.569464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c69f5-0d12-4a38-abc7-0b72746071c1 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:40.570054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c69f5-0d12-4a38-abc7-0b72746071c1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:40.570582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c69f5-0d12-4a38-abc7-0b72746071c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:40.602070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7e1c69f5-0d12-4a38-abc7-0b72746071c1 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:40.606857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7e1c69f5-0d12-4a38-abc7-0b72746071c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:40.609512 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-429e2708-da16-4ddc-b233-0d2ad47077f4 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:40.612934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-429e2708-da16-4ddc-b233-0d2ad47077f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:40.829232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1149/2310] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:40.846426 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1162/2311] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:40.861781 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:40.971753 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e2708-da16-4ddc-b233-0d2ad47077f4 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:40.974713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-429e2708-da16-4ddc-b233-0d2ad47077f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:40.981859 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c69f5-0d12-4a38-abc7-0b72746071c1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:40.984430 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7e1c69f5-0d12-4a38-abc7-0b72746071c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:41.241902 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c69f5-0d12-4a38-abc7-0b72746071c1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:41.251558 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25936a80-ee27-4b1e-85eb-561cfe9d14aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:41.254110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25936a80-ee27-4b1e-85eb-561cfe9d14aa service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:41.255255 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25936a80-ee27-4b1e-85eb-561cfe9d14aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:41.256194 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25936a80-ee27-4b1e-85eb-561cfe9d14aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:41.263155 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e2708-da16-4ddc-b233-0d2ad47077f4 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:41.274838 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb0ece-0219-4aaf-b707-da68fcdd84d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:41.276940 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb0ece-0219-4aaf-b707-da68fcdd84d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:41.277610 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb0ece-0219-4aaf-b707-da68fcdd84d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:41.278570 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb0ece-0219-4aaf-b707-da68fcdd84d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:41.290556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25936a80-ee27-4b1e-85eb-561cfe9d14aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:41.293427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25936a80-ee27-4b1e-85eb-561cfe9d14aa service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:41.309038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb0ece-0219-4aaf-b707-da68fcdd84d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:41.315295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb0ece-0219-4aaf-b707-da68fcdd84d9 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:41.332493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1163/2312] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:41.339462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1150/2313] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:42.769112 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25936a80-ee27-4b1e-85eb-561cfe9d14aa service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:42.772539 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-25936a80-ee27-4b1e-85eb-561cfe9d14aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:42.801728 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25936a80-ee27-4b1e-85eb-561cfe9d14aa service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:42.818033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6fdb7-9c3b-4991-b02b-8262fe1bee48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:42.819274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6fdb7-9c3b-4991-b02b-8262fe1bee48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:42.819943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6fdb7-9c3b-4991-b02b-8262fe1bee48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:42.820494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6fdb7-9c3b-4991-b02b-8262fe1bee48 admin admin] PATH_INFO: `/v3/users/f52882dfbe1c41109bd7b9b68f8ecb93` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:42.825534 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6fdb7-9c3b-4991-b02b-8262fe1bee48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f52882dfbe1c41109bd7b9b68f8ecb93)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:42.840254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6fdb7-9c3b-4991-b02b-8262fe1bee48 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:43.167683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b4f6fdb7-9c3b-4991-b02b-8262fe1bee48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f52882dfbe1c41109bd7b9b68f8ecb93'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:43.300288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b4f6fdb7-9c3b-4991-b02b-8262fe1bee48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f52882dfbe1c41109bd7b9b68f8ecb93'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:43.305601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b9be4-c28b-4f0d-b1dc-cc5c1dd75353 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.311180 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b9be4-c28b-4f0d-b1dc-cc5c1dd75353 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.311180 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b9be4-c28b-4f0d-b1dc-cc5c1dd75353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.319120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b4f6fdb7-9c3b-4991-b02b-8262fe1bee48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f52882dfbe1c41109bd7b9b68f8ecb93'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:43.319910 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b4f6fdb7-9c3b-4991-b02b-8262fe1bee48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f52882dfbe1c41109bd7b9b68f8ecb93'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:43.356959 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-583b9be4-c28b-4f0d-b1dc-cc5c1dd75353 None None] MFA Rules not processed for user `b769fe84d79c4dda86000ddede4574e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:43.356959 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-583b9be4-c28b-4f0d-b1dc-cc5c1dd75353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:43.372240 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b4f6fdb7-9c3b-4991-b02b-8262fe1bee48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f52882dfbe1c41109bd7b9b68f8ecb93'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:43.455543 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1164/2314] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:42 2022] DELETE /identity/v3/users/f52882dfbe1c41109bd7b9b68f8ecb93 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:43.462851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb2a4c-f86b-4938-8ab1-0c590ca327e2 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.463641 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb2a4c-f86b-4938-8ab1-0c590ca327e2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.464383 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb2a4c-f86b-4938-8ab1-0c590ca327e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.555050 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b7bb2a4c-f86b-4938-8ab1-0c590ca327e2 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:43.555050 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b7bb2a4c-f86b-4938-8ab1-0c590ca327e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:43.617668 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1151/2315] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:43.623875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94bd6c-c5b8-45c8-8a22-f2dc5415dd1e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.624897 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94bd6c-c5b8-45c8-8a22-f2dc5415dd1e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.625504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94bd6c-c5b8-45c8-8a22-f2dc5415dd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.669191 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6e94bd6c-c5b8-45c8-8a22-f2dc5415dd1e None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:43.677259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6e94bd6c-c5b8-45c8-8a22-f2dc5415dd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:43.788365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1165/2316] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:43.823695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb2a4c-f86b-4938-8ab1-0c590ca327e2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:43.826691 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b7bb2a4c-f86b-4938-8ab1-0c590ca327e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:43.854648 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1152/2317] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 18 10:42:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:43.895354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94bd6c-c5b8-45c8-8a22-f2dc5415dd1e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:43.898035 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6e94bd6c-c5b8-45c8-8a22-f2dc5415dd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:43.996190 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb2a4c-f86b-4938-8ab1-0c590ca327e2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:44.004072 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cb99b-939b-4043-b09a-07540899f19d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:44.005552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb99b-939b-4043-b09a-07540899f19d service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:44.006315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb99b-939b-4043-b09a-07540899f19d service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:44.007038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb99b-939b-4043-b09a-07540899f19d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:44.032529 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cb99b-939b-4043-b09a-07540899f19d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:44.044040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cb99b-939b-4043-b09a-07540899f19d service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:44.068745 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1166/2318] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:44.081310 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94bd6c-c5b8-45c8-8a22-f2dc5415dd1e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:44.095755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:44.100133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4feeb-6b62-4531-b43f-b86887f25f7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:44.100826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4feeb-6b62-4531-b43f-b86887f25f7b service swift] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:44.101108 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4feeb-6b62-4531-b43f-b86887f25f7b service swift] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:44.101673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4feeb-6b62-4531-b43f-b86887f25f7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:44.115881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4feeb-6b62-4531-b43f-b86887f25f7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:44.118241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4feeb-6b62-4531-b43f-b86887f25f7b service swift] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:44.131682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1153/2319] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:42:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:42:44.251414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cb99b-939b-4043-b09a-07540899f19d service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:44.253456 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2c7cb99b-939b-4043-b09a-07540899f19d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:44.296700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cb99b-939b-4043-b09a-07540899f19d service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:44.313821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfd2ac-d6d5-4b67-9a64-86de06f7a3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:44.316581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfd2ac-d6d5-4b67-9a64-86de06f7a3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:44.317455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfd2ac-d6d5-4b67-9a64-86de06f7a3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:44.318053 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfd2ac-d6d5-4b67-9a64-86de06f7a3c0 admin admin] PATH_INFO: `/v3/projects/aca947c2fc96479499531e243c701ff7` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:44.321011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cfd2ac-d6d5-4b67-9a64-86de06f7a3c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aca947c2fc96479499531e243c701ff7)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:44.324798 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cfd2ac-d6d5-4b67-9a64-86de06f7a3c0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:44.740683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-33cfd2ac-d6d5-4b67-9a64-86de06f7a3c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca947c2fc96479499531e243c701ff7', 'request_id': 'req-33cfd2ac-d6d5-4b67-9a64-86de06f7a3c0'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:44.776395 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-33cfd2ac-d6d5-4b67-9a64-86de06f7a3c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca947c2fc96479499531e243c701ff7', 'request_id': 'req-33cfd2ac-d6d5-4b67-9a64-86de06f7a3c0'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:44.824077 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-33cfd2ac-d6d5-4b67-9a64-86de06f7a3c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca947c2fc96479499531e243c701ff7', 'request_id': 'req-33cfd2ac-d6d5-4b67-9a64-86de06f7a3c0'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:44.954943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-33cfd2ac-d6d5-4b67-9a64-86de06f7a3c0 admin admin] The token cache is being invalidate because project aca947c2fc96479499531e243c701ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:44.955532 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-33cfd2ac-d6d5-4b67-9a64-86de06f7a3c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:44.975625 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-33cfd2ac-d6d5-4b67-9a64-86de06f7a3c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:44.983647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1167/2320] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:44 2022] DELETE /identity/v3/projects/aca947c2fc96479499531e243c701ff7 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:44.990884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b3100-2953-4b08-986e-562a16860665 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:44.995786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b3100-2953-4b08-986e-562a16860665 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:44.995786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b3100-2953-4b08-986e-562a16860665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.095648 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-801b3100-2953-4b08-986e-562a16860665 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:45.098819 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-801b3100-2953-4b08-986e-562a16860665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:45.147005 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:45.269669 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1154/2321] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:45.283652 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103b51-e83d-487f-bcaf-73bc14296a63 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.284302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103b51-e83d-487f-bcaf-73bc14296a63 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.284815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103b51-e83d-487f-bcaf-73bc14296a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.331805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3d103b51-e83d-487f-bcaf-73bc14296a63 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:45.338929 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3d103b51-e83d-487f-bcaf-73bc14296a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:45.382222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1168/2322] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:45.384696 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b3100-2953-4b08-986e-562a16860665 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:45.430095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b3100-2953-4b08-986e-562a16860665 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:45.455326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3990-323f-41b3-b88b-745b8084dbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:45.460963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3990-323f-41b3-b88b-745b8084dbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.467429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3990-323f-41b3-b88b-745b8084dbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.468000 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3990-323f-41b3-b88b-745b8084dbb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.475023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa3990-323f-41b3-b88b-745b8084dbb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:45.475608 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa3990-323f-41b3-b88b-745b8084dbb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:45.489748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa3990-323f-41b3-b88b-745b8084dbb2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:45.570820 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1155/2323] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:45.580134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103b51-e83d-487f-bcaf-73bc14296a63 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:45.621780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103b51-e83d-487f-bcaf-73bc14296a63 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:45.650529 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ba303-cafb-445d-8c14-526a30f815b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:45.651951 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ba303-cafb-445d-8c14-526a30f815b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.661137 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ba303-cafb-445d-8c14-526a30f815b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.662724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ba303-cafb-445d-8c14-526a30f815b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.665571 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ba303-cafb-445d-8c14-526a30f815b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:45.678347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ba303-cafb-445d-8c14-526a30f815b3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:46.042530 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1169/2324] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:45 2022] POST /identity/v3/projects => generated 385 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:46.047574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3990-323f-41b3-b88b-745b8084dbb2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:46.070985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3990-323f-41b3-b88b-745b8084dbb2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:46.384192 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e260d-07b3-4419-a6b9-6d9abf10f1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:46.387506 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e260d-07b3-4419-a6b9-6d9abf10f1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:46.387994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e260d-07b3-4419-a6b9-6d9abf10f1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:46.389031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e260d-07b3-4419-a6b9-6d9abf10f1f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:46.396164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e260d-07b3-4419-a6b9-6d9abf10f1f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:46.407820 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e260d-07b3-4419-a6b9-6d9abf10f1f1 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:46.605589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1156/2325] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:46 2022] POST /identity/v3/users => generated 293 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:46.612109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ba303-cafb-445d-8c14-526a30f815b3 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:46.636551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ba303-cafb-445d-8c14-526a30f815b3 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:46.659657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d3d66-cf35-4443-9fc2-0e08aa887992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:46.661646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d3d66-cf35-4443-9fc2-0e08aa887992 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:46.662554 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d3d66-cf35-4443-9fc2-0e08aa887992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:46.663372 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d3d66-cf35-4443-9fc2-0e08aa887992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:46.665186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d3d66-cf35-4443-9fc2-0e08aa887992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:46.668890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d3d66-cf35-4443-9fc2-0e08aa887992 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:46.700751 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1170/2326] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:46.702964 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e260d-07b3-4419-a6b9-6d9abf10f1f1 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:46.749605 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5f8d1-d53e-41cc-94ad-6e7d0c869f96 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:46.750264 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5f8d1-d53e-41cc-94ad-6e7d0c869f96 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:46.751154 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5f8d1-d53e-41cc-94ad-6e7d0c869f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:46.788930 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e260d-07b3-4419-a6b9-6d9abf10f1f1 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:46.815941 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbada4-0f57-40ac-ad8a-1a4650f76da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:46.819239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbada4-0f57-40ac-ad8a-1a4650f76da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:46.824341 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbada4-0f57-40ac-ad8a-1a4650f76da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:46.825104 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbada4-0f57-40ac-ad8a-1a4650f76da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:46.829398 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbada4-0f57-40ac-ad8a-1a4650f76da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:46.834365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-87a5f8d1-d53e-41cc-94ad-6e7d0c869f96 None None] MFA Rules not processed for user `c91494330c2843c3bea4baa263eb302a`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:46.835226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbada4-0f57-40ac-ad8a-1a4650f76da4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:46.839649 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-87a5f8d1-d53e-41cc-94ad-6e7d0c869f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:46.897040 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1157/2327] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:46.898309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbada4-0f57-40ac-ad8a-1a4650f76da4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:46.958317 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbada4-0f57-40ac-ad8a-1a4650f76da4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:46.989643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2febd14-79de-4915-9d82-59ba78741468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:46.991803 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2febd14-79de-4915-9d82-59ba78741468 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:46.994801 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2febd14-79de-4915-9d82-59ba78741468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:46.995609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2febd14-79de-4915-9d82-59ba78741468 admin admin] PATH_INFO: `/v3/projects/cd2327a1012a4d5c91555b01b2fd4d21/users/61aa854524cc4b05b6baaf67e69708ab/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:47.093608 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2febd14-79de-4915-9d82-59ba78741468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2327a1012a4d5c91555b01b2fd4d21, user_id=61aa854524cc4b05b6baaf67e69708ab, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:47.107827 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2febd14-79de-4915-9d82-59ba78741468 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:47.219545 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1171/2328] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:47.236065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5f8d1-d53e-41cc-94ad-6e7d0c869f96 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:47.239939 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-87a5f8d1-d53e-41cc-94ad-6e7d0c869f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:47.292246 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1158/2329] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:46 2022] PUT /identity/v3/projects/cd2327a1012a4d5c91555b01b2fd4d21/users/61aa854524cc4b05b6baaf67e69708ab/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:47.307064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa14191-8634-442e-bbb9-6e5dfb2aa7f8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:47.307591 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa14191-8634-442e-bbb9-6e5dfb2aa7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:47.308100 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa14191-8634-442e-bbb9-6e5dfb2aa7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:47.430892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-afa14191-8634-442e-bbb9-6e5dfb2aa7f8 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:47.443163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-afa14191-8634-442e-bbb9-6e5dfb2aa7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:47.602461 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5f8d1-d53e-41cc-94ad-6e7d0c869f96 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:47.751330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1159/2330] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:47.755050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa14191-8634-442e-bbb9-6e5dfb2aa7f8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:47.756402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-afa14191-8634-442e-bbb9-6e5dfb2aa7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:47.849777 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:47.874180 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa14191-8634-442e-bbb9-6e5dfb2aa7f8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:47.910060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc25d4-8983-465f-adc4-11259635bcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:47.913127 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc25d4-8983-465f-adc4-11259635bcbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:47.923534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc25d4-8983-465f-adc4-11259635bcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:47.924709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc25d4-8983-465f-adc4-11259635bcbb admin admin] PATH_INFO: `/v3/projects/0d1f1cc699ee47c8adfaae4671101280` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:47.949434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc25d4-8983-465f-adc4-11259635bcbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1f1cc699ee47c8adfaae4671101280)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:47.959395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc25d4-8983-465f-adc4-11259635bcbb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:47.969034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c6276-72e7-4a2c-8d3a-fa4e7348ffec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:47.970277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c6276-72e7-4a2c-8d3a-fa4e7348ffec service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:47.973645 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c6276-72e7-4a2c-8d3a-fa4e7348ffec service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:47.974173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c6276-72e7-4a2c-8d3a-fa4e7348ffec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:47.980841 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:48.256968 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c8cc25d4-8983-465f-adc4-11259635bcbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1f1cc699ee47c8adfaae4671101280', 'request_id': 'req-c8cc25d4-8983-465f-adc4-11259635bcbb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:48.279503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c8cc25d4-8983-465f-adc4-11259635bcbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1f1cc699ee47c8adfaae4671101280', 'request_id': 'req-c8cc25d4-8983-465f-adc4-11259635bcbb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:48.280835 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c6276-72e7-4a2c-8d3a-fa4e7348ffec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:48.284960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c6276-72e7-4a2c-8d3a-fa4e7348ffec service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:48.304580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c8cc25d4-8983-465f-adc4-11259635bcbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1f1cc699ee47c8adfaae4671101280', 'request_id': 'req-c8cc25d4-8983-465f-adc4-11259635bcbb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:48.314660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1172/2331] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 1079 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:48.319856 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c6276-72e7-4a2c-8d3a-fa4e7348ffec service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:48.326739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e46c6276-72e7-4a2c-8d3a-fa4e7348ffec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:48.423847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c8cc25d4-8983-465f-adc4-11259635bcbb admin admin] The token cache is being invalidate because project 0d1f1cc699ee47c8adfaae4671101280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:48.424334 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c8cc25d4-8983-465f-adc4-11259635bcbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:48.430244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c8cc25d4-8983-465f-adc4-11259635bcbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:48.445698 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1160/2332] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:47 2022] DELETE /identity/v3/projects/0d1f1cc699ee47c8adfaae4671101280 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:48.456985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fff01-3153-4864-9403-74b95b2259bf None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:48.457467 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fff01-3153-4864-9403-74b95b2259bf None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:48.457965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fff01-3153-4864-9403-74b95b2259bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:48.549327 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-496fff01-3153-4864-9403-74b95b2259bf None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:48.552225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-496fff01-3153-4864-9403-74b95b2259bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:48.629969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c6276-72e7-4a2c-8d3a-fa4e7348ffec service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:48.814882 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1161/2333] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:48.828624 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144b4e3-8aea-44eb-a4b1-8e0b15305242 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:48.830486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144b4e3-8aea-44eb-a4b1-8e0b15305242 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:48.830486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144b4e3-8aea-44eb-a4b1-8e0b15305242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:48.887948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-7144b4e3-8aea-44eb-a4b1-8e0b15305242 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:48.890110 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7144b4e3-8aea-44eb-a4b1-8e0b15305242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:48.922417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed188d1-ed74-46f5-a6f3-cf6d940c7cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:48.922417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed188d1-ed74-46f5-a6f3-cf6d940c7cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:48.922417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed188d1-ed74-46f5-a6f3-cf6d940c7cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:48.922417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed188d1-ed74-46f5-a6f3-cf6d940c7cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:48.923055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1162/2334] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:48.926675 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144b4e3-8aea-44eb-a4b1-8e0b15305242 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:48.936086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0ed188d1-ed74-46f5-a6f3-cf6d940c7cb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:48.977566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144b4e3-8aea-44eb-a4b1-8e0b15305242 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:49.006416 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e399a-6657-4301-b294-d039127e8316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:49.007628 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e399a-6657-4301-b294-d039127e8316 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:49.008148 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e399a-6657-4301-b294-d039127e8316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:49.008803 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e399a-6657-4301-b294-d039127e8316 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:49.010283 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e399a-6657-4301-b294-d039127e8316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:49.010960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e399a-6657-4301-b294-d039127e8316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:49.020038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e399a-6657-4301-b294-d039127e8316 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:49.045132 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed188d1-ed74-46f5-a6f3-cf6d940c7cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:49.048737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed188d1-ed74-46f5-a6f3-cf6d940c7cb4 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:49.092632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1163/2335] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:49.095887 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e399a-6657-4301-b294-d039127e8316 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:49.096886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1173/2336] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 781 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:49.135260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e399a-6657-4301-b294-d039127e8316 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:49.161635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa589d00-6166-40e7-8b81-3c8bbfa806b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:49.162785 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa589d00-6166-40e7-8b81-3c8bbfa806b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:49.163254 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa589d00-6166-40e7-8b81-3c8bbfa806b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:49.163792 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa589d00-6166-40e7-8b81-3c8bbfa806b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:49.165122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa589d00-6166-40e7-8b81-3c8bbfa806b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:49.174137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa589d00-6166-40e7-8b81-3c8bbfa806b5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:49.317839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1164/2337] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:49 2022] POST /identity/v3/projects => generated 359 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:49.320493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed188d1-ed74-46f5-a6f3-cf6d940c7cb4 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:49.426386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed188d1-ed74-46f5-a6f3-cf6d940c7cb4 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:49.646967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ce21e-bc19-46b4-9242-a80ee77b9642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:49.647885 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ce21e-bc19-46b4-9242-a80ee77b9642 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:49.648285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ce21e-bc19-46b4-9242-a80ee77b9642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:49.648672 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ce21e-bc19-46b4-9242-a80ee77b9642 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:49.649670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ce21e-bc19-46b4-9242-a80ee77b9642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:49.654409 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ce21e-bc19-46b4-9242-a80ee77b9642 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:49.815336 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1174/2338] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:49 2022] POST /identity/v3/users => generated 280 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:42:49.816738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa589d00-6166-40e7-8b81-3c8bbfa806b5 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:49.837543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa589d00-6166-40e7-8b81-3c8bbfa806b5 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:49.869193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bdffd-20cd-4bfd-a76a-7532578c572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:49.870098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bdffd-20cd-4bfd-a76a-7532578c572a admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:49.870575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bdffd-20cd-4bfd-a76a-7532578c572a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:49.871160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bdffd-20cd-4bfd-a76a-7532578c572a admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:49.879746 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bdffd-20cd-4bfd-a76a-7532578c572a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:49.882168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bdffd-20cd-4bfd-a76a-7532578c572a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:49.908511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1165/2339] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:49.910006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ce21e-bc19-46b4-9242-a80ee77b9642 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:49.947761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ce21e-bc19-46b4-9242-a80ee77b9642 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:49.962141 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e8430-ff41-4883-8036-332d4177eed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:49.975167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e8430-ff41-4883-8036-332d4177eed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:49.977797 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e8430-ff41-4883-8036-332d4177eed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:49.978254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e8430-ff41-4883-8036-332d4177eed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:49.981127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e8430-ff41-4883-8036-332d4177eed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:49.990823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e8430-ff41-4883-8036-332d4177eed0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:50.091341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1175/2340] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:50.094364 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bdffd-20cd-4bfd-a76a-7532578c572a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:50.134252 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bdffd-20cd-4bfd-a76a-7532578c572a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:50.145407 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be180184-3294-41a1-9db1-46ae838fd5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:50.147796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be180184-3294-41a1-9db1-46ae838fd5b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:50.152972 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be180184-3294-41a1-9db1-46ae838fd5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:50.155242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be180184-3294-41a1-9db1-46ae838fd5b6 admin admin] PATH_INFO: `/v3/projects/5796a6fc3f6a45c9993a3ee4b6865ab3/users/68867b11727d4d5fa87d894e59b9539a/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:50.205026 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be180184-3294-41a1-9db1-46ae838fd5b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5796a6fc3f6a45c9993a3ee4b6865ab3, user_id=68867b11727d4d5fa87d894e59b9539a, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:50.217785 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be180184-3294-41a1-9db1-46ae838fd5b6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:50.272744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:50.335578 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:50.367435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1166/2341] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:50 2022] PUT /identity/v3/projects/5796a6fc3f6a45c9993a3ee4b6865ab3/users/68867b11727d4d5fa87d894e59b9539a/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:50.391744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dc2c8-af47-4d7a-82ed-8b1d0214c662 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:50.392613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dc2c8-af47-4d7a-82ed-8b1d0214c662 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:50.392613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dc2c8-af47-4d7a-82ed-8b1d0214c662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:50.535377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e91dc2c8-af47-4d7a-82ed-8b1d0214c662 None None] MFA Rules not processed for user `68867b11727d4d5fa87d894e59b9539a`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:50.545885 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e91dc2c8-af47-4d7a-82ed-8b1d0214c662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:50.646464 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff315f9-e5e4-4a1c-a38d-9b25d1ec06b9 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:50.647385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff315f9-e5e4-4a1c-a38d-9b25d1ec06b9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:50.648184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff315f9-e5e4-4a1c-a38d-9b25d1ec06b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:50.765200 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-eff315f9-e5e4-4a1c-a38d-9b25d1ec06b9 None None] MFA Rules not processed for user `50fbf833259c466d8d764fab65af0ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:50.771011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-eff315f9-e5e4-4a1c-a38d-9b25d1ec06b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:50.942787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1176/2342] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:50 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 548 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:50.988277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dc2c8-af47-4d7a-82ed-8b1d0214c662 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:50.989906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e91dc2c8-af47-4d7a-82ed-8b1d0214c662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:51.110530 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1167/2343] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:50 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:51.164099 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dc2c8-af47-4d7a-82ed-8b1d0214c662 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:51.180656 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491783f8-319b-40dc-b32b-eb62fd293d3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:51.181369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491783f8-319b-40dc-b32b-eb62fd293d3d service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:51.181658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491783f8-319b-40dc-b32b-eb62fd293d3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:51.181937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491783f8-319b-40dc-b32b-eb62fd293d3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:51.218158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491783f8-319b-40dc-b32b-eb62fd293d3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:51.224432 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491783f8-319b-40dc-b32b-eb62fd293d3d service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:51.227680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:51.248570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1177/2344] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:50 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:51.262264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff315f9-e5e4-4a1c-a38d-9b25d1ec06b9 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:51.316541 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:51.444142 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f5d9b-9503-4494-8fbb-41011f6cd5a6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:51.444909 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f5d9b-9503-4494-8fbb-41011f6cd5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:51.445226 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f5d9b-9503-4494-8fbb-41011f6cd5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:51.565936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8a9f5d9b-9503-4494-8fbb-41011f6cd5a6 None None] MFA Rules not processed for user `c91494330c2843c3bea4baa263eb302a`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:51.571828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8a9f5d9b-9503-4494-8fbb-41011f6cd5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:51.730302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff315f9-e5e4-4a1c-a38d-9b25d1ec06b9 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:51.762010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3bf9b-650b-4c6a-ad7e-bac2e53dea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:51.776847 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3bf9b-650b-4c6a-ad7e-bac2e53dea93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:51.781035 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3bf9b-650b-4c6a-ad7e-bac2e53dea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:51.782610 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3bf9b-650b-4c6a-ad7e-bac2e53dea93 admin admin] PATH_INFO: `/v3/users/68867b11727d4d5fa87d894e59b9539a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:51.786677 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3bf9b-650b-4c6a-ad7e-bac2e53dea93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68867b11727d4d5fa87d894e59b9539a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:51.792442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3bf9b-650b-4c6a-ad7e-bac2e53dea93 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:51.852251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:51.966963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:52.019173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1178/2345] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 577 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:52.131496 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f5d9b-9503-4494-8fbb-41011f6cd5a6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:52.135217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8a9f5d9b-9503-4494-8fbb-41011f6cd5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:52.192080 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:52.256853 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1df3bf9b-650b-4c6a-ad7e-bac2e53dea93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68867b11727d4d5fa87d894e59b9539a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:52.340449 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1df3bf9b-650b-4c6a-ad7e-bac2e53dea93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68867b11727d4d5fa87d894e59b9539a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:52.383856 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1df3bf9b-650b-4c6a-ad7e-bac2e53dea93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68867b11727d4d5fa87d894e59b9539a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:52.385185 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1df3bf9b-650b-4c6a-ad7e-bac2e53dea93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68867b11727d4d5fa87d894e59b9539a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:52.425280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1df3bf9b-650b-4c6a-ad7e-bac2e53dea93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68867b11727d4d5fa87d894e59b9539a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:52.457776 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1168/2346] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:51 2022] DELETE /identity/v3/users/68867b11727d4d5fa87d894e59b9539a => generated 0 bytes in 1193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:52.467070 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdd5c3-888c-4f9f-8e6e-d0632d8850b0 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:52.469458 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdd5c3-888c-4f9f-8e6e-d0632d8850b0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:52.470009 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdd5c3-888c-4f9f-8e6e-d0632d8850b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:52.493234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f5d9b-9503-4494-8fbb-41011f6cd5a6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:52.555589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b7cdd5c3-888c-4f9f-8e6e-d0632d8850b0 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:52.561012 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b7cdd5c3-888c-4f9f-8e6e-d0632d8850b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:52.561677 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:52.616142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:52.777076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f9d31-dc48-41a7-aec8-b45c396f32d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:52.778258 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f9d31-dc48-41a7-aec8-b45c396f32d7 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:52.779579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f9d31-dc48-41a7-aec8-b45c396f32d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:52.780674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f9d31-dc48-41a7-aec8-b45c396f32d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:52.795741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6a1f9d31-dc48-41a7-aec8-b45c396f32d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:52.897117 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1169/2347] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:53.083355 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdd5c3-888c-4f9f-8e6e-d0632d8850b0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:53.085587 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b7cdd5c3-888c-4f9f-8e6e-d0632d8850b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:53.161652 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f9d31-dc48-41a7-aec8-b45c396f32d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:53.178028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f9d31-dc48-41a7-aec8-b45c396f32d7 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:53.211415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:53.271547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1179/2348] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 1141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:53.329108 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:53.419865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:53.467440 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdd5c3-888c-4f9f-8e6e-d0632d8850b0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:53.489146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e01c58-5d70-4545-b349-8747197badb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:53.499789 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e01c58-5d70-4545-b349-8747197badb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:53.499789 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e01c58-5d70-4545-b349-8747197badb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:53.499789 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e01c58-5d70-4545-b349-8747197badb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:53.544508 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e01c58-5d70-4545-b349-8747197badb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:53.548351 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e01c58-5d70-4545-b349-8747197badb5 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:53.600957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1170/2349] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:53.781936 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:54.229206 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:54.734595 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:54.905451 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:55.432926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:56.367888 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f9d31-dc48-41a7-aec8-b45c396f32d7 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:56.367888 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6a1f9d31-dc48-41a7-aec8-b45c396f32d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:56.393564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f9d31-dc48-41a7-aec8-b45c396f32d7 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:56.413745 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a42c6-9b47-40f9-8c1a-b1222bd355a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:56.415334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a42c6-9b47-40f9-8c1a-b1222bd355a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:56.415845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a42c6-9b47-40f9-8c1a-b1222bd355a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:56.416356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a42c6-9b47-40f9-8c1a-b1222bd355a7 admin admin] PATH_INFO: `/v3/projects/5796a6fc3f6a45c9993a3ee4b6865ab3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:56.421471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a42c6-9b47-40f9-8c1a-b1222bd355a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5796a6fc3f6a45c9993a3ee4b6865ab3)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:56.441914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a42c6-9b47-40f9-8c1a-b1222bd355a7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:56.747844 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:56.829192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d11a42c6-9b47-40f9-8c1a-b1222bd355a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5796a6fc3f6a45c9993a3ee4b6865ab3', 'request_id': 'req-d11a42c6-9b47-40f9-8c1a-b1222bd355a7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.851972 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d11a42c6-9b47-40f9-8c1a-b1222bd355a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5796a6fc3f6a45c9993a3ee4b6865ab3', 'request_id': 'req-d11a42c6-9b47-40f9-8c1a-b1222bd355a7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.892659 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d11a42c6-9b47-40f9-8c1a-b1222bd355a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5796a6fc3f6a45c9993a3ee4b6865ab3', 'request_id': 'req-d11a42c6-9b47-40f9-8c1a-b1222bd355a7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.971303 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:57.052735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d11a42c6-9b47-40f9-8c1a-b1222bd355a7 admin admin] The token cache is being invalidate because project 5796a6fc3f6a45c9993a3ee4b6865ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:57.053248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d11a42c6-9b47-40f9-8c1a-b1222bd355a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:57.055357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d11a42c6-9b47-40f9-8c1a-b1222bd355a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:57.061422 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1180/2350] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:56 2022] DELETE /identity/v3/projects/5796a6fc3f6a45c9993a3ee4b6865ab3 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:57.067644 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18867af4-a0ff-48f4-9cc3-24b29cd4d81d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.068143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18867af4-a0ff-48f4-9cc3-24b29cd4d81d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.068621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18867af4-a0ff-48f4-9cc3-24b29cd4d81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.184335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-18867af4-a0ff-48f4-9cc3-24b29cd4d81d None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:57.202008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-18867af4-a0ff-48f4-9cc3-24b29cd4d81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:57.572625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1171/2351] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:57.580629 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa940-b78f-4174-a6c7-7c872e7b8bd3 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.581903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa940-b78f-4174-a6c7-7c872e7b8bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.582787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa940-b78f-4174-a6c7-7c872e7b8bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.634744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f2caa940-b78f-4174-a6c7-7c872e7b8bd3 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:57.641958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f2caa940-b78f-4174-a6c7-7c872e7b8bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:57.726003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1181/2352] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:57.728758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18867af4-a0ff-48f4-9cc3-24b29cd4d81d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:57.799711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18867af4-a0ff-48f4-9cc3-24b29cd4d81d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:57.843749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ee1a1-fd29-454d-ba1b-5adb6064092e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:57.845364 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ee1a1-fd29-454d-ba1b-5adb6064092e admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.846224 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ee1a1-fd29-454d-ba1b-5adb6064092e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.847105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ee1a1-fd29-454d-ba1b-5adb6064092e admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.848811 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ee1a1-fd29-454d-ba1b-5adb6064092e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:57.849863 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ee1a1-fd29-454d-ba1b-5adb6064092e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:57.873188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ee1a1-fd29-454d-ba1b-5adb6064092e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:57.935050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1172/2353] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:57.935965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caa940-b78f-4174-a6c7-7c872e7b8bd3 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:57.952266 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caa940-b78f-4174-a6c7-7c872e7b8bd3 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:57.980396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5e7d0-c6a1-411f-b3b8-742914517972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:57.984908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5e7d0-c6a1-411f-b3b8-742914517972 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.988495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5e7d0-c6a1-411f-b3b8-742914517972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.989432 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5e7d0-c6a1-411f-b3b8-742914517972 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.998986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5e7d0-c6a1-411f-b3b8-742914517972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:58.012265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5e7d0-c6a1-411f-b3b8-742914517972 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:58.174209 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:58.197418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1182/2354] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:57 2022] POST /identity/v3/projects => generated 385 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:58.203876 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ee1a1-fd29-454d-ba1b-5adb6064092e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:58.273691 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ee1a1-fd29-454d-ba1b-5adb6064092e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:58.337634 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:58.613986 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6068f-3805-4175-a28e-e4b82d833fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:58.615308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6068f-3805-4175-a28e-e4b82d833fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:58.615812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6068f-3805-4175-a28e-e4b82d833fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:58.616383 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6068f-3805-4175-a28e-e4b82d833fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:58.617983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6068f-3805-4175-a28e-e4b82d833fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:58.623332 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6068f-3805-4175-a28e-e4b82d833fd3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:58.806684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1173/2355] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:58 2022] POST /identity/v3/users => generated 293 bytes in 603 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:58.807094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5e7d0-c6a1-411f-b3b8-742914517972 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:58.833424 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5e7d0-c6a1-411f-b3b8-742914517972 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:58.846560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc746c8-df0e-4a4e-8bb0-18183f09121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:58.847962 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc746c8-df0e-4a4e-8bb0-18183f09121d admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:58.848520 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc746c8-df0e-4a4e-8bb0-18183f09121d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:58.852126 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc746c8-df0e-4a4e-8bb0-18183f09121d admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:58.853276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc746c8-df0e-4a4e-8bb0-18183f09121d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:58.855421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc746c8-df0e-4a4e-8bb0-18183f09121d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:58.904877 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1183/2356] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:58.911495 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6068f-3805-4175-a28e-e4b82d833fd3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:58.973018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6068f-3805-4175-a28e-e4b82d833fd3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:59.004492 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa08d0b-1f10-487f-ac8f-1829016a3871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:59.005515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa08d0b-1f10-487f-ac8f-1829016a3871 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:59.005962 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa08d0b-1f10-487f-ac8f-1829016a3871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:59.013213 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa08d0b-1f10-487f-ac8f-1829016a3871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:59.018018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa08d0b-1f10-487f-ac8f-1829016a3871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:59.046181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa08d0b-1f10-487f-ac8f-1829016a3871 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:59.090937 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1174/2357] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:59.094780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc746c8-df0e-4a4e-8bb0-18183f09121d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:59.114816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc746c8-df0e-4a4e-8bb0-18183f09121d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:59.130810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3227562-02f6-4060-bb2b-150c5b9d04af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:59.132928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3227562-02f6-4060-bb2b-150c5b9d04af admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:59.133376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3227562-02f6-4060-bb2b-150c5b9d04af admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:59.133958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3227562-02f6-4060-bb2b-150c5b9d04af admin admin] PATH_INFO: `/v3/projects/fdec79fd14314ff6943c259525d1ed92/users/e5325690e28344568a2ccf732ea27916/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:59.165811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3227562-02f6-4060-bb2b-150c5b9d04af admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdec79fd14314ff6943c259525d1ed92, user_id=e5325690e28344568a2ccf732ea27916, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:59.172663 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3227562-02f6-4060-bb2b-150c5b9d04af admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:59.282145 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1184/2358] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:59 2022] PUT /identity/v3/projects/fdec79fd14314ff6943c259525d1ed92/users/e5325690e28344568a2ccf732ea27916/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:59.302187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a339bda-359f-450f-a619-95a13483a75f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:59.303430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a339bda-359f-450f-a619-95a13483a75f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:59.304019 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a339bda-359f-450f-a619-95a13483a75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:59.308430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:59.409484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4a339bda-359f-450f-a619-95a13483a75f None None] MFA Rules not processed for user `e5325690e28344568a2ccf732ea27916`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:59.412956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4a339bda-359f-450f-a619-95a13483a75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:59.663971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1175/2359] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:59.670921 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3227562-02f6-4060-bb2b-150c5b9d04af admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:59.812662 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:59.842343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:59.921254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3227562-02f6-4060-bb2b-150c5b9d04af admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:59.942417 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28951e36-3697-4026-9c59-2a491ee034ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:59.943196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28951e36-3697-4026-9c59-2a491ee034ac admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:59.943482 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28951e36-3697-4026-9c59-2a491ee034ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:59.943763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28951e36-3697-4026-9c59-2a491ee034ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:59.944496 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28951e36-3697-4026-9c59-2a491ee034ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:59.947388 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28951e36-3697-4026-9c59-2a491ee034ac admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:00.204766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1185/2360] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:59 2022] POST /identity/v3/projects => generated 385 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:00.207384 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a339bda-359f-450f-a619-95a13483a75f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:00.282957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a339bda-359f-450f-a619-95a13483a75f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:00.564785 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22524d-9091-43e7-94ed-dcf7cfa876b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:00.580337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22524d-9091-43e7-94ed-dcf7cfa876b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:00.580987 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22524d-9091-43e7-94ed-dcf7cfa876b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:00.581427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22524d-9091-43e7-94ed-dcf7cfa876b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:00.582462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22524d-9091-43e7-94ed-dcf7cfa876b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:00.585658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22524d-9091-43e7-94ed-dcf7cfa876b0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:00.742921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1176/2361] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:00 2022] POST /identity/v3/users => generated 293 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:00.757091 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28951e36-3697-4026-9c59-2a491ee034ac admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:00.849348 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28951e36-3697-4026-9c59-2a491ee034ac admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:00.912565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6648aa-f572-42b0-bc3f-d22424fe7b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:00.918410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6648aa-f572-42b0-bc3f-d22424fe7b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:00.919662 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6648aa-f572-42b0-bc3f-d22424fe7b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:00.919999 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6648aa-f572-42b0-bc3f-d22424fe7b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:00.920883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6648aa-f572-42b0-bc3f-d22424fe7b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:00.931989 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6648aa-f572-42b0-bc3f-d22424fe7b50 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:00.960565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1186/2362] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:00.970270 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22524d-9091-43e7-94ed-dcf7cfa876b0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:00.998596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22524d-9091-43e7-94ed-dcf7cfa876b0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:01.038827 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be329a-d521-4a4e-be51-ed751fd0feae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:01.042407 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be329a-d521-4a4e-be51-ed751fd0feae admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:01.042870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be329a-d521-4a4e-be51-ed751fd0feae admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:01.043063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be329a-d521-4a4e-be51-ed751fd0feae admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:01.045413 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be329a-d521-4a4e-be51-ed751fd0feae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:01.053245 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be329a-d521-4a4e-be51-ed751fd0feae admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:01.123011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1177/2363] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:01.128793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6648aa-f572-42b0-bc3f-d22424fe7b50 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:01.151586 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6648aa-f572-42b0-bc3f-d22424fe7b50 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:01.170596 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82da459-1e0a-40b0-b8f1-bf52746f1902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:01.171458 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82da459-1e0a-40b0-b8f1-bf52746f1902 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:01.171870 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82da459-1e0a-40b0-b8f1-bf52746f1902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:01.172009 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82da459-1e0a-40b0-b8f1-bf52746f1902 admin admin] PATH_INFO: `/v3/projects/5656d7d904ae469a8247be01a2e116aa/users/fea46d277814429ea6f656f8bac8ac24/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:01.234832 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82da459-1e0a-40b0-b8f1-bf52746f1902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5656d7d904ae469a8247be01a2e116aa, user_id=fea46d277814429ea6f656f8bac8ac24, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:01.239207 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82da459-1e0a-40b0-b8f1-bf52746f1902 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:01.275692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:01.409448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1187/2364] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:01 2022] PUT /identity/v3/projects/5656d7d904ae469a8247be01a2e116aa/users/fea46d277814429ea6f656f8bac8ac24/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:01.432709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4402fa-fe00-459f-862f-c0f617549d09 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:01.433562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4402fa-fe00-459f-862f-c0f617549d09 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:01.434299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4402fa-fe00-459f-862f-c0f617549d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:01.537656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0a4402fa-fe00-459f-862f-c0f617549d09 None None] MFA Rules not processed for user `fea46d277814429ea6f656f8bac8ac24`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:01.541009 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0a4402fa-fe00-459f-862f-c0f617549d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:01.738217 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1178/2365] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:43:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:01.745997 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82da459-1e0a-40b0-b8f1-bf52746f1902 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:01.915940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:01.954142 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82da459-1e0a-40b0-b8f1-bf52746f1902 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:01.976716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde58345-12c0-4a40-9717-1a09a4b20fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:01.980363 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde58345-12c0-4a40-9717-1a09a4b20fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:01.983021 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde58345-12c0-4a40-9717-1a09a4b20fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:01.983472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde58345-12c0-4a40-9717-1a09a4b20fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:01.987369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde58345-12c0-4a40-9717-1a09a4b20fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:01.998982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde58345-12c0-4a40-9717-1a09a4b20fcc admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:02.146662 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1188/2366] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:01 2022] POST /identity/v3/projects => generated 385 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:02.149731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4402fa-fe00-459f-862f-c0f617549d09 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:02.176521 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4402fa-fe00-459f-862f-c0f617549d09 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:02.270975 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:02.354959 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9b31c-5c39-44cf-a4e2-a32ace4b5e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:02.355660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9b31c-5c39-44cf-a4e2-a32ace4b5e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:02.355942 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9b31c-5c39-44cf-a4e2-a32ace4b5e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:02.364122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9b31c-5c39-44cf-a4e2-a32ace4b5e77 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:02.365997 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9b31c-5c39-44cf-a4e2-a32ace4b5e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:02.372149 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9b31c-5c39-44cf-a4e2-a32ace4b5e77 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:02.538810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde58345-12c0-4a40-9717-1a09a4b20fcc admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:02.542228 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1179/2367] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:02 2022] POST /identity/v3/users => generated 299 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:02.552910 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde58345-12c0-4a40-9717-1a09a4b20fcc admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:02.572815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96f6f3-20ab-446c-ae95-867efe76af37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:02.573512 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96f6f3-20ab-446c-ae95-867efe76af37 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:02.573796 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96f6f3-20ab-446c-ae95-867efe76af37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:02.574067 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96f6f3-20ab-446c-ae95-867efe76af37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:02.574871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96f6f3-20ab-446c-ae95-867efe76af37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:02.585773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96f6f3-20ab-446c-ae95-867efe76af37 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:02.620411 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1189/2368] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:02.631232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9b31c-5c39-44cf-a4e2-a32ace4b5e77 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:02.664131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9b31c-5c39-44cf-a4e2-a32ace4b5e77 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:02.676757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b552b-a7b2-45dc-9a1c-a0ebe7dc6091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:02.682060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b552b-a7b2-45dc-9a1c-a0ebe7dc6091 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:02.682060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b552b-a7b2-45dc-9a1c-a0ebe7dc6091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:02.682060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b552b-a7b2-45dc-9a1c-a0ebe7dc6091 admin admin] PATH_INFO: `/v3/projects/7b100a4187e54004bb6f7afbca12c5a8/users/d822dec1ceae4827a41727600674ca9d/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:02.731644 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b552b-a7b2-45dc-9a1c-a0ebe7dc6091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b100a4187e54004bb6f7afbca12c5a8, user_id=d822dec1ceae4827a41727600674ca9d, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:02.738777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b552b-a7b2-45dc-9a1c-a0ebe7dc6091 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:02.795814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:02.899707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1180/2369] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:02 2022] PUT /identity/v3/projects/7b100a4187e54004bb6f7afbca12c5a8/users/d822dec1ceae4827a41727600674ca9d/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:02.910217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96f6f3-20ab-446c-ae95-867efe76af37 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:02.926937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96f6f3-20ab-446c-ae95-867efe76af37 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:03.075608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de98729-3a1b-4831-8b1e-ec574037d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:03.076546 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de98729-3a1b-4831-8b1e-ec574037d319 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:03.076828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de98729-3a1b-4831-8b1e-ec574037d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:03.077102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de98729-3a1b-4831-8b1e-ec574037d319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:03.077849 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de98729-3a1b-4831-8b1e-ec574037d319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:03.079576 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de98729-3a1b-4831-8b1e-ec574037d319 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:03.096703 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1190/2370] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:03.098145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b552b-a7b2-45dc-9a1c-a0ebe7dc6091 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:03.149559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b552b-a7b2-45dc-9a1c-a0ebe7dc6091 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:03.177538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8bf3e-3bca-4ae5-b653-d946fa5968bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:03.179617 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8bf3e-3bca-4ae5-b653-d946fa5968bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:03.182468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8bf3e-3bca-4ae5-b653-d946fa5968bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:03.183033 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8bf3e-3bca-4ae5-b653-d946fa5968bb admin admin] PATH_INFO: `/v3/projects/7b100a4187e54004bb6f7afbca12c5a8/users/d822dec1ceae4827a41727600674ca9d/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:03.194491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:03.197929 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8bf3e-3bca-4ae5-b653-d946fa5968bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b100a4187e54004bb6f7afbca12c5a8, user_id=d822dec1ceae4827a41727600674ca9d, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:03.219388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8bf3e-3bca-4ae5-b653-d946fa5968bb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:03.256736 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1181/2371] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:03 2022] PUT /identity/v3/projects/7b100a4187e54004bb6f7afbca12c5a8/users/d822dec1ceae4827a41727600674ca9d/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:03.270820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe426b27-c11c-4fb8-9acb-1a7320b25b3c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:03.271092 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe426b27-c11c-4fb8-9acb-1a7320b25b3c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:03.271369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe426b27-c11c-4fb8-9acb-1a7320b25b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:03.343945 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-fe426b27-c11c-4fb8-9acb-1a7320b25b3c None None] MFA Rules not processed for user `d822dec1ceae4827a41727600674ca9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:03.349001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fe426b27-c11c-4fb8-9acb-1a7320b25b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:03.520474 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:03.548535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:03.702570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1191/2372] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:43:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:03.740511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8bf3e-3bca-4ae5-b653-d946fa5968bb admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:03.743793 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c2b8bf3e-3bca-4ae5-b653-d946fa5968bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:03.942350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8bf3e-3bca-4ae5-b653-d946fa5968bb admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:03.959490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c879b06-b1fc-4fd6-ad6f-dedae5027a56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:03.960636 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c879b06-b1fc-4fd6-ad6f-dedae5027a56 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:03.961572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c879b06-b1fc-4fd6-ad6f-dedae5027a56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:03.962152 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c879b06-b1fc-4fd6-ad6f-dedae5027a56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:04.059094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:04.092736 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c879b06-b1fc-4fd6-ad6f-dedae5027a56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:04.101943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c879b06-b1fc-4fd6-ad6f-dedae5027a56 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:04.135503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1182/2373] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:04.324450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:04.582582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d13cc-e290-48c0-b072-0bcbea09506e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:04.583346 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d13cc-e290-48c0-b072-0bcbea09506e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:04.583779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d13cc-e290-48c0-b072-0bcbea09506e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:04.635440 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ae2d13cc-e290-48c0-b072-0bcbea09506e None None] MFA Rules not processed for user `217b7f5e31d849b389b1d2fbcda68332`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:04.637328 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ae2d13cc-e290-48c0-b072-0bcbea09506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:04.773725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1192/2374] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:43:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:04.877908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:08.061367 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c879b06-b1fc-4fd6-ad6f-dedae5027a56 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:08.073747 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c879b06-b1fc-4fd6-ad6f-dedae5027a56 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:08.080307 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab104227-501a-400e-a553-a6a5f0d5e6de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:08.081228 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab104227-501a-400e-a553-a6a5f0d5e6de service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.081714 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab104227-501a-400e-a553-a6a5f0d5e6de service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.082183 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab104227-501a-400e-a553-a6a5f0d5e6de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.311016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab104227-501a-400e-a553-a6a5f0d5e6de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:08.313813 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab104227-501a-400e-a553-a6a5f0d5e6de service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:08.357540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1183/2375] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:12.241034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d13cc-e290-48c0-b072-0bcbea09506e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:12.242870 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ae2d13cc-e290-48c0-b072-0bcbea09506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:12.269132 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d13cc-e290-48c0-b072-0bcbea09506e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:12.279106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d26db-f569-40e9-8e91-2fd7f8a1e900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:12.279802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d26db-f569-40e9-8e91-2fd7f8a1e900 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:12.280083 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d26db-f569-40e9-8e91-2fd7f8a1e900 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:12.286269 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d26db-f569-40e9-8e91-2fd7f8a1e900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:12.320287 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d26db-f569-40e9-8e91-2fd7f8a1e900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:12.321785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d26db-f569-40e9-8e91-2fd7f8a1e900 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:12.377203 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1193/2376] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:16.990199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2fcdc-8381-4330-a41f-99ac903653ca None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:16.990900 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2fcdc-8381-4330-a41f-99ac903653ca None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:16.991392 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2fcdc-8381-4330-a41f-99ac903653ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:17.108109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-11a2fcdc-8381-4330-a41f-99ac903653ca None None] MFA Rules not processed for user `61aa854524cc4b05b6baaf67e69708ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:17.112261 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-11a2fcdc-8381-4330-a41f-99ac903653ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:17.181782 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:17.445515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1184/2377] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:43:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:17.446060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d26db-f569-40e9-8e91-2fd7f8a1e900 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:17.448403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9b3d26db-f569-40e9-8e91-2fd7f8a1e900 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:17.621562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:17.693913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d26db-f569-40e9-8e91-2fd7f8a1e900 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:17.701415 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ebc69-cb4c-4901-8b12-7f72a9289f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:17.702390 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ebc69-cb4c-4901-8b12-7f72a9289f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:17.702688 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ebc69-cb4c-4901-8b12-7f72a9289f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:17.702981 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ebc69-cb4c-4901-8b12-7f72a9289f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:17.703743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ebc69-cb4c-4901-8b12-7f72a9289f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:17.706253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ebc69-cb4c-4901-8b12-7f72a9289f78 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:17.934387 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1194/2378] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:17 2022] POST /identity/v3/projects => generated 383 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:17.936295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2fcdc-8381-4330-a41f-99ac903653ca None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:17.985042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2fcdc-8381-4330-a41f-99ac903653ca None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:18.128255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178dbd3-93fc-4848-b717-f4b4658456ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:18.130709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178dbd3-93fc-4848-b717-f4b4658456ee admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:18.130709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178dbd3-93fc-4848-b717-f4b4658456ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:18.130709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178dbd3-93fc-4848-b717-f4b4658456ee admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:18.132151 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178dbd3-93fc-4848-b717-f4b4658456ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:18.138381 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178dbd3-93fc-4848-b717-f4b4658456ee admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:18.244530 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1185/2379] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:17 2022] POST /identity/v3/users => generated 298 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:18.249401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ebc69-cb4c-4901-8b12-7f72a9289f78 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:18.261472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ebc69-cb4c-4901-8b12-7f72a9289f78 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:18.269612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70a11e-9fb0-4102-80dc-774ce6928844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:18.274261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70a11e-9fb0-4102-80dc-774ce6928844 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:18.274261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70a11e-9fb0-4102-80dc-774ce6928844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:18.274261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70a11e-9fb0-4102-80dc-774ce6928844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:18.274261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70a11e-9fb0-4102-80dc-774ce6928844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:18.274261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70a11e-9fb0-4102-80dc-774ce6928844 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:18.292686 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1195/2380] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:18.297972 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178dbd3-93fc-4848-b717-f4b4658456ee admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:18.311369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178dbd3-93fc-4848-b717-f4b4658456ee admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:18.331709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333155ed-a4b5-46a1-bb82-36ba80107372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:18.333176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333155ed-a4b5-46a1-bb82-36ba80107372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:18.333616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333155ed-a4b5-46a1-bb82-36ba80107372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:18.333903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333155ed-a4b5-46a1-bb82-36ba80107372 admin admin] PATH_INFO: `/v3/projects/d1bd9d2237184c33a262721c37f70136/users/0c5f398f641348de8554e52b3d367476/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:18.367326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333155ed-a4b5-46a1-bb82-36ba80107372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1bd9d2237184c33a262721c37f70136, user_id=0c5f398f641348de8554e52b3d367476, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:18.372860 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333155ed-a4b5-46a1-bb82-36ba80107372 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:18.476898 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1186/2381] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:18 2022] PUT /identity/v3/projects/d1bd9d2237184c33a262721c37f70136/users/0c5f398f641348de8554e52b3d367476/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:18.484125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70a11e-9fb0-4102-80dc-774ce6928844 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:18.529863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70a11e-9fb0-4102-80dc-774ce6928844 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:18.741949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd080df-56ca-42df-a8d9-c57f478abdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:18.742236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd080df-56ca-42df-a8d9-c57f478abdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:18.742670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd080df-56ca-42df-a8d9-c57f478abdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:18.772011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd080df-56ca-42df-a8d9-c57f478abdf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:18.773681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd080df-56ca-42df-a8d9-c57f478abdf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:18.782132 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd080df-56ca-42df-a8d9-c57f478abdf1 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:18.830982 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1196/2382] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:18.836737 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333155ed-a4b5-46a1-bb82-36ba80107372 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:18.886158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333155ed-a4b5-46a1-bb82-36ba80107372 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:18.915085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd4744-d2ff-4231-a616-33ba00bb8379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:18.915085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd4744-d2ff-4231-a616-33ba00bb8379 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:18.915085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd4744-d2ff-4231-a616-33ba00bb8379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:18.915085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd4744-d2ff-4231-a616-33ba00bb8379 admin admin] PATH_INFO: `/v3/projects/d1bd9d2237184c33a262721c37f70136/users/0c5f398f641348de8554e52b3d367476/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:18.915662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd4744-d2ff-4231-a616-33ba00bb8379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1bd9d2237184c33a262721c37f70136, user_id=0c5f398f641348de8554e52b3d367476, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:18.917077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd4744-d2ff-4231-a616-33ba00bb8379 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:18.961911 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1187/2383] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:18 2022] PUT /identity/v3/projects/d1bd9d2237184c33a262721c37f70136/users/0c5f398f641348de8554e52b3d367476/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:18.962962 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd080df-56ca-42df-a8d9-c57f478abdf1 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:18.981523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd080df-56ca-42df-a8d9-c57f478abdf1 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:19.234380 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180135a-cb63-4a0a-b506-5c90fbaaa329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:19.236501 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180135a-cb63-4a0a-b506-5c90fbaaa329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:19.236806 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180135a-cb63-4a0a-b506-5c90fbaaa329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:19.237090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180135a-cb63-4a0a-b506-5c90fbaaa329 admin admin] PATH_INFO: `/v3/users/e5325690e28344568a2ccf732ea27916` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:19.245704 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180135a-cb63-4a0a-b506-5c90fbaaa329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5325690e28344568a2ccf732ea27916)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:19.248686 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180135a-cb63-4a0a-b506-5c90fbaaa329 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:19.607793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a180135a-cb63-4a0a-b506-5c90fbaaa329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5325690e28344568a2ccf732ea27916'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:19.619615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:19.704556 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a180135a-cb63-4a0a-b506-5c90fbaaa329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5325690e28344568a2ccf732ea27916'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:19.722893 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a180135a-cb63-4a0a-b506-5c90fbaaa329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5325690e28344568a2ccf732ea27916'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:19.724352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a180135a-cb63-4a0a-b506-5c90fbaaa329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5325690e28344568a2ccf732ea27916'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:19.744706 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a180135a-cb63-4a0a-b506-5c90fbaaa329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5325690e28344568a2ccf732ea27916'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:19.757380 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1197/2384] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:18 2022] DELETE /identity/v3/users/e5325690e28344568a2ccf732ea27916 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:19.764165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fb6fc-6220-4b51-bc15-8ef6ea8e51f5 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:19.764999 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fb6fc-6220-4b51-bc15-8ef6ea8e51f5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:19.765271 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fb6fc-6220-4b51-bc15-8ef6ea8e51f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:19.799143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-944fb6fc-6220-4b51-bc15-8ef6ea8e51f5 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:19.800929 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-944fb6fc-6220-4b51-bc15-8ef6ea8e51f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:20.045103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1188/2385] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:20.091809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180135a-cb63-4a0a-b506-5c90fbaaa329 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:20.093489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a180135a-cb63-4a0a-b506-5c90fbaaa329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:20.393762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180135a-cb63-4a0a-b506-5c90fbaaa329 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:20.412403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6b011-7f55-4bdd-b631-fb2263047046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:20.414400 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b011-7f55-4bdd-b631-fb2263047046 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:20.414861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b011-7f55-4bdd-b631-fb2263047046 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:20.415297 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b011-7f55-4bdd-b631-fb2263047046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:20.469808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6b011-7f55-4bdd-b631-fb2263047046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:20.475697 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6b011-7f55-4bdd-b631-fb2263047046 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:20.488295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1198/2386] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:21.707280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fb6fc-6220-4b51-bc15-8ef6ea8e51f5 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:21.711331 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-944fb6fc-6220-4b51-bc15-8ef6ea8e51f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:21.733851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fb6fc-6220-4b51-bc15-8ef6ea8e51f5 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:21.742466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8aff0-1157-49e4-9bc4-1798948620e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:21.744043 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8aff0-1157-49e4-9bc4-1798948620e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:21.744733 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8aff0-1157-49e4-9bc4-1798948620e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:21.745271 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8aff0-1157-49e4-9bc4-1798948620e3 admin admin] PATH_INFO: `/v3/projects/fdec79fd14314ff6943c259525d1ed92` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:21.748519 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8aff0-1157-49e4-9bc4-1798948620e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdec79fd14314ff6943c259525d1ed92)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:21.751914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8aff0-1157-49e4-9bc4-1798948620e3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:21.763446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:21.911215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-86b8aff0-1157-49e4-9bc4-1798948620e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdec79fd14314ff6943c259525d1ed92', 'request_id': 'req-86b8aff0-1157-49e4-9bc4-1798948620e3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:21.924045 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-86b8aff0-1157-49e4-9bc4-1798948620e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdec79fd14314ff6943c259525d1ed92', 'request_id': 'req-86b8aff0-1157-49e4-9bc4-1798948620e3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:21.941946 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-86b8aff0-1157-49e4-9bc4-1798948620e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdec79fd14314ff6943c259525d1ed92', 'request_id': 'req-86b8aff0-1157-49e4-9bc4-1798948620e3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:22.056417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-86b8aff0-1157-49e4-9bc4-1798948620e3 admin admin] The token cache is being invalidate because project fdec79fd14314ff6943c259525d1ed92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:22.057014 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-86b8aff0-1157-49e4-9bc4-1798948620e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:22.058062 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-86b8aff0-1157-49e4-9bc4-1798948620e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:22.061434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1189/2387] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:21 2022] DELETE /identity/v3/projects/fdec79fd14314ff6943c259525d1ed92 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:22.066651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6b011-7f55-4bdd-b631-fb2263047046 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:22.081869 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6b011-7f55-4bdd-b631-fb2263047046 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:22.179568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101627af-eeb2-4f24-bfe1-94302b965920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:22.180570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101627af-eeb2-4f24-bfe1-94302b965920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:22.180941 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101627af-eeb2-4f24-bfe1-94302b965920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:22.181646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101627af-eeb2-4f24-bfe1-94302b965920 admin admin] PATH_INFO: `/v3/users/fea46d277814429ea6f656f8bac8ac24` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:22.184119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101627af-eeb2-4f24-bfe1-94302b965920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea46d277814429ea6f656f8bac8ac24)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:22.186453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101627af-eeb2-4f24-bfe1-94302b965920 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:22.572628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-101627af-eeb2-4f24-bfe1-94302b965920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea46d277814429ea6f656f8bac8ac24'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:22.721138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-101627af-eeb2-4f24-bfe1-94302b965920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea46d277814429ea6f656f8bac8ac24'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:22.734072 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-101627af-eeb2-4f24-bfe1-94302b965920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea46d277814429ea6f656f8bac8ac24'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:22.735226 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-101627af-eeb2-4f24-bfe1-94302b965920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea46d277814429ea6f656f8bac8ac24'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:22.755741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:22.765820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-101627af-eeb2-4f24-bfe1-94302b965920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea46d277814429ea6f656f8bac8ac24'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:22.794205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1199/2388] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:22 2022] DELETE /identity/v3/users/fea46d277814429ea6f656f8bac8ac24 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:23.549706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8aff0-1157-49e4-9bc4-1798948620e3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:23.551260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-86b8aff0-1157-49e4-9bc4-1798948620e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:23.579650 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8aff0-1157-49e4-9bc4-1798948620e3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:23.720432 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:23.721458 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:23.727019 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:23.727529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a admin admin] PATH_INFO: `/v3/projects/5656d7d904ae469a8247be01a2e116aa` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:23.729607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5656d7d904ae469a8247be01a2e116aa)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:23.737827 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:24.005967 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5656d7d904ae469a8247be01a2e116aa', 'request_id': 'req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:24.026175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5656d7d904ae469a8247be01a2e116aa', 'request_id': 'req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:24.049428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5656d7d904ae469a8247be01a2e116aa', 'request_id': 'req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:24.186872 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a admin admin] The token cache is being invalidate because project 5656d7d904ae469a8247be01a2e116aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:24.188305 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:24.190628 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:24.197548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1190/2389] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:23 2022] DELETE /identity/v3/projects/5656d7d904ae469a8247be01a2e116aa => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:24.203962 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101627af-eeb2-4f24-bfe1-94302b965920 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:24.208206 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-101627af-eeb2-4f24-bfe1-94302b965920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:24.224965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101627af-eeb2-4f24-bfe1-94302b965920 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:24.334224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b75d66-333a-42cc-ae41-cf955aaefcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:24.335573 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b75d66-333a-42cc-ae41-cf955aaefcc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:24.335957 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b75d66-333a-42cc-ae41-cf955aaefcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:24.336334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b75d66-333a-42cc-ae41-cf955aaefcc0 admin admin] PATH_INFO: `/v3/users/d822dec1ceae4827a41727600674ca9d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:24.338603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b75d66-333a-42cc-ae41-cf955aaefcc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d822dec1ceae4827a41727600674ca9d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:24.341355 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b75d66-333a-42cc-ae41-cf955aaefcc0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:24.592067 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-00b75d66-333a-42cc-ae41-cf955aaefcc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd822dec1ceae4827a41727600674ca9d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:24.688656 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-00b75d66-333a-42cc-ae41-cf955aaefcc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd822dec1ceae4827a41727600674ca9d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:24.713095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-00b75d66-333a-42cc-ae41-cf955aaefcc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd822dec1ceae4827a41727600674ca9d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:24.714742 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-00b75d66-333a-42cc-ae41-cf955aaefcc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd822dec1ceae4827a41727600674ca9d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:24.762839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-00b75d66-333a-42cc-ae41-cf955aaefcc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd822dec1ceae4827a41727600674ca9d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:24.782614 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1200/2390] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:24 2022] DELETE /identity/v3/users/d822dec1ceae4827a41727600674ca9d => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:26.034132 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:26.037458 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:26.106513 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cae7fd-2cab-4295-90f2-3f4fc5ad5b5a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:26.204387 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:26.334611 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cba3e-241a-4f84-81b3-63b174503fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:26.340138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cba3e-241a-4f84-81b3-63b174503fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:26.340138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cba3e-241a-4f84-81b3-63b174503fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:26.340138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cba3e-241a-4f84-81b3-63b174503fe3 admin admin] PATH_INFO: `/v3/projects/7b100a4187e54004bb6f7afbca12c5a8` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:26.350602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cba3e-241a-4f84-81b3-63b174503fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b100a4187e54004bb6f7afbca12c5a8)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:26.355335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cba3e-241a-4f84-81b3-63b174503fe3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:26.579793 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b55cba3e-241a-4f84-81b3-63b174503fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b100a4187e54004bb6f7afbca12c5a8', 'request_id': 'req-b55cba3e-241a-4f84-81b3-63b174503fe3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:26.593446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b55cba3e-241a-4f84-81b3-63b174503fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b100a4187e54004bb6f7afbca12c5a8', 'request_id': 'req-b55cba3e-241a-4f84-81b3-63b174503fe3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:26.619011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b55cba3e-241a-4f84-81b3-63b174503fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b100a4187e54004bb6f7afbca12c5a8', 'request_id': 'req-b55cba3e-241a-4f84-81b3-63b174503fe3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:26.726888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b55cba3e-241a-4f84-81b3-63b174503fe3 admin admin] The token cache is being invalidate because project 7b100a4187e54004bb6f7afbca12c5a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:26.727668 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b55cba3e-241a-4f84-81b3-63b174503fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:26.728917 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b55cba3e-241a-4f84-81b3-63b174503fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:26.750515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1191/2391] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:26 2022] DELETE /identity/v3/projects/7b100a4187e54004bb6f7afbca12c5a8 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:29.514261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b75d66-333a-42cc-ae41-cf955aaefcc0 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:29.526316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-00b75d66-333a-42cc-ae41-cf955aaefcc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:29.725220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b75d66-333a-42cc-ae41-cf955aaefcc0 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:29.741035 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:29.758408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660d263-ace3-430c-bd94-f3f495065db2 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:29.774724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660d263-ace3-430c-bd94-f3f495065db2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:29.774724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660d263-ace3-430c-bd94-f3f495065db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:29.832338 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6660d263-ace3-430c-bd94-f3f495065db2 None None] MFA Rules not processed for user `b769fe84d79c4dda86000ddede4574e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:29.837000 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6660d263-ace3-430c-bd94-f3f495065db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:29.887936 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece2333-c536-4f4c-8049-739188746f8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fd088faaba4d5c9745638c14f1a7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:29.895266 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece2333-c536-4f4c-8049-739188746f8e service placement] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:29.895266 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece2333-c536-4f4c-8049-739188746f8e service placement] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:29.895266 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece2333-c536-4f4c-8049-739188746f8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:29.896438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8ece2333-c536-4f4c-8049-739188746f8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:29.936987 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece2333-c536-4f4c-8049-739188746f8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:29.941989 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece2333-c536-4f4c-8049-739188746f8e service placement] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:30.027549 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1201/2392] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:30.029241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece2333-c536-4f4c-8049-739188746f8e service placement] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:30.035698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8ece2333-c536-4f4c-8049-739188746f8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:30.101265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece2333-c536-4f4c-8049-739188746f8e service placement] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:30.118744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1192/2393] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:43:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:30.124710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594b04a-6780-4b6f-bd76-b56a85b43e9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fd088faaba4d5c9745638c14f1a7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:30.128875 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594b04a-6780-4b6f-bd76-b56a85b43e9a service placement] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:30.128875 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594b04a-6780-4b6f-bd76-b56a85b43e9a service placement] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:30.128875 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594b04a-6780-4b6f-bd76-b56a85b43e9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:30.141734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5f215-f670-44ea-b9f1-0db01f17f5d5 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:30.142186 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5f215-f670-44ea-b9f1-0db01f17f5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:30.142716 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5f215-f670-44ea-b9f1-0db01f17f5d5 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:30.147651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594b04a-6780-4b6f-bd76-b56a85b43e9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:30.152565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594b04a-6780-4b6f-bd76-b56a85b43e9a service placement] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:30.166129 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1193/2394] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 18 10:43:30 2022] GET /identity => generated 270 bytes in 34 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:43:30.177092 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34353229-7373-4fe3-aff4-dced4d2c6d0b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:30.178774 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34353229-7373-4fe3-aff4-dced4d2c6d0b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:30.180731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34353229-7373-4fe3-aff4-dced4d2c6d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:30.195222 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1202/2395] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:30.237302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-34353229-7373-4fe3-aff4-dced4d2c6d0b None None] MFA Rules not processed for user `f7abf6b71ac3454ca547a750cef9220a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:30.241108 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-34353229-7373-4fe3-aff4-dced4d2c6d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:30.466073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:30.542593 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1194/2396] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 18 10:43:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:30.556372 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594b04a-6780-4b6f-bd76-b56a85b43e9a service placement] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:30.562105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c594b04a-6780-4b6f-bd76-b56a85b43e9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:30.783268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594b04a-6780-4b6f-bd76-b56a85b43e9a service placement] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:30.788326 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4cd05-e92b-45a3-8480-442a9ba77612 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f93de99555742ca9bd99d707d1cdbee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:30.789012 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4cd05-e92b-45a3-8480-442a9ba77612 service glance] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:30.789298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4cd05-e92b-45a3-8480-442a9ba77612 service glance] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:30.796667 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4cd05-e92b-45a3-8480-442a9ba77612 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:30.816698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4cd05-e92b-45a3-8480-442a9ba77612 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:30.829139 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4cd05-e92b-45a3-8480-442a9ba77612 service glance] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:30.873432 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1203/2397] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:31.202518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03aeb3-bd6a-4a2c-abf7-b5e821bbab51 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:31.203425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03aeb3-bd6a-4a2c-abf7-b5e821bbab51 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:31.203425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03aeb3-bd6a-4a2c-abf7-b5e821bbab51 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:31.204907 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1195/2398] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 18 10:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:43:31.211760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f34ec9-ac32-4e5c-a437-0bcb017a5665 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:31.212959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f34ec9-ac32-4e5c-a437-0bcb017a5665 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:31.212959 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f34ec9-ac32-4e5c-a437-0bcb017a5665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:31.294523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-12f34ec9-ac32-4e5c-a437-0bcb017a5665 None None] MFA Rules not processed for user `3f9385dec85a4e0cba21c2a840124f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:31.298635 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-12f34ec9-ac32-4e5c-a437-0bcb017a5665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:31.405829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1204/2399] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 18 10:43:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:31.422746 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03aeb3-bd6a-4a2c-abf7-b5e821bbab51 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:31.424882 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5d03aeb3-bd6a-4a2c-abf7-b5e821bbab51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:31.478054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03aeb3-bd6a-4a2c-abf7-b5e821bbab51 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:31.516490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2979fd-e794-4cb0-b5c3-561b2298ae5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:31.519664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2979fd-e794-4cb0-b5c3-561b2298ae5d service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:31.525013 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2979fd-e794-4cb0-b5c3-561b2298ae5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:31.525318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2979fd-e794-4cb0-b5c3-561b2298ae5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:31.564855 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2979fd-e794-4cb0-b5c3-561b2298ae5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:31.566593 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2979fd-e794-4cb0-b5c3-561b2298ae5d service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:31.596553 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1196/2400] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:31.755600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18671d-e9ed-42bc-af1e-3cf624769459 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:31.756090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18671d-e9ed-42bc-af1e-3cf624769459 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:31.756619 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18671d-e9ed-42bc-af1e-3cf624769459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:31.815008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-cd18671d-e9ed-42bc-af1e-3cf624769459 None None] MFA Rules not processed for user `0c5f398f641348de8554e52b3d367476`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:31.817360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-cd18671d-e9ed-42bc-af1e-3cf624769459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:31.866985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c0dc6-a973-49c8-9111-11d241257744 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:31.867381 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c0dc6-a973-49c8-9111-11d241257744 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:31.867740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c0dc6-a973-49c8-9111-11d241257744 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:31.869702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1197/2401] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 18 10:43:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:43:31.884515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3dc7b-66f0-4bfb-bb38-4e76e14c7a7a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:31.884903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3dc7b-66f0-4bfb-bb38-4e76e14c7a7a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:31.885255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3dc7b-66f0-4bfb-bb38-4e76e14c7a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:31.937779 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:31.941292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e1a3dc7b-66f0-4bfb-bb38-4e76e14c7a7a None None] MFA Rules not processed for user `f7abf6b71ac3454ca547a750cef9220a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:31.942881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e1a3dc7b-66f0-4bfb-bb38-4e76e14c7a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:31.988738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1198/2402] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 18 10:43:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:31.996412 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3dc7b-66f0-4bfb-bb38-4e76e14c7a7a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:31.997811 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e1a3dc7b-66f0-4bfb-bb38-4e76e14c7a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:32.060718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3dc7b-66f0-4bfb-bb38-4e76e14c7a7a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:32.082428 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1205/2403] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:43:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:32.082588 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe89120-9e11-4d7b-9daf-74f659070ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:32.083133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe89120-9e11-4d7b-9daf-74f659070ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:32.083640 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe89120-9e11-4d7b-9daf-74f659070ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:32.084437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe89120-9e11-4d7b-9daf-74f659070ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:32.104688 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18671d-e9ed-42bc-af1e-3cf624769459 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:32.116161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe89120-9e11-4d7b-9daf-74f659070ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:32.118346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe89120-9e11-4d7b-9daf-74f659070ec7 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:32.124327 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18671d-e9ed-42bc-af1e-3cf624769459 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:32.136843 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fabca-54ec-47d3-9ee7-373aa8388d73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f93de99555742ca9bd99d707d1cdbee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:32.138098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fabca-54ec-47d3-9ee7-373aa8388d73 service glance] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:32.138877 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fabca-54ec-47d3-9ee7-373aa8388d73 service glance] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:32.139521 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fabca-54ec-47d3-9ee7-373aa8388d73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:32.141943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-da5fabca-54ec-47d3-9ee7-373aa8388d73 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:32.145386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1199/2404] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:32.269382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fabca-54ec-47d3-9ee7-373aa8388d73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:32.274457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fabca-54ec-47d3-9ee7-373aa8388d73 service glance] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:32.296580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1206/2405] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:32.780330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa3cd0-1d6a-4606-a3b7-a775f1850379 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:32.780884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa3cd0-1d6a-4606-a3b7-a775f1850379 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:32.781006 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa3cd0-1d6a-4606-a3b7-a775f1850379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:32.811646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-fdaa3cd0-1d6a-4606-a3b7-a775f1850379 None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:32.815352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-fdaa3cd0-1d6a-4606-a3b7-a775f1850379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:33.024169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1200/2406] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 18 10:43:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:33.047866 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fabca-54ec-47d3-9ee7-373aa8388d73 service glance] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:33.050837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-da5fabca-54ec-47d3-9ee7-373aa8388d73 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:33.247185 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fabca-54ec-47d3-9ee7-373aa8388d73 service glance] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:33.259708 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8a381-1cc3-4d4d-a807-e34783bbb3f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:33.262105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8a381-1cc3-4d4d-a807-e34783bbb3f7 service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:33.262736 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8a381-1cc3-4d4d-a807-e34783bbb3f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:33.263441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8a381-1cc3-4d4d-a807-e34783bbb3f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:33.285387 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8a381-1cc3-4d4d-a807-e34783bbb3f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:33.289501 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8a381-1cc3-4d4d-a807-e34783bbb3f7 service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:33.328927 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1207/2407] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:43:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:43:40.847049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f06c9f-0e9f-4b90-9c86-b171ea4a78d5 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:40.848246 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f06c9f-0e9f-4b90-9c86-b171ea4a78d5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:40.848246 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f06c9f-0e9f-4b90-9c86-b171ea4a78d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:40.950479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-22f06c9f-0e9f-4b90-9c86-b171ea4a78d5 None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:40.954779 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-22f06c9f-0e9f-4b90-9c86-b171ea4a78d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:40.999726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1201/2408] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 18 10:43:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:41.072215 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8a381-1cc3-4d4d-a807-e34783bbb3f7 service swift] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:41.084980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8a381-1cc3-4d4d-a807-e34783bbb3f7 service swift] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:41.101135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d4362-663f-4648-ba94-ba77c9c3c448 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:41.102243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d4362-663f-4648-ba94-ba77c9c3c448 service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:41.106485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d4362-663f-4648-ba94-ba77c9c3c448 service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:41.107117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d4362-663f-4648-ba94-ba77c9c3c448 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:41.153689 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d4362-663f-4648-ba94-ba77c9c3c448 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:41.159548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d4362-663f-4648-ba94-ba77c9c3c448 service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:41.195518 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1208/2409] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:43:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:43:50.912679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=49 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:51.204916 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=81 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:52.792758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182057-62d3-4e40-9c22-7c23494b4a8f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:52.793550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182057-62d3-4e40-9c22-7c23494b4a8f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:52.793703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182057-62d3-4e40-9c22-7c23494b4a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:52.873520 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ad182057-62d3-4e40-9c22-7c23494b4a8f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:52.874949 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ad182057-62d3-4e40-9c22-7c23494b4a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:53.052243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1202/2410] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Jul 18 10:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:53.411710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d4362-663f-4648-ba94-ba77c9c3c448 service swift] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:53.414306 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fd9d4362-663f-4648-ba94-ba77c9c3c448 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:53.468516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d4362-663f-4648-ba94-ba77c9c3c448 service swift] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:53.486265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66862f54-5bb1-46bc-8e98-cdaf9c2472c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:53.487930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66862f54-5bb1-46bc-8e98-cdaf9c2472c4 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:53.488647 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66862f54-5bb1-46bc-8e98-cdaf9c2472c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:53.490125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66862f54-5bb1-46bc-8e98-cdaf9c2472c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:53.514074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66862f54-5bb1-46bc-8e98-cdaf9c2472c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:53.518840 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66862f54-5bb1-46bc-8e98-cdaf9c2472c4 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:53.558294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1209/2411] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:56.001481 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a372f5-6f18-451f-b3cf-55910c4aee8e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:56.012446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a372f5-6f18-451f-b3cf-55910c4aee8e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:56.013012 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a372f5-6f18-451f-b3cf-55910c4aee8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:56.038303 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-87a372f5-6f18-451f-b3cf-55910c4aee8e None None] MFA Rules not processed for user `61aa854524cc4b05b6baaf67e69708ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:56.040134 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-87a372f5-6f18-451f-b3cf-55910c4aee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:56.049712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1203/2412] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:43:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:58.809037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66862f54-5bb1-46bc-8e98-cdaf9c2472c4 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:58.852581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66862f54-5bb1-46bc-8e98-cdaf9c2472c4 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:58.885924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8180bb2-be30-4b9f-a89b-41eb3d20049e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:58.887213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8180bb2-be30-4b9f-a89b-41eb3d20049e service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:58.893642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8180bb2-be30-4b9f-a89b-41eb3d20049e service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:58.893642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8180bb2-be30-4b9f-a89b-41eb3d20049e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:58.896914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f8180bb2-be30-4b9f-a89b-41eb3d20049e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:59.047231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8180bb2-be30-4b9f-a89b-41eb3d20049e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:59.049070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8180bb2-be30-4b9f-a89b-41eb3d20049e service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:59.069170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1210/2413] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:03.802462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dceb3-d3c9-48a0-8b31-03b40e4c5efc None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:03.803410 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dceb3-d3c9-48a0-8b31-03b40e4c5efc None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:03.803410 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dceb3-d3c9-48a0-8b31-03b40e4c5efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:03.835913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-531dceb3-d3c9-48a0-8b31-03b40e4c5efc None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:03.838802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-531dceb3-d3c9-48a0-8b31-03b40e4c5efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:03.857496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1204/2414] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Jul 18 10:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:44:03.887481 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8180bb2-be30-4b9f-a89b-41eb3d20049e service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:03.889372 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f8180bb2-be30-4b9f-a89b-41eb3d20049e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:03.920996 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8180bb2-be30-4b9f-a89b-41eb3d20049e service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:03.938110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400e706-e38e-42c2-9c52-c254c57ad077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:03.941278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400e706-e38e-42c2-9c52-c254c57ad077 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:03.941823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400e706-e38e-42c2-9c52-c254c57ad077 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:03.942114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400e706-e38e-42c2-9c52-c254c57ad077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:03.960515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400e706-e38e-42c2-9c52-c254c57ad077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:03.965071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400e706-e38e-42c2-9c52-c254c57ad077 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:03.985557 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1211/2415] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:10.279259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff6f77-5c44-4156-ae4b-fd023685ccc2 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:10.280248 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff6f77-5c44-4156-ae4b-fd023685ccc2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:10.280678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff6f77-5c44-4156-ae4b-fd023685ccc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:10.303210 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-32ff6f77-5c44-4156-ae4b-fd023685ccc2 None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:10.304618 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-32ff6f77-5c44-4156-ae4b-fd023685ccc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:10.312641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1205/2416] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 18 10:44:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:10.326088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400e706-e38e-42c2-9c52-c254c57ad077 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:10.339306 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400e706-e38e-42c2-9c52-c254c57ad077 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:10.344773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf49820-9366-439f-bdcc-0dc2d7540805 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:10.345282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf49820-9366-439f-bdcc-0dc2d7540805 service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:10.345565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf49820-9366-439f-bdcc-0dc2d7540805 service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:10.345839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf49820-9366-439f-bdcc-0dc2d7540805 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:10.355623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf49820-9366-439f-bdcc-0dc2d7540805 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:10.357229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf49820-9366-439f-bdcc-0dc2d7540805 service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:10.367200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1212/2417] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:44:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:44:12.976175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf9710-bfda-4e6d-bea7-385153e4671e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:12.976910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf9710-bfda-4e6d-bea7-385153e4671e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:12.976910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf9710-bfda-4e6d-bea7-385153e4671e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:12.997713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ddaf9710-bfda-4e6d-bea7-385153e4671e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:12.998795 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ddaf9710-bfda-4e6d-bea7-385153e4671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:13.007201 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1206/2418] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Jul 18 10:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:13.024233 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf49820-9366-439f-bdcc-0dc2d7540805 service swift] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:13.045869 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf49820-9366-439f-bdcc-0dc2d7540805 service swift] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:13.054437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0590b26-5db2-4d97-82cc-7a6e4ee4d1b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:13.055228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0590b26-5db2-4d97-82cc-7a6e4ee4d1b2 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:13.055592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0590b26-5db2-4d97-82cc-7a6e4ee4d1b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:13.056084 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0590b26-5db2-4d97-82cc-7a6e4ee4d1b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:13.067548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0590b26-5db2-4d97-82cc-7a6e4ee4d1b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:13.069676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0590b26-5db2-4d97-82cc-7a6e4ee4d1b2 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:13.094123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1213/2419] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:22.990982 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=39 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:23.077442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=54 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:24.935544 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38be6f-b6d8-4540-bfd2-60a8b4b3a95a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:24.937446 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38be6f-b6d8-4540-bfd2-60a8b4b3a95a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:24.938268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38be6f-b6d8-4540-bfd2-60a8b4b3a95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:24.975776 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0e38be6f-b6d8-4540-bfd2-60a8b4b3a95a None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:24.978921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0e38be6f-b6d8-4540-bfd2-60a8b4b3a95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:24.987085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1207/2420] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jul 18 10:44:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:25.018172 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0590b26-5db2-4d97-82cc-7a6e4ee4d1b2 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:25.031563 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0590b26-5db2-4d97-82cc-7a6e4ee4d1b2 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:25.038838 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8875588-2ce7-4a75-83c5-1c8b033a60b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:25.039522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8875588-2ce7-4a75-83c5-1c8b033a60b4 service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:25.040432 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8875588-2ce7-4a75-83c5-1c8b033a60b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:25.040723 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8875588-2ce7-4a75-83c5-1c8b033a60b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:25.050674 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8875588-2ce7-4a75-83c5-1c8b033a60b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:25.052352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8875588-2ce7-4a75-83c5-1c8b033a60b4 service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:25.063850 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1214/2421] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:44:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:44:29.237242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65b663-28df-4924-aeb8-23203b1eda60 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:29.237785 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65b663-28df-4924-aeb8-23203b1eda60 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:29.237902 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65b663-28df-4924-aeb8-23203b1eda60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:29.257670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-dd65b663-28df-4924-aeb8-23203b1eda60 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:29.259754 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-dd65b663-28df-4924-aeb8-23203b1eda60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:29.268113 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1208/2422] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Jul 18 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:29.314723 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8875588-2ce7-4a75-83c5-1c8b033a60b4 service swift] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:29.328399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8875588-2ce7-4a75-83c5-1c8b033a60b4 service swift] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:29.335619 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae7695-4c9b-4052-a57d-7bb14ece04c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:29.337288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae7695-4c9b-4052-a57d-7bb14ece04c1 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:29.337769 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae7695-4c9b-4052-a57d-7bb14ece04c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:29.338289 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae7695-4c9b-4052-a57d-7bb14ece04c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:29.348244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae7695-4c9b-4052-a57d-7bb14ece04c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:29.349867 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae7695-4c9b-4052-a57d-7bb14ece04c1 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:29.361627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1215/2423] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:33.770416 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a12961-2086-4b32-bcf4-ee4f9e6d40c7 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:33.777247 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a12961-2086-4b32-bcf4-ee4f9e6d40c7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:33.777247 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a12961-2086-4b32-bcf4-ee4f9e6d40c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:33.796590 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-04a12961-2086-4b32-bcf4-ee4f9e6d40c7 None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:33.797833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-04a12961-2086-4b32-bcf4-ee4f9e6d40c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:33.805901 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1209/2424] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 18 10:44:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:33.826675 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae7695-4c9b-4052-a57d-7bb14ece04c1 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:33.840431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae7695-4c9b-4052-a57d-7bb14ece04c1 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:33.845794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c4d8f-dbd0-4a7c-86e5-3be6ff518a21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:33.848543 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c4d8f-dbd0-4a7c-86e5-3be6ff518a21 service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:33.848543 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c4d8f-dbd0-4a7c-86e5-3be6ff518a21 service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:33.848543 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c4d8f-dbd0-4a7c-86e5-3be6ff518a21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:33.857835 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c4d8f-dbd0-4a7c-86e5-3be6ff518a21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:33.859512 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c4d8f-dbd0-4a7c-86e5-3be6ff518a21 service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:33.869747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1216/2425] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:44:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:44:34.604921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4781a-7b4f-4808-82e8-b3cfb97cdab6 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:34.605255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4781a-7b4f-4808-82e8-b3cfb97cdab6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:34.605569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4781a-7b4f-4808-82e8-b3cfb97cdab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:34.632212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f3b4781a-7b4f-4808-82e8-b3cfb97cdab6 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:34.636996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f3b4781a-7b4f-4808-82e8-b3cfb97cdab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:34.646491 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1210/2426] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Jul 18 10:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:34.671930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c4d8f-dbd0-4a7c-86e5-3be6ff518a21 service swift] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:34.698046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c4d8f-dbd0-4a7c-86e5-3be6ff518a21 service swift] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:34.716005 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a6c38-e08e-4a29-807a-203ad1641d3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:34.717246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a6c38-e08e-4a29-807a-203ad1641d3c service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:34.717853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a6c38-e08e-4a29-807a-203ad1641d3c service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:34.718722 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a6c38-e08e-4a29-807a-203ad1641d3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:34.731835 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a6c38-e08e-4a29-807a-203ad1641d3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:34.735737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a6c38-e08e-4a29-807a-203ad1641d3c service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:34.759484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1217/2427] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:39.947309 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83fa14-817d-4aec-8c5b-e6a55898402f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:39.948122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83fa14-817d-4aec-8c5b-e6a55898402f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:39.948725 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83fa14-817d-4aec-8c5b-e6a55898402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:39.984833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-cc83fa14-817d-4aec-8c5b-e6a55898402f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:39.987448 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cc83fa14-817d-4aec-8c5b-e6a55898402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:40.005609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1211/2428] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Jul 18 10:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:40.030419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a6c38-e08e-4a29-807a-203ad1641d3c service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:40.050540 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a6c38-e08e-4a29-807a-203ad1641d3c service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:40.058367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cfb84-b1e0-4595-ac06-8203ee812e0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:40.059292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cfb84-b1e0-4595-ac06-8203ee812e0a service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:40.059752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cfb84-b1e0-4595-ac06-8203ee812e0a service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:40.060266 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cfb84-b1e0-4595-ac06-8203ee812e0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:40.070395 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cfb84-b1e0-4595-ac06-8203ee812e0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:40.072295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cfb84-b1e0-4595-ac06-8203ee812e0a service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:40.085259 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1218/2429] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:46.598885 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83fa14-817d-4aec-8c5b-e6a55898402f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:46.611055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83fa14-817d-4aec-8c5b-e6a55898402f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:46.615121 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300cfd0-a930-4ee8-9785-50032376e8e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:46.615884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300cfd0-a930-4ee8-9785-50032376e8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:46.616187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300cfd0-a930-4ee8-9785-50032376e8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:46.616733 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300cfd0-a930-4ee8-9785-50032376e8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:46.627566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300cfd0-a930-4ee8-9785-50032376e8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:46.629176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300cfd0-a930-4ee8-9785-50032376e8e9 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:46.640022 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1212/2430] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:50.078749 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=30 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:56.634880 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=21 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:57.501265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02079397-34a0-4fe1-b5b3-a2874cc25c69 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:57.505134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02079397-34a0-4fe1-b5b3-a2874cc25c69 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:57.505134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02079397-34a0-4fe1-b5b3-a2874cc25c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:57.524897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-02079397-34a0-4fe1-b5b3-a2874cc25c69 None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:57.528319 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-02079397-34a0-4fe1-b5b3-a2874cc25c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:57.542090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1219/2431] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jul 18 10:44:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:57.554443 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300cfd0-a930-4ee8-9785-50032376e8e9 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:57.566583 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300cfd0-a930-4ee8-9785-50032376e8e9 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:57.572111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4099359-c5c8-4cd6-9f6e-7fa2447fcade service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:57.572988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4099359-c5c8-4cd6-9f6e-7fa2447fcade service swift] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:57.573376 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4099359-c5c8-4cd6-9f6e-7fa2447fcade service swift] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:57.573902 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4099359-c5c8-4cd6-9f6e-7fa2447fcade service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:57.583444 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4099359-c5c8-4cd6-9f6e-7fa2447fcade service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:57.585919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4099359-c5c8-4cd6-9f6e-7fa2447fcade service swift] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:57.597173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1213/2432] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:44:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:45:00.858625 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02079397-34a0-4fe1-b5b3-a2874cc25c69 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:00.860146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-02079397-34a0-4fe1-b5b3-a2874cc25c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:00.876272 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02079397-34a0-4fe1-b5b3-a2874cc25c69 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:00.880837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d5b29-ee06-4b78-9548-ade7e1d55118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:00.881725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d5b29-ee06-4b78-9548-ade7e1d55118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:00.882581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d5b29-ee06-4b78-9548-ade7e1d55118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:00.882866 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d5b29-ee06-4b78-9548-ade7e1d55118 admin admin] PATH_INFO: `/v3/users/b769fe84d79c4dda86000ddede4574e8` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:00.884206 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d5b29-ee06-4b78-9548-ade7e1d55118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b769fe84d79c4dda86000ddede4574e8)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:00.886151 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d5b29-ee06-4b78-9548-ade7e1d55118 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:01.158653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1e7d5b29-ee06-4b78-9548-ade7e1d55118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b769fe84d79c4dda86000ddede4574e8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.249309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1e7d5b29-ee06-4b78-9548-ade7e1d55118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b769fe84d79c4dda86000ddede4574e8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.258815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1e7d5b29-ee06-4b78-9548-ade7e1d55118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b769fe84d79c4dda86000ddede4574e8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.259934 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1e7d5b29-ee06-4b78-9548-ade7e1d55118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b769fe84d79c4dda86000ddede4574e8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.272713 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1e7d5b29-ee06-4b78-9548-ade7e1d55118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b769fe84d79c4dda86000ddede4574e8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.280214 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1220/2433] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:45:00 2022] DELETE /identity/v3/users/b769fe84d79c4dda86000ddede4574e8 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:01.550838 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4099359-c5c8-4cd6-9f6e-7fa2447fcade service swift] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:01.563779 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4099359-c5c8-4cd6-9f6e-7fa2447fcade service swift] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:01.626817 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17bed6-de23-441f-830a-776415800043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:01.627685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17bed6-de23-441f-830a-776415800043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:01.627966 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17bed6-de23-441f-830a-776415800043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:01.628238 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17bed6-de23-441f-830a-776415800043 admin admin] PATH_INFO: `/v3/projects/03c2687260bf48f2a860854b45c7202f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:01.629433 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17bed6-de23-441f-830a-776415800043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c2687260bf48f2a860854b45c7202f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:01.631434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17bed6-de23-441f-830a-776415800043 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:01.762676 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4f17bed6-de23-441f-830a-776415800043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c2687260bf48f2a860854b45c7202f', 'request_id': 'req-4f17bed6-de23-441f-830a-776415800043'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.768905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4f17bed6-de23-441f-830a-776415800043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c2687260bf48f2a860854b45c7202f', 'request_id': 'req-4f17bed6-de23-441f-830a-776415800043'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.785130 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4f17bed6-de23-441f-830a-776415800043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c2687260bf48f2a860854b45c7202f', 'request_id': 'req-4f17bed6-de23-441f-830a-776415800043'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.887614 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4f17bed6-de23-441f-830a-776415800043 admin admin] The token cache is being invalidate because project 03c2687260bf48f2a860854b45c7202f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:45:01.887905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4f17bed6-de23-441f-830a-776415800043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.888618 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4f17bed6-de23-441f-830a-776415800043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.890435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1214/2434] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:45:01 2022] DELETE /identity/v3/projects/03c2687260bf48f2a860854b45c7202f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:01.896828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0406-c792-4e73-9034-41ab0db8d820 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:01.897404 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0406-c792-4e73-9034-41ab0db8d820 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:01.897534 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0406-c792-4e73-9034-41ab0db8d820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:01.918526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2b5b0406-c792-4e73-9034-41ab0db8d820 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:01.922192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2b5b0406-c792-4e73-9034-41ab0db8d820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:01.990050 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1221/2435] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:01.999319 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c1e7f-c922-46ae-95fe-66750f355fa9 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:01.999590 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c1e7f-c922-46ae-95fe-66750f355fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:01.999870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c1e7f-c922-46ae-95fe-66750f355fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.021427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1e6c1e7f-c922-46ae-95fe-66750f355fa9 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:02.022998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1e6c1e7f-c922-46ae-95fe-66750f355fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:02.031684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1215/2436] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:02.036123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b0406-c792-4e73-9034-41ab0db8d820 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:02.046696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b0406-c792-4e73-9034-41ab0db8d820 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:02.051531 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57388b5b-d653-4b62-9d5e-e3677aee991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:02.052192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57388b5b-d653-4b62-9d5e-e3677aee991e admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.052480 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57388b5b-d653-4b62-9d5e-e3677aee991e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.052770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57388b5b-d653-4b62-9d5e-e3677aee991e admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.054090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57388b5b-d653-4b62-9d5e-e3677aee991e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:45:02.054524 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57388b5b-d653-4b62-9d5e-e3677aee991e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:02.056198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57388b5b-d653-4b62-9d5e-e3677aee991e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:02.070806 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1222/2437] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:45:02.077914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c1e7f-c922-46ae-95fe-66750f355fa9 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:02.088081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c1e7f-c922-46ae-95fe-66750f355fa9 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:02.093117 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db01ab-fac8-48f6-a238-c100ecbc312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:02.093794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db01ab-fac8-48f6-a238-c100ecbc312b admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.094146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db01ab-fac8-48f6-a238-c100ecbc312b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.094524 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db01ab-fac8-48f6-a238-c100ecbc312b admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.095233 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db01ab-fac8-48f6-a238-c100ecbc312b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:02.097945 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db01ab-fac8-48f6-a238-c100ecbc312b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:02.221157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1216/2438] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:45:02 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:45:02.222534 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57388b5b-d653-4b62-9d5e-e3677aee991e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:02.233572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57388b5b-d653-4b62-9d5e-e3677aee991e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:02.289454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:02.299495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9dd1c-2b89-4acf-a120-9d71ad66aa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:02.304441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9dd1c-2b89-4acf-a120-9d71ad66aa8e admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.304441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9dd1c-2b89-4acf-a120-9d71ad66aa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.304441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9dd1c-2b89-4acf-a120-9d71ad66aa8e admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.304441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9dd1c-2b89-4acf-a120-9d71ad66aa8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:02.304441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9dd1c-2b89-4acf-a120-9d71ad66aa8e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:02.426196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1223/2439] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:45:02 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:45:02.430996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db01ab-fac8-48f6-a238-c100ecbc312b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:02.443109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db01ab-fac8-48f6-a238-c100ecbc312b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:02.448958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70fb5f-6571-499b-9612-a6eb67f93062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:02.449625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70fb5f-6571-499b-9612-a6eb67f93062 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.449905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70fb5f-6571-499b-9612-a6eb67f93062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.450186 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70fb5f-6571-499b-9612-a6eb67f93062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.450948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70fb5f-6571-499b-9612-a6eb67f93062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:02.452563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70fb5f-6571-499b-9612-a6eb67f93062 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:02.466161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1217/2440] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:45:02.470285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9dd1c-2b89-4acf-a120-9d71ad66aa8e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:02.482526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9dd1c-2b89-4acf-a120-9d71ad66aa8e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:02.487664 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be669b0-6710-4e38-bb3f-ba23950687a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:02.488313 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be669b0-6710-4e38-bb3f-ba23950687a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.488593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be669b0-6710-4e38-bb3f-ba23950687a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.489126 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be669b0-6710-4e38-bb3f-ba23950687a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.489858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be669b0-6710-4e38-bb3f-ba23950687a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:02.491965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be669b0-6710-4e38-bb3f-ba23950687a6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:02.510793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1224/2441] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:45:02.513770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70fb5f-6571-499b-9612-a6eb67f93062 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:02.525131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70fb5f-6571-499b-9612-a6eb67f93062 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:02.530204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee86543-2c86-4053-bde8-95c21a6f4c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:02.531402 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee86543-2c86-4053-bde8-95c21a6f4c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.531808 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee86543-2c86-4053-bde8-95c21a6f4c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.532270 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee86543-2c86-4053-bde8-95c21a6f4c74 admin admin] PATH_INFO: `/v3/projects/4a3b2dc9d31e41a590aa717c88490d62/users/15343e5e69574f97a240989144898f86/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.549664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee86543-2c86-4053-bde8-95c21a6f4c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a3b2dc9d31e41a590aa717c88490d62, user_id=15343e5e69574f97a240989144898f86, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:02.552395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee86543-2c86-4053-bde8-95c21a6f4c74 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:02.629887 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1218/2442] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:45:02 2022] PUT /identity/v3/projects/4a3b2dc9d31e41a590aa717c88490d62/users/15343e5e69574f97a240989144898f86/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:02.698570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a07aa4-9958-495f-b154-daca0421296b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.698899 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a07aa4-9958-495f-b154-daca0421296b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.699134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a07aa4-9958-495f-b154-daca0421296b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.727103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a1a07aa4-9958-495f-b154-daca0421296b None None] MFA Rules not processed for user `15343e5e69574f97a240989144898f86`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:02.728296 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a1a07aa4-9958-495f-b154-daca0421296b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:02.799502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1225/2443] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:02.811611 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee86543-2c86-4053-bde8-95c21a6f4c74 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:02.813527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-dee86543-2c86-4053-bde8-95c21a6f4c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:02.832517 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:02.881012 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee86543-2c86-4053-bde8-95c21a6f4c74 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:02.888174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191fc58-a6ed-4442-81a8-635e13c138e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:02.891175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191fc58-a6ed-4442-81a8-635e13c138e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.891457 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191fc58-a6ed-4442-81a8-635e13c138e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.891742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191fc58-a6ed-4442-81a8-635e13c138e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.901861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191fc58-a6ed-4442-81a8-635e13c138e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:02.903394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191fc58-a6ed-4442-81a8-635e13c138e2 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:02.912786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1219/2444] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:03.933871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4312c4-f315-4fd3-8885-9915d033a7ab None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:03.934486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4312c4-f315-4fd3-8885-9915d033a7ab None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:03.934606 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4312c4-f315-4fd3-8885-9915d033a7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:03.953238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7d4312c4-f315-4fd3-8885-9915d033a7ab None None] MFA Rules not processed for user `c91494330c2843c3bea4baa263eb302a`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:03.954917 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7d4312c4-f315-4fd3-8885-9915d033a7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:04.014406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1226/2445] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:45:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:13.000975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=20 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:14.006937 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:15.671941 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655c964-3784-4f3b-8e2c-dd6225785621 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:15.672612 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655c964-3784-4f3b-8e2c-dd6225785621 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:15.672857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655c964-3784-4f3b-8e2c-dd6225785621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:15.692672 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9655c964-3784-4f3b-8e2c-dd6225785621 None None] MFA Rules not processed for user `d4be9b38bc54460c8e8a0c08f8c6efed`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:15.694918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9655c964-3784-4f3b-8e2c-dd6225785621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:15.764250 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1220/2446] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:45:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:25.757057 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=25 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:27.722100 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddc2f1-78b4-4d5c-888c-25b55da6469f None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:27.722688 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddc2f1-78b4-4d5c-888c-25b55da6469f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:27.722688 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddc2f1-78b4-4d5c-888c-25b55da6469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:27.744290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a4ddc2f1-78b4-4d5c-888c-25b55da6469f None None] MFA Rules not processed for user `43b46c9179024f6b89c579db0d570cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:27.745565 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a4ddc2f1-78b4-4d5c-888c-25b55da6469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:27.820991 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1227/2447] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:45:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:28.220662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75b5e5-a1a2-46b2-8bb0-efc90b09ec76 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:28.221250 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75b5e5-a1a2-46b2-8bb0-efc90b09ec76 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:28.221250 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75b5e5-a1a2-46b2-8bb0-efc90b09ec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:28.241997 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-cb75b5e5-a1a2-46b2-8bb0-efc90b09ec76 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:28.243354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cb75b5e5-a1a2-46b2-8bb0-efc90b09ec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:28.320756 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1221/2448] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Jul 18 10:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:28.389563 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddc2f1-78b4-4d5c-888c-25b55da6469f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:28.389895 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a4ddc2f1-78b4-4d5c-888c-25b55da6469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:28.486957 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddc2f1-78b4-4d5c-888c-25b55da6469f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:28.493352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53be357-25a9-43ba-ab60-380e32e77256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:28.494013 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53be357-25a9-43ba-ab60-380e32e77256 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:28.494298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53be357-25a9-43ba-ab60-380e32e77256 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:28.494624 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53be357-25a9-43ba-ab60-380e32e77256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:28.504373 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53be357-25a9-43ba-ab60-380e32e77256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:28.506834 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53be357-25a9-43ba-ab60-380e32e77256 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:28.517470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1228/2449] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:31.808849 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75b5e5-a1a2-46b2-8bb0-efc90b09ec76 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:31.810415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cb75b5e5-a1a2-46b2-8bb0-efc90b09ec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:31.887710 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75b5e5-a1a2-46b2-8bb0-efc90b09ec76 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:31.892659 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f28e9-65cf-4e8f-9325-0ae9af91eb78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:31.894502 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f28e9-65cf-4e8f-9325-0ae9af91eb78 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:31.894502 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f28e9-65cf-4e8f-9325-0ae9af91eb78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:31.894502 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f28e9-65cf-4e8f-9325-0ae9af91eb78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:31.906427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-528f28e9-65cf-4e8f-9325-0ae9af91eb78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:31.926911 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f28e9-65cf-4e8f-9325-0ae9af91eb78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:31.930618 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f28e9-65cf-4e8f-9325-0ae9af91eb78 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:31.945208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1222/2450] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:33.070850 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53be357-25a9-43ba-ab60-380e32e77256 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:33.072286 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a53be357-25a9-43ba-ab60-380e32e77256 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:33.085705 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53be357-25a9-43ba-ab60-380e32e77256 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:33.089525 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71d33e-104e-41e2-b7e5-81748a20a666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:33.090191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71d33e-104e-41e2-b7e5-81748a20a666 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:33.090507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71d33e-104e-41e2-b7e5-81748a20a666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:33.090781 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71d33e-104e-41e2-b7e5-81748a20a666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:33.092805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9e71d33e-104e-41e2-b7e5-81748a20a666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:33.106981 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71d33e-104e-41e2-b7e5-81748a20a666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:33.108419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71d33e-104e-41e2-b7e5-81748a20a666 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:33.123353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1229/2451] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:33.979985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f7844-3c2a-4c79-a121-39e00ebfbfb2 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:33.980549 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f7844-3c2a-4c79-a121-39e00ebfbfb2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:33.980549 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f7844-3c2a-4c79-a121-39e00ebfbfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:34.001580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-763f7844-3c2a-4c79-a121-39e00ebfbfb2 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:34.003127 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-763f7844-3c2a-4c79-a121-39e00ebfbfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:34.012498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1223/2452] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Jul 18 10:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:34.031063 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71d33e-104e-41e2-b7e5-81748a20a666 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:34.043365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71d33e-104e-41e2-b7e5-81748a20a666 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:34.049245 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25757de9-3d95-4c3e-8db1-71049b27c3b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:34.049913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25757de9-3d95-4c3e-8db1-71049b27c3b2 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:34.050196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25757de9-3d95-4c3e-8db1-71049b27c3b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:34.050516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25757de9-3d95-4c3e-8db1-71049b27c3b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:34.060011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25757de9-3d95-4c3e-8db1-71049b27c3b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:34.061635 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25757de9-3d95-4c3e-8db1-71049b27c3b2 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:34.073761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1230/2453] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:39.863570 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab3b37-73c7-4c3b-9834-278481751aa1 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:39.864137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab3b37-73c7-4c3b-9834-278481751aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:39.864137 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab3b37-73c7-4c3b-9834-278481751aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:39.885470 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-64ab3b37-73c7-4c3b-9834-278481751aa1 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:39.886858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-64ab3b37-73c7-4c3b-9834-278481751aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:39.899811 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1224/2454] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Jul 18 10:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:39.915319 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25757de9-3d95-4c3e-8db1-71049b27c3b2 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:39.930142 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25757de9-3d95-4c3e-8db1-71049b27c3b2 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:39.940962 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37beb3-ee23-445a-89db-d563d8c127e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:39.947769 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37beb3-ee23-445a-89db-d563d8c127e4 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:39.947769 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37beb3-ee23-445a-89db-d563d8c127e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:39.947769 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37beb3-ee23-445a-89db-d563d8c127e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:39.955374 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37beb3-ee23-445a-89db-d563d8c127e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:39.957344 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37beb3-ee23-445a-89db-d563d8c127e4 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:39.968968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1231/2455] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:44.991035 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab3b37-73c7-4c3b-9834-278481751aa1 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:45.001415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab3b37-73c7-4c3b-9834-278481751aa1 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:45.005749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e57176-8e53-4a26-a5ca-0638678d39c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:45.006498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57176-8e53-4a26-a5ca-0638678d39c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:45.006791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57176-8e53-4a26-a5ca-0638678d39c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:45.007068 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57176-8e53-4a26-a5ca-0638678d39c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:45.008916 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b1e57176-8e53-4a26-a5ca-0638678d39c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:45.075459 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e57176-8e53-4a26-a5ca-0638678d39c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:45.076930 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e57176-8e53-4a26-a5ca-0638678d39c4 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:45.088905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1225/2456] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:46.245027 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37beb3-ee23-445a-89db-d563d8c127e4 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:46.255588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37beb3-ee23-445a-89db-d563d8c127e4 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:46.260258 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac961beb-d93f-4fff-aed3-91e1e25cc942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:46.261119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac961beb-d93f-4fff-aed3-91e1e25cc942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:46.261392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac961beb-d93f-4fff-aed3-91e1e25cc942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:46.261667 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac961beb-d93f-4fff-aed3-91e1e25cc942 admin admin] PATH_INFO: `/v3/users/15343e5e69574f97a240989144898f86` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:46.262903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac961beb-d93f-4fff-aed3-91e1e25cc942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15343e5e69574f97a240989144898f86)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:46.264825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac961beb-d93f-4fff-aed3-91e1e25cc942 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:46.486572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:46.488672 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac961beb-d93f-4fff-aed3-91e1e25cc942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15343e5e69574f97a240989144898f86'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:46.583003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac961beb-d93f-4fff-aed3-91e1e25cc942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15343e5e69574f97a240989144898f86'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:46.591592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac961beb-d93f-4fff-aed3-91e1e25cc942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15343e5e69574f97a240989144898f86'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:46.592436 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac961beb-d93f-4fff-aed3-91e1e25cc942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15343e5e69574f97a240989144898f86'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:46.606434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac961beb-d93f-4fff-aed3-91e1e25cc942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15343e5e69574f97a240989144898f86'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:46.613577 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1232/2457] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:45:46 2022] DELETE /identity/v3/users/15343e5e69574f97a240989144898f86 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:46.623919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a961a-ddd2-43f6-8ef7-a1ae3efe6b46 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:46.624504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a961a-ddd2-43f6-8ef7-a1ae3efe6b46 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:46.624504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a961a-ddd2-43f6-8ef7-a1ae3efe6b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:46.642548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-343a961a-ddd2-43f6-8ef7-a1ae3efe6b46 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:46.643753 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-343a961a-ddd2-43f6-8ef7-a1ae3efe6b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:46.669021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:46.706006 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1226/2458] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:46.715995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac961beb-d93f-4fff-aed3-91e1e25cc942 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:46.717415 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ac961beb-d93f-4fff-aed3-91e1e25cc942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:46.779167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac961beb-d93f-4fff-aed3-91e1e25cc942 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:46.782865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729da78-3fb8-4326-bcbb-e2dc52da079a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:46.783514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729da78-3fb8-4326-bcbb-e2dc52da079a service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:46.783791 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729da78-3fb8-4326-bcbb-e2dc52da079a service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:46.784062 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729da78-3fb8-4326-bcbb-e2dc52da079a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:46.796445 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729da78-3fb8-4326-bcbb-e2dc52da079a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:46.797873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729da78-3fb8-4326-bcbb-e2dc52da079a service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:46.809167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1233/2459] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:47.313543 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a961a-ddd2-43f6-8ef7-a1ae3efe6b46 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:47.315251 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-343a961a-ddd2-43f6-8ef7-a1ae3efe6b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:47.330739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a961a-ddd2-43f6-8ef7-a1ae3efe6b46 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:47.337162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7f8e6-3b72-4ace-b14b-c28499133f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:47.338279 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7f8e6-3b72-4ace-b14b-c28499133f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:47.338601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7f8e6-3b72-4ace-b14b-c28499133f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:47.338878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7f8e6-3b72-4ace-b14b-c28499133f1e admin admin] PATH_INFO: `/v3/projects/4a3b2dc9d31e41a590aa717c88490d62` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:47.340246 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7f8e6-3b72-4ace-b14b-c28499133f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a3b2dc9d31e41a590aa717c88490d62)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:47.342617 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7f8e6-3b72-4ace-b14b-c28499133f1e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:47.468015 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d1a7f8e6-3b72-4ace-b14b-c28499133f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a3b2dc9d31e41a590aa717c88490d62', 'request_id': 'req-d1a7f8e6-3b72-4ace-b14b-c28499133f1e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:47.474875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d1a7f8e6-3b72-4ace-b14b-c28499133f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a3b2dc9d31e41a590aa717c88490d62', 'request_id': 'req-d1a7f8e6-3b72-4ace-b14b-c28499133f1e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:47.481809 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d1a7f8e6-3b72-4ace-b14b-c28499133f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a3b2dc9d31e41a590aa717c88490d62', 'request_id': 'req-d1a7f8e6-3b72-4ace-b14b-c28499133f1e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:47.565062 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d1a7f8e6-3b72-4ace-b14b-c28499133f1e admin admin] The token cache is being invalidate because project 4a3b2dc9d31e41a590aa717c88490d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:45:47.565349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d1a7f8e6-3b72-4ace-b14b-c28499133f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:47.566076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d1a7f8e6-3b72-4ace-b14b-c28499133f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:47.568316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1227/2460] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:45:47 2022] DELETE /identity/v3/projects/4a3b2dc9d31e41a590aa717c88490d62 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:48.841357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729da78-3fb8-4326-bcbb-e2dc52da079a service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:48.843243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f729da78-3fb8-4326-bcbb-e2dc52da079a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:48.857898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729da78-3fb8-4326-bcbb-e2dc52da079a service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:48.948799 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb17893-3bdb-413d-9406-60ac6a31abdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:48.949484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb17893-3bdb-413d-9406-60ac6a31abdc service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:48.954823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb17893-3bdb-413d-9406-60ac6a31abdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:48.954823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb17893-3bdb-413d-9406-60ac6a31abdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:48.954823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1bb17893-3bdb-413d-9406-60ac6a31abdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:49.034715 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb17893-3bdb-413d-9406-60ac6a31abdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:49.037408 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb17893-3bdb-413d-9406-60ac6a31abdc service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:49.060151 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1234/2461] 10.222.0.16 () {60 vars in 1396 bytes} [Mon Jul 18 10:45:48 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:49.385529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5c5f1-57f2-4f04-ab92-d4127de35b9d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:49.386073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5c5f1-57f2-4f04-ab92-d4127de35b9d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:49.386073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5c5f1-57f2-4f04-ab92-d4127de35b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:49.406732 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f5f5c5f1-57f2-4f04-ab92-d4127de35b9d None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:49.408253 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f5f5c5f1-57f2-4f04-ab92-d4127de35b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:49.491805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1228/2462] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Jul 18 10:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:49.512808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb17893-3bdb-413d-9406-60ac6a31abdc service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:49.514501 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1bb17893-3bdb-413d-9406-60ac6a31abdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:49.563088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:49.633731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb17893-3bdb-413d-9406-60ac6a31abdc service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:49.642410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7f2bf-7e25-4f21-8dd4-fec0d45a48e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:49.643359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7f2bf-7e25-4f21-8dd4-fec0d45a48e5 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:49.643787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7f2bf-7e25-4f21-8dd4-fec0d45a48e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:49.644238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7f2bf-7e25-4f21-8dd4-fec0d45a48e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:49.655007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7f2bf-7e25-4f21-8dd4-fec0d45a48e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:49.656815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7f2bf-7e25-4f21-8dd4-fec0d45a48e5 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:49.678418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1235/2463] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:55.759972 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbee7d-9625-49fd-a0e4-a94c0a39bb54 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:55.761248 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbee7d-9625-49fd-a0e4-a94c0a39bb54 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:55.761445 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbee7d-9625-49fd-a0e4-a94c0a39bb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:55.783535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-02bbee7d-9625-49fd-a0e4-a94c0a39bb54 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:55.784795 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-02bbee7d-9625-49fd-a0e4-a94c0a39bb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:55.795431 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1229/2464] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Jul 18 10:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:55.819172 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7f2bf-7e25-4f21-8dd4-fec0d45a48e5 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:55.820725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-62e7f2bf-7e25-4f21-8dd4-fec0d45a48e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:55.842577 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7f2bf-7e25-4f21-8dd4-fec0d45a48e5 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:55.854234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc15a1-bfcb-4221-876b-b05b859af623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:55.854968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc15a1-bfcb-4221-876b-b05b859af623 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:55.855252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc15a1-bfcb-4221-876b-b05b859af623 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:55.855522 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc15a1-bfcb-4221-876b-b05b859af623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:55.866229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc15a1-bfcb-4221-876b-b05b859af623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:55.870171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc15a1-bfcb-4221-876b-b05b859af623 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:55.883326 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1236/2465] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:57.652788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4de80c-cc42-409e-a370-c0a1adfec93a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:57.654193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4de80c-cc42-409e-a370-c0a1adfec93a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:57.654193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4de80c-cc42-409e-a370-c0a1adfec93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:57.677841 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-aa4de80c-cc42-409e-a370-c0a1adfec93a None None] MFA Rules not processed for user `649b66b27ef44ad5b218f6e8bb790963`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:57.679171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-aa4de80c-cc42-409e-a370-c0a1adfec93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:57.726350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:57.743775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1230/2466] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:45:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:58.084235 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc15a1-bfcb-4221-876b-b05b859af623 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:58.085826 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-79fc15a1-bfcb-4221-876b-b05b859af623 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:58.106341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc15a1-bfcb-4221-876b-b05b859af623 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:58.112574 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fe412-4b94-42d3-ae13-637cd64d5016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:58.113252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe412-4b94-42d3-ae13-637cd64d5016 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:58.113781 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe412-4b94-42d3-ae13-637cd64d5016 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:58.114085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe412-4b94-42d3-ae13-637cd64d5016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:58.116789 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4b8fe412-4b94-42d3-ae13-637cd64d5016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:58.129006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fe412-4b94-42d3-ae13-637cd64d5016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:58.131625 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fe412-4b94-42d3-ae13-637cd64d5016 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:58.141650 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1237/2467] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:58.612042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4de80c-cc42-409e-a370-c0a1adfec93a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:58.614499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-aa4de80c-cc42-409e-a370-c0a1adfec93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:58.695120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4de80c-cc42-409e-a370-c0a1adfec93a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:58.701706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81571c-391b-42a3-bf9e-264083c905be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fd088faaba4d5c9745638c14f1a7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:58.702407 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81571c-391b-42a3-bf9e-264083c905be service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:58.702707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81571c-391b-42a3-bf9e-264083c905be service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:58.703120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81571c-391b-42a3-bf9e-264083c905be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:58.705015 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5f81571c-391b-42a3-bf9e-264083c905be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:58.718158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81571c-391b-42a3-bf9e-264083c905be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:58.719850 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81571c-391b-42a3-bf9e-264083c905be service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:58.733612 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1231/2468] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:46:08.137018 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=37 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:08.727751 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=36 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:09.855956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fe412-4b94-42d3-ae13-637cd64d5016 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:46:09.874170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fe412-4b94-42d3-ae13-637cd64d5016 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:46:09.878143 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25d699-a85a-4f04-9dbb-812f50148efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:46:09.879442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25d699-a85a-4f04-9dbb-812f50148efe service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:09.879891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25d699-a85a-4f04-9dbb-812f50148efe service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:09.880172 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25d699-a85a-4f04-9dbb-812f50148efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:09.882239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3c25d699-a85a-4f04-9dbb-812f50148efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:09.893951 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25d699-a85a-4f04-9dbb-812f50148efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:46:09.896138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25d699-a85a-4f04-9dbb-812f50148efe service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:46:09.909140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1238/2469] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:46:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:46:11.276100 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81571c-391b-42a3-bf9e-264083c905be service placement] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:46:11.292590 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81571c-391b-42a3-bf9e-264083c905be service placement] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:46:11.299249 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d359848-235f-41da-8589-ec9a48129a75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:46:11.299931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d359848-235f-41da-8589-ec9a48129a75 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:11.300213 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d359848-235f-41da-8589-ec9a48129a75 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:11.300494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d359848-235f-41da-8589-ec9a48129a75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:11.302592 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3d359848-235f-41da-8589-ec9a48129a75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:11.316159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d359848-235f-41da-8589-ec9a48129a75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:46:11.318600 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d359848-235f-41da-8589-ec9a48129a75 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:46:11.330189 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1232/2470] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:46:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:46:19.901573 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=6 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:21.325349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=6 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:22.034055 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25d699-a85a-4f04-9dbb-812f50148efe service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:46:22.053934 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25d699-a85a-4f04-9dbb-812f50148efe service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:46:22.061541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e57c48-d822-4ab2-8f27-036ba0f4f570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:46:22.062566 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e57c48-d822-4ab2-8f27-036ba0f4f570 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:22.063103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e57c48-d822-4ab2-8f27-036ba0f4f570 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:22.063401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e57c48-d822-4ab2-8f27-036ba0f4f570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:22.065478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-88e57c48-d822-4ab2-8f27-036ba0f4f570 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:22.080733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e57c48-d822-4ab2-8f27-036ba0f4f570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:46:22.082681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e57c48-d822-4ab2-8f27-036ba0f4f570 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:46:22.097884 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1239/2471] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:46:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:46:32.089839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=6 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:37.623087 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d359848-235f-41da-8589-ec9a48129a75 service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:46:37.641136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d359848-235f-41da-8589-ec9a48129a75 service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:46:37.648065 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393326b1-8a57-4e56-8d57-1b5f12a19763 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fd088faaba4d5c9745638c14f1a7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:46:37.649093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393326b1-8a57-4e56-8d57-1b5f12a19763 service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:37.649654 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393326b1-8a57-4e56-8d57-1b5f12a19763 service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:37.649941 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393326b1-8a57-4e56-8d57-1b5f12a19763 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:37.652063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-393326b1-8a57-4e56-8d57-1b5f12a19763 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:37.670003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393326b1-8a57-4e56-8d57-1b5f12a19763 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:46:37.672540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393326b1-8a57-4e56-8d57-1b5f12a19763 service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:46:37.687664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1233/2472] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:46:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:46:37.769879 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e57c48-d822-4ab2-8f27-036ba0f4f570 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:46:37.771457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-88e57c48-d822-4ab2-8f27-036ba0f4f570 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:37.792052 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e57c48-d822-4ab2-8f27-036ba0f4f570 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:46:37.798519 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a051ec2-45b3-488c-be86-da4d4abb25d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:46:37.799411 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a051ec2-45b3-488c-be86-da4d4abb25d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:37.799824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a051ec2-45b3-488c-be86-da4d4abb25d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:37.800101 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a051ec2-45b3-488c-be86-da4d4abb25d9 admin admin] PATH_INFO: `/v3/users/c91494330c2843c3bea4baa263eb302a` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:37.801318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a051ec2-45b3-488c-be86-da4d4abb25d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c91494330c2843c3bea4baa263eb302a)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:46:37.803307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a051ec2-45b3-488c-be86-da4d4abb25d9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:46:38.052102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7a051ec2-45b3-488c-be86-da4d4abb25d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c91494330c2843c3bea4baa263eb302a'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:46:38.170413 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7a051ec2-45b3-488c-be86-da4d4abb25d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c91494330c2843c3bea4baa263eb302a'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:46:38.178739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7a051ec2-45b3-488c-be86-da4d4abb25d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c91494330c2843c3bea4baa263eb302a'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:46:38.179902 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7a051ec2-45b3-488c-be86-da4d4abb25d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c91494330c2843c3bea4baa263eb302a'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:46:38.193620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7a051ec2-45b3-488c-be86-da4d4abb25d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c91494330c2843c3bea4baa263eb302a'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:46:38.199619 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1240/2473] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:46:37 2022] DELETE /identity/v3/users/c91494330c2843c3bea4baa263eb302a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:46:38.504203 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393326b1-8a57-4e56-8d57-1b5f12a19763 service placement] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:46:38.520085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393326b1-8a57-4e56-8d57-1b5f12a19763 service placement] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:46:38.587516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f8998-6668-4748-b942-c3b52270d10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:46:38.588378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f8998-6668-4748-b942-c3b52270d10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:38.588726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f8998-6668-4748-b942-c3b52270d10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:38.589010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f8998-6668-4748-b942-c3b52270d10b admin admin] PATH_INFO: `/v3/projects/3642fdd5ab874f20bda2395313aa5509` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:38.590202 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f8998-6668-4748-b942-c3b52270d10b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3642fdd5ab874f20bda2395313aa5509)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:46:38.592176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f8998-6668-4748-b942-c3b52270d10b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:46:38.753508 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-079f8998-6668-4748-b942-c3b52270d10b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3642fdd5ab874f20bda2395313aa5509', 'request_id': 'req-079f8998-6668-4748-b942-c3b52270d10b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:46:38.757596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-079f8998-6668-4748-b942-c3b52270d10b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3642fdd5ab874f20bda2395313aa5509', 'request_id': 'req-079f8998-6668-4748-b942-c3b52270d10b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:46:38.766231 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-079f8998-6668-4748-b942-c3b52270d10b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3642fdd5ab874f20bda2395313aa5509', 'request_id': 'req-079f8998-6668-4748-b942-c3b52270d10b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:46:38.841091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-079f8998-6668-4748-b942-c3b52270d10b admin admin] The token cache is being invalidate because project 3642fdd5ab874f20bda2395313aa5509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:46:38.841382 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-079f8998-6668-4748-b942-c3b52270d10b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:46:38.842022 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-079f8998-6668-4748-b942-c3b52270d10b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:46:38.843615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1234/2474] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:46:38 2022] DELETE /identity/v3/projects/3642fdd5ab874f20bda2395313aa5509 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:46:42.513719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b1fd7-878a-4937-aa55-907a91d4a4c8 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:42.514402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b1fd7-878a-4937-aa55-907a91d4a4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:42.514402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b1fd7-878a-4937-aa55-907a91d4a4c8 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:42.515816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1241/2475] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 18 10:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:46:42.523270 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623267f1-9241-4e72-ad77-4413073aa662 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:42.524122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623267f1-9241-4e72-ad77-4413073aa662 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:42.524122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623267f1-9241-4e72-ad77-4413073aa662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:42.546584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-623267f1-9241-4e72-ad77-4413073aa662 None None] MFA Rules not processed for user `3f9385dec85a4e0cba21c2a840124f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:46:42.547794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-623267f1-9241-4e72-ad77-4413073aa662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:42.605238 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1235/2476] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 18 10:46:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:46:42.618774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b1fd7-878a-4937-aa55-907a91d4a4c8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:46:42.620637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-528b1fd7-878a-4937-aa55-907a91d4a4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:42.635367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b1fd7-878a-4937-aa55-907a91d4a4c8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:46:42.639762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43a409-0e27-4cb7-9df8-2a30fc4e95fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:46:42.640498 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43a409-0e27-4cb7-9df8-2a30fc4e95fb service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:42.640784 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43a409-0e27-4cb7-9df8-2a30fc4e95fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:42.641058 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43a409-0e27-4cb7-9df8-2a30fc4e95fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:42.656166 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43a409-0e27-4cb7-9df8-2a30fc4e95fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:46:42.657835 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43a409-0e27-4cb7-9df8-2a30fc4e95fb service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:46:42.666995 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1242/2477] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:46:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:46:42.790366 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375cb06-cedb-46dc-ac7f-279bd83fcee5 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:42.790836 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375cb06-cedb-46dc-ac7f-279bd83fcee5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:42.791207 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375cb06-cedb-46dc-ac7f-279bd83fcee5 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:42.792820 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1236/2478] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 18 10:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:46:42.799872 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3102e99-3502-4282-9d41-3490aaa6963a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:42.807261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3102e99-3502-4282-9d41-3490aaa6963a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:42.807261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3102e99-3502-4282-9d41-3490aaa6963a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:42.824210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e3102e99-3502-4282-9d41-3490aaa6963a None None] MFA Rules not processed for user `f7abf6b71ac3454ca547a750cef9220a`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:46:42.825682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e3102e99-3502-4282-9d41-3490aaa6963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:42.911094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1243/2479] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 18 10:46:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:46:42.922910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375cb06-cedb-46dc-ac7f-279bd83fcee5 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:46:42.925457 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4375cb06-cedb-46dc-ac7f-279bd83fcee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:42.942280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375cb06-cedb-46dc-ac7f-279bd83fcee5 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:46:42.946010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffefd6-efa8-41c3-85a9-5e0c732b0cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:46:42.946693 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffefd6-efa8-41c3-85a9-5e0c732b0cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:42.947001 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffefd6-efa8-41c3-85a9-5e0c732b0cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:42.947281 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffefd6-efa8-41c3-85a9-5e0c732b0cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:42.959110 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffefd6-efa8-41c3-85a9-5e0c732b0cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:46:42.961953 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffefd6-efa8-41c3-85a9-5e0c732b0cc0 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:46:42.976886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1237/2480] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:46:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:46:44.057850 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3102e99-3502-4282-9d41-3490aaa6963a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:46:44.060467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e3102e99-3502-4282-9d41-3490aaa6963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:44.077479 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3102e99-3502-4282-9d41-3490aaa6963a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:46:44.084175 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbd4dc-56a5-4c86-a771-42d55188fb79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:46:44.084932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbd4dc-56a5-4c86-a771-42d55188fb79 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:44.085121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbd4dc-56a5-4c86-a771-42d55188fb79 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:44.085454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbd4dc-56a5-4c86-a771-42d55188fb79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:44.087349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c1cbd4dc-56a5-4c86-a771-42d55188fb79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:44.109700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbd4dc-56a5-4c86-a771-42d55188fb79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:46:44.113446 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbd4dc-56a5-4c86-a771-42d55188fb79 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:46:44.128860 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1244/2481] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:46:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:46:52.968194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:54.121432 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=72,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:04.038243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2ce79-869a-4b9f-ac55-10c4a14da4a8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:04.040070 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2ce79-869a-4b9f-ac55-10c4a14da4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:04.040562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2ce79-869a-4b9f-ac55-10c4a14da4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:04.072380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-61d2ce79-869a-4b9f-ac55-10c4a14da4a8 None None] MFA Rules not processed for user `d4be9b38bc54460c8e8a0c08f8c6efed`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:04.073989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-61d2ce79-869a-4b9f-ac55-10c4a14da4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:04.179636 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1238/2482] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:47:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:14.165954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=25 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:20.947514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda1de3-dda3-4c70-8900-2d4fb22b0b63 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:20.948367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda1de3-dda3-4c70-8900-2d4fb22b0b63 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:20.948842 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda1de3-dda3-4c70-8900-2d4fb22b0b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:20.977871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8cda1de3-dda3-4c70-8900-2d4fb22b0b63 None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:20.979649 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8cda1de3-dda3-4c70-8900-2d4fb22b0b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:21.094208 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1245/2483] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jul 18 10:47:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:21.328158 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2ce79-869a-4b9f-ac55-10c4a14da4a8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:21.331176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-61d2ce79-869a-4b9f-ac55-10c4a14da4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:21.472289 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2ce79-869a-4b9f-ac55-10c4a14da4a8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:21.484832 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b588b9-05a8-4881-a5cc-49fadc707ae0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:21.485988 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b588b9-05a8-4881-a5cc-49fadc707ae0 service swift] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:21.486392 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b588b9-05a8-4881-a5cc-49fadc707ae0 service swift] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:21.486777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b588b9-05a8-4881-a5cc-49fadc707ae0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:21.499480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b588b9-05a8-4881-a5cc-49fadc707ae0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:21.502270 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b588b9-05a8-4881-a5cc-49fadc707ae0 service swift] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:21.516253 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1239/2484] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:47:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 10:47:29.725126 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda1de3-dda3-4c70-8900-2d4fb22b0b63 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:29.741605 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda1de3-dda3-4c70-8900-2d4fb22b0b63 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:29.748247 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ee393-7778-44ea-a1d7-dbcc8deac76c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:29.749431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ee393-7778-44ea-a1d7-dbcc8deac76c service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:29.749897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ee393-7778-44ea-a1d7-dbcc8deac76c service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:29.750424 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ee393-7778-44ea-a1d7-dbcc8deac76c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:29.756077 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-af3ee393-7778-44ea-a1d7-dbcc8deac76c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:29.872842 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ee393-7778-44ea-a1d7-dbcc8deac76c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:29.876513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ee393-7778-44ea-a1d7-dbcc8deac76c service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:29.893964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1246/2485] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:31.511535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=32 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:36.723479 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6537099-409d-4ce3-a87b-af7701f5b82a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:36.725490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6537099-409d-4ce3-a87b-af7701f5b82a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:36.726678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6537099-409d-4ce3-a87b-af7701f5b82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:36.770923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f6537099-409d-4ce3-a87b-af7701f5b82a None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:36.774002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f6537099-409d-4ce3-a87b-af7701f5b82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:36.791813 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1240/2486] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 18 10:47:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:36.819117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ee393-7778-44ea-a1d7-dbcc8deac76c service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:36.838748 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ee393-7778-44ea-a1d7-dbcc8deac76c service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:36.853696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c855c3-d983-4217-8022-813349ee67b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:36.853696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c855c3-d983-4217-8022-813349ee67b1 service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:36.853696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c855c3-d983-4217-8022-813349ee67b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:36.853696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c855c3-d983-4217-8022-813349ee67b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:36.869367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c855c3-d983-4217-8022-813349ee67b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:36.878129 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c855c3-d983-4217-8022-813349ee67b1 service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:36.921450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1247/2487] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:47:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 10:47:37.439037 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6537099-409d-4ce3-a87b-af7701f5b82a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:37.443008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f6537099-409d-4ce3-a87b-af7701f5b82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:37.480954 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6537099-409d-4ce3-a87b-af7701f5b82a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:37.498272 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8ca0e-2992-47f2-90d0-32dfcb618f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:37.503336 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8ca0e-2992-47f2-90d0-32dfcb618f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:37.507680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8ca0e-2992-47f2-90d0-32dfcb618f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:37.508553 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8ca0e-2992-47f2-90d0-32dfcb618f9b admin admin] PATH_INFO: `/v3/users/43b46c9179024f6b89c579db0d570cd7` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:37.515703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8ca0e-2992-47f2-90d0-32dfcb618f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=43b46c9179024f6b89c579db0d570cd7)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:37.528731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8ca0e-2992-47f2-90d0-32dfcb618f9b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:37.863526 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-09f8ca0e-2992-47f2-90d0-32dfcb618f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43b46c9179024f6b89c579db0d570cd7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:37.972944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-09f8ca0e-2992-47f2-90d0-32dfcb618f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43b46c9179024f6b89c579db0d570cd7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:37.999886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-09f8ca0e-2992-47f2-90d0-32dfcb618f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43b46c9179024f6b89c579db0d570cd7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:38.008150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-09f8ca0e-2992-47f2-90d0-32dfcb618f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43b46c9179024f6b89c579db0d570cd7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:38.074176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-09f8ca0e-2992-47f2-90d0-32dfcb618f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43b46c9179024f6b89c579db0d570cd7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:38.093819 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1241/2488] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:47:37 2022] DELETE /identity/v3/users/43b46c9179024f6b89c579db0d570cd7 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:38.756919 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c855c3-d983-4217-8022-813349ee67b1 service swift] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:38.783854 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c855c3-d983-4217-8022-813349ee67b1 service swift] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:38.785259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8ca0e-2992-47f2-90d0-32dfcb618f9b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:38.788922 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-09f8ca0e-2992-47f2-90d0-32dfcb618f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:38.987996 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b681037-33c8-46d2-961f-e012f207bda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:38.989664 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b681037-33c8-46d2-961f-e012f207bda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:38.990159 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b681037-33c8-46d2-961f-e012f207bda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:38.990704 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b681037-33c8-46d2-961f-e012f207bda6 admin admin] PATH_INFO: `/v3/projects/c2f28b1e666243fb9780f63e2fa6a6eb` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:38.993495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b681037-33c8-46d2-961f-e012f207bda6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2f28b1e666243fb9780f63e2fa6a6eb)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:38.997704 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b681037-33c8-46d2-961f-e012f207bda6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:39.029242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8ca0e-2992-47f2-90d0-32dfcb618f9b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:39.042877 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1e7e4-6f8e-437d-9a7f-5b2710700933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:39.044592 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1e7e4-6f8e-437d-9a7f-5b2710700933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:39.045148 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1e7e4-6f8e-437d-9a7f-5b2710700933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:39.045681 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1e7e4-6f8e-437d-9a7f-5b2710700933 admin admin] PATH_INFO: `/v3/users/61aa854524cc4b05b6baaf67e69708ab` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:39.050363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1e7e4-6f8e-437d-9a7f-5b2710700933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61aa854524cc4b05b6baaf67e69708ab)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:39.054809 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1e7e4-6f8e-437d-9a7f-5b2710700933 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:39.202421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:39.237776 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7b681037-33c8-46d2-961f-e012f207bda6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f28b1e666243fb9780f63e2fa6a6eb', 'request_id': 'req-7b681037-33c8-46d2-961f-e012f207bda6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.257130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7b681037-33c8-46d2-961f-e012f207bda6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f28b1e666243fb9780f63e2fa6a6eb', 'request_id': 'req-7b681037-33c8-46d2-961f-e012f207bda6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.269826 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7b681037-33c8-46d2-961f-e012f207bda6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f28b1e666243fb9780f63e2fa6a6eb', 'request_id': 'req-7b681037-33c8-46d2-961f-e012f207bda6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.461438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7b681037-33c8-46d2-961f-e012f207bda6 admin admin] The token cache is being invalidate because project c2f28b1e666243fb9780f63e2fa6a6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:47:39.464984 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7b681037-33c8-46d2-961f-e012f207bda6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.468236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7b681037-33c8-46d2-961f-e012f207bda6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.477452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1248/2489] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:47:38 2022] DELETE /identity/v3/projects/c2f28b1e666243fb9780f63e2fa6a6eb => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:39.485958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2394df5-9166-408d-863e-a3c13415e1c6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:39.488570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2394df5-9166-408d-863e-a3c13415e1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:39.489191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2394df5-9166-408d-863e-a3c13415e1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:39.495075 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7da1e7e4-6f8e-437d-9a7f-5b2710700933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61aa854524cc4b05b6baaf67e69708ab'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.531268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d2394df5-9166-408d-863e-a3c13415e1c6 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:39.534107 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d2394df5-9166-408d-863e-a3c13415e1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:39.654308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7da1e7e4-6f8e-437d-9a7f-5b2710700933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61aa854524cc4b05b6baaf67e69708ab'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.673710 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7da1e7e4-6f8e-437d-9a7f-5b2710700933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61aa854524cc4b05b6baaf67e69708ab'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.675308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7da1e7e4-6f8e-437d-9a7f-5b2710700933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61aa854524cc4b05b6baaf67e69708ab'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.678847 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1249/2490] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:47:39.685939 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:39.692890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f51ba-67f1-49f3-997d-2f1a91fdc0a5 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:39.693472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f51ba-67f1-49f3-997d-2f1a91fdc0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:39.693846 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f51ba-67f1-49f3-997d-2f1a91fdc0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:39.726968 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7da1e7e4-6f8e-437d-9a7f-5b2710700933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61aa854524cc4b05b6baaf67e69708ab'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.736875 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ce8f51ba-67f1-49f3-997d-2f1a91fdc0a5 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:39.739079 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ce8f51ba-67f1-49f3-997d-2f1a91fdc0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:39.753270 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1242/2491] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:47:38 2022] DELETE /identity/v3/users/61aa854524cc4b05b6baaf67e69708ab => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:39.758992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1250/2492] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:39.773882 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1e7e4-6f8e-437d-9a7f-5b2710700933 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:39.957407 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1e7e4-6f8e-437d-9a7f-5b2710700933 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:39.964566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1b57c-e583-4058-adc8-0c1513ffc3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:39.968533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1b57c-e583-4058-adc8-0c1513ffc3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:39.968951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1b57c-e583-4058-adc8-0c1513ffc3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:39.969424 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1b57c-e583-4058-adc8-0c1513ffc3e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:39.971897 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1b57c-e583-4058-adc8-0c1513ffc3e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:47:39.971897 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1b57c-e583-4058-adc8-0c1513ffc3e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:39.975615 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1b57c-e583-4058-adc8-0c1513ffc3e0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:40.012210 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1243/2493] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:47:40.014037 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f51ba-67f1-49f3-997d-2f1a91fdc0a5 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:40.043579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f51ba-67f1-49f3-997d-2f1a91fdc0a5 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:40.061381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a006963-c9fd-4c67-a743-d52eb90ac2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:40.066900 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a006963-c9fd-4c67-a743-d52eb90ac2fb admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:40.068168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a006963-c9fd-4c67-a743-d52eb90ac2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:40.068904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a006963-c9fd-4c67-a743-d52eb90ac2fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:40.071389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a006963-c9fd-4c67-a743-d52eb90ac2fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:40.076484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a006963-c9fd-4c67-a743-d52eb90ac2fb admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:40.260071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1251/2494] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:47:40 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:47:40.262569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1b57c-e583-4058-adc8-0c1513ffc3e0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:40.285630 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1b57c-e583-4058-adc8-0c1513ffc3e0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:40.386758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7dbde-1e1f-4eaf-8829-9addf7fce0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:40.388626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7dbde-1e1f-4eaf-8829-9addf7fce0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:40.389561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7dbde-1e1f-4eaf-8829-9addf7fce0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:40.390350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7dbde-1e1f-4eaf-8829-9addf7fce0d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:40.392254 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7dbde-1e1f-4eaf-8829-9addf7fce0d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:40.395508 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7dbde-1e1f-4eaf-8829-9addf7fce0d2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:40.502198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a006963-c9fd-4c67-a743-d52eb90ac2fb admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:40.504536 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4a006963-c9fd-4c67-a743-d52eb90ac2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:40.540113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a006963-c9fd-4c67-a743-d52eb90ac2fb admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:40.546736 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:40.548285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:40.548563 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:40.548839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c admin admin] PATH_INFO: `/v3/projects/cd2327a1012a4d5c91555b01b2fd4d21` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:40.550303 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd2327a1012a4d5c91555b01b2fd4d21)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:40.552338 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:40.652705 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1244/2495] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:47:40 2022] POST /identity/v3/users => generated 293 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:47:40.658123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7dbde-1e1f-4eaf-8829-9addf7fce0d2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:40.676738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7dbde-1e1f-4eaf-8829-9addf7fce0d2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:40.684638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a3d84-d7b5-4808-8729-34c73b9729ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:40.686020 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a3d84-d7b5-4808-8729-34c73b9729ee admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:40.686667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a3d84-d7b5-4808-8729-34c73b9729ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:40.687260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a3d84-d7b5-4808-8729-34c73b9729ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:40.689625 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a3d84-d7b5-4808-8729-34c73b9729ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:40.692870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a3d84-d7b5-4808-8729-34c73b9729ee admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:40.716342 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1245/2496] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:40.722969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a3d84-d7b5-4808-8729-34c73b9729ee admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:40.742923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a3d84-d7b5-4808-8729-34c73b9729ee admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:40.752579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1efb6-f65f-4709-aa7b-acb0cb614faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:40.753765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1efb6-f65f-4709-aa7b-acb0cb614faa admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:40.754284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1efb6-f65f-4709-aa7b-acb0cb614faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:40.754891 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1efb6-f65f-4709-aa7b-acb0cb614faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:40.756540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1efb6-f65f-4709-aa7b-acb0cb614faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:40.759912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1efb6-f65f-4709-aa7b-acb0cb614faa admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:40.784396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1246/2497] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:40.789722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1efb6-f65f-4709-aa7b-acb0cb614faa admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:40.793085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd2327a1012a4d5c91555b01b2fd4d21', 'request_id': 'req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:40.803297 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd2327a1012a4d5c91555b01b2fd4d21', 'request_id': 'req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:40.812505 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1efb6-f65f-4709-aa7b-acb0cb614faa admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:40.816817 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd2327a1012a4d5c91555b01b2fd4d21', 'request_id': 'req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:40.900078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:40.923246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c admin admin] The token cache is being invalidate because project cd2327a1012a4d5c91555b01b2fd4d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:47:40.923725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:40.925515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:40.927792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1252/2498] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:47:40 2022] DELETE /identity/v3/projects/cd2327a1012a4d5c91555b01b2fd4d21 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:47:40.940427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:40.943652 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:40.946678 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c429a4b-f823-4f4a-9469-c1b580929023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:40.948526 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c429a4b-f823-4f4a-9469-c1b580929023 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:40.949206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c429a4b-f823-4f4a-9469-c1b580929023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:40.949774 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c429a4b-f823-4f4a-9469-c1b580929023 admin admin] PATH_INFO: `/v3/projects/f307af71df174a3d8855902b68cb565e/users/6ab418830d774189899baaf615001e47/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:40.979587 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621f6f3-2f8d-40b4-8c3e-4a2cb64d193c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:40.980781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c429a4b-f823-4f4a-9469-c1b580929023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f307af71df174a3d8855902b68cb565e, user_id=6ab418830d774189899baaf615001e47, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:40.986471 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c429a4b-f823-4f4a-9469-c1b580929023 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:40.991184 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872021a-76ee-4814-849b-d6b1ec7e3a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:40.992563 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872021a-76ee-4814-849b-d6b1ec7e3a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:40.993060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872021a-76ee-4814-849b-d6b1ec7e3a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:40.993619 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872021a-76ee-4814-849b-d6b1ec7e3a3f admin admin] PATH_INFO: `/v3/users/0c5f398f641348de8554e52b3d367476` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:40.996187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872021a-76ee-4814-849b-d6b1ec7e3a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5f398f641348de8554e52b3d367476)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:40.998733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872021a-76ee-4814-849b-d6b1ec7e3a3f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:41.009193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:41.085558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1247/2499] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:47:40 2022] PUT /identity/v3/projects/f307af71df174a3d8855902b68cb565e/users/6ab418830d774189899baaf615001e47/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:41.091456 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6e320-5d2f-4c6a-a50c-fafdbe61dac0 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:41.091841 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6e320-5d2f-4c6a-a50c-fafdbe61dac0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:41.092228 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6e320-5d2f-4c6a-a50c-fafdbe61dac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:41.122951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c4a6e320-5d2f-4c6a-a50c-fafdbe61dac0 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:41.127730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c4a6e320-5d2f-4c6a-a50c-fafdbe61dac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:41.250969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1248/2500] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:41.261718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6e320-5d2f-4c6a-a50c-fafdbe61dac0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:41.264248 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c4a6e320-5d2f-4c6a-a50c-fafdbe61dac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:41.379414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0872021a-76ee-4814-849b-d6b1ec7e3a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5f398f641348de8554e52b3d367476'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:41.415536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6e320-5d2f-4c6a-a50c-fafdbe61dac0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:41.419903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71475bf5-5802-45bd-a6ff-2f19cb8f88b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:41.420666 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71475bf5-5802-45bd-a6ff-2f19cb8f88b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:41.420976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71475bf5-5802-45bd-a6ff-2f19cb8f88b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:41.421205 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71475bf5-5802-45bd-a6ff-2f19cb8f88b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:41.456287 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71475bf5-5802-45bd-a6ff-2f19cb8f88b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:41.458866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71475bf5-5802-45bd-a6ff-2f19cb8f88b2 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:41.511328 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1249/2501] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:41.942638 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0872021a-76ee-4814-849b-d6b1ec7e3a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5f398f641348de8554e52b3d367476'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:41.991509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0872021a-76ee-4814-849b-d6b1ec7e3a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5f398f641348de8554e52b3d367476'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:41.991509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0872021a-76ee-4814-849b-d6b1ec7e3a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5f398f641348de8554e52b3d367476'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:41.991509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0872021a-76ee-4814-849b-d6b1ec7e3a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5f398f641348de8554e52b3d367476'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:41.991509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1253/2502] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:47:40 2022] DELETE /identity/v3/users/0c5f398f641348de8554e52b3d367476 => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:42.410955 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71475bf5-5802-45bd-a6ff-2f19cb8f88b2 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:42.445761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71475bf5-5802-45bd-a6ff-2f19cb8f88b2 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:42.656829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:42.658938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:42.659602 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:42.660250 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9 admin admin] PATH_INFO: `/v3/projects/d1bd9d2237184c33a262721c37f70136` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:42.665528 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1bd9d2237184c33a262721c37f70136)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:42.669828 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:42.707787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:42.847786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1bd9d2237184c33a262721c37f70136', 'request_id': 'req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:42.860812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1bd9d2237184c33a262721c37f70136', 'request_id': 'req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:42.874695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1bd9d2237184c33a262721c37f70136', 'request_id': 'req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:42.974127 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9 admin admin] The token cache is being invalidate because project d1bd9d2237184c33a262721c37f70136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:47:42.974788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:42.978305 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:42.981690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1250/2503] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:47:42 2022] DELETE /identity/v3/projects/d1bd9d2237184c33a262721c37f70136 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:51.979467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=24,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:52.117564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5abece-a935-43b6-a07d-695044700f60 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:52.128371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5abece-a935-43b6-a07d-695044700f60 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:52.129708 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5abece-a935-43b6-a07d-695044700f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:52.238823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6b5abece-a935-43b6-a07d-695044700f60 None None] MFA Rules not processed for user `6ab418830d774189899baaf615001e47`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:52.241318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6b5abece-a935-43b6-a07d-695044700f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:52.434382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1254/2504] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:47:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:47:52.473321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:52.476193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:52.821087 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c920b20-1b37-4e5c-8af2-6fc29a8c07d9 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:52.855379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d3f3f-64a4-487e-a90a-fb0ee49c57ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:52.856878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d3f3f-64a4-487e-a90a-fb0ee49c57ac service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:52.857520 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d3f3f-64a4-487e-a90a-fb0ee49c57ac service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:52.858115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d3f3f-64a4-487e-a90a-fb0ee49c57ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:52.886425 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d3f3f-64a4-487e-a90a-fb0ee49c57ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:52.889838 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d3f3f-64a4-487e-a90a-fb0ee49c57ac service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:52.912764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1251/2505] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:54.451668 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5abece-a935-43b6-a07d-695044700f60 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:54.456441 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6b5abece-a935-43b6-a07d-695044700f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:54.578794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5abece-a935-43b6-a07d-695044700f60 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:54.597884 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9e316-55bc-420f-97e0-1dbfb9536b68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:54.598671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9e316-55bc-420f-97e0-1dbfb9536b68 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:54.598960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9e316-55bc-420f-97e0-1dbfb9536b68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:54.599239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9e316-55bc-420f-97e0-1dbfb9536b68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:54.609170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-45a9e316-55bc-420f-97e0-1dbfb9536b68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:54.785485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9e316-55bc-420f-97e0-1dbfb9536b68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:54.787880 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9e316-55bc-420f-97e0-1dbfb9536b68 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:54.808667 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1255/2506] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:56.763894 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e71ed-2c69-4f29-b0bf-62c568a2f70d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:56.764560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e71ed-2c69-4f29-b0bf-62c568a2f70d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:56.764560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e71ed-2c69-4f29-b0bf-62c568a2f70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:56.784584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-870e71ed-2c69-4f29-b0bf-62c568a2f70d None None] MFA Rules not processed for user `6ab418830d774189899baaf615001e47`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:56.785849 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-870e71ed-2c69-4f29-b0bf-62c568a2f70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:56.794074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1252/2507] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:47:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:57.186403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9e316-55bc-420f-97e0-1dbfb9536b68 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:57.189359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-45a9e316-55bc-420f-97e0-1dbfb9536b68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:57.243636 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:57.254781 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9e316-55bc-420f-97e0-1dbfb9536b68 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:57.266598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014f1b7-13ab-4587-bca4-aca364ef25a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:57.267270 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014f1b7-13ab-4587-bca4-aca364ef25a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:57.267551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014f1b7-13ab-4587-bca4-aca364ef25a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:57.267828 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014f1b7-13ab-4587-bca4-aca364ef25a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:57.269861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c014f1b7-13ab-4587-bca4-aca364ef25a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:57.281479 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014f1b7-13ab-4587-bca4-aca364ef25a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:57.283497 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014f1b7-13ab-4587-bca4-aca364ef25a3 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:57.292505 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1256/2508] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:01.801260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca525f2-0dab-402e-806a-43a31a57735e None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:01.808560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca525f2-0dab-402e-806a-43a31a57735e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:01.808560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca525f2-0dab-402e-806a-43a31a57735e None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:01.808560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1253/2509] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 18 10:48:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:48:01.809793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fb474-4c5f-4a3e-829c-a176ac1b7b6b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:01.810283 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fb474-4c5f-4a3e-829c-a176ac1b7b6b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:01.810578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fb474-4c5f-4a3e-829c-a176ac1b7b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:01.835162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e26fb474-4c5f-4a3e-829c-a176ac1b7b6b None None] MFA Rules not processed for user `f7abf6b71ac3454ca547a750cef9220a`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:01.836560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e26fb474-4c5f-4a3e-829c-a176ac1b7b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:01.847615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1257/2510] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 18 10:48:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:01.861188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca525f2-0dab-402e-806a-43a31a57735e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:01.878803 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2ca525f2-0dab-402e-806a-43a31a57735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:01.936161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca525f2-0dab-402e-806a-43a31a57735e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:01.940975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e66fc1-3a29-4bb2-a3b2-1bc0341c0ef4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f93de99555742ca9bd99d707d1cdbee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:01.942123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e66fc1-3a29-4bb2-a3b2-1bc0341c0ef4 service glance] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:01.942670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e66fc1-3a29-4bb2-a3b2-1bc0341c0ef4 service glance] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:01.943174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e66fc1-3a29-4bb2-a3b2-1bc0341c0ef4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:01.957331 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e66fc1-3a29-4bb2-a3b2-1bc0341c0ef4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:01.958810 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e66fc1-3a29-4bb2-a3b2-1bc0341c0ef4 service glance] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:01.975622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1254/2511] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:05.948621 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1fe67-f4b9-4630-8b1d-567111deaa4c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:05.949530 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1fe67-f4b9-4630-8b1d-567111deaa4c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:05.949811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1fe67-f4b9-4630-8b1d-567111deaa4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:06.000069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-54b1fe67-f4b9-4630-8b1d-567111deaa4c None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:06.001883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-54b1fe67-f4b9-4630-8b1d-567111deaa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:06.106844 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1258/2512] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 18 10:48:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:06.122620 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e66fc1-3a29-4bb2-a3b2-1bc0341c0ef4 service glance] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:06.126513 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-99e66fc1-3a29-4bb2-a3b2-1bc0341c0ef4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:06.183000 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:06.269142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e66fc1-3a29-4bb2-a3b2-1bc0341c0ef4 service glance] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:06.278616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd67cf9-6046-4d8b-b3e1-f01e943b3b1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:06.279294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd67cf9-6046-4d8b-b3e1-f01e943b3b1e service swift] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:06.279768 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd67cf9-6046-4d8b-b3e1-f01e943b3b1e service swift] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:06.280236 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd67cf9-6046-4d8b-b3e1-f01e943b3b1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:06.297654 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd67cf9-6046-4d8b-b3e1-f01e943b3b1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:06.303749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd67cf9-6046-4d8b-b3e1-f01e943b3b1e service swift] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:06.323331 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1255/2513] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:48:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 10:48:16.092994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=34 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:16.856814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=21 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:18.521135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1fe67-f4b9-4630-8b1d-567111deaa4c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:18.540468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1fe67-f4b9-4630-8b1d-567111deaa4c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:18.547583 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d74fe-3847-48d3-81d8-e5c34873936f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:18.548878 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d74fe-3847-48d3-81d8-e5c34873936f service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:18.549235 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d74fe-3847-48d3-81d8-e5c34873936f service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:18.549641 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d74fe-3847-48d3-81d8-e5c34873936f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:18.552985 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f91d74fe-3847-48d3-81d8-e5c34873936f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:18.631803 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d74fe-3847-48d3-81d8-e5c34873936f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:18.631803 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d74fe-3847-48d3-81d8-e5c34873936f service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:18.649533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1259/2514] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:26.855758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6771075-d217-446e-a9e6-4e2d58fa696c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:26.856297 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6771075-d217-446e-a9e6-4e2d58fa696c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:26.856508 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6771075-d217-446e-a9e6-4e2d58fa696c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:26.906604 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f6771075-d217-446e-a9e6-4e2d58fa696c None None] MFA Rules not processed for user `8c34067d12a34f8ab2061460e86ef135`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:26.907860 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f6771075-d217-446e-a9e6-4e2d58fa696c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:26.960001 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1256/2515] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jul 18 10:48:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:26.989408 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d74fe-3847-48d3-81d8-e5c34873936f service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:27.043151 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d74fe-3847-48d3-81d8-e5c34873936f service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:27.049446 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084301b-4be7-415e-b777-b8c9ac0fe48c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8ee2beff1a7487d92c1c5940f2784f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:27.050152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084301b-4be7-415e-b777-b8c9ac0fe48c service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:27.062560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084301b-4be7-415e-b777-b8c9ac0fe48c service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:27.062560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084301b-4be7-415e-b777-b8c9ac0fe48c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:27.062560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084301b-4be7-415e-b777-b8c9ac0fe48c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:27.062560 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084301b-4be7-415e-b777-b8c9ac0fe48c service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:27.071787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1260/2516] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 18 10:48:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:48:28.302097 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6771075-d217-446e-a9e6-4e2d58fa696c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:28.304973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f6771075-d217-446e-a9e6-4e2d58fa696c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:28.325940 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6771075-d217-446e-a9e6-4e2d58fa696c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:28.332968 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7484f9f-0dd0-4d09-98c0-4faaacddd9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:28.334114 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7484f9f-0dd0-4d09-98c0-4faaacddd9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:28.334682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7484f9f-0dd0-4d09-98c0-4faaacddd9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:28.335169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7484f9f-0dd0-4d09-98c0-4faaacddd9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:28.339563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f7484f9f-0dd0-4d09-98c0-4faaacddd9b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:28.450568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7484f9f-0dd0-4d09-98c0-4faaacddd9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:28.452215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7484f9f-0dd0-4d09-98c0-4faaacddd9b7 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:28.474643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1257/2517] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:30.506698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084301b-4be7-415e-b777-b8c9ac0fe48c service swift] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:30.519472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084301b-4be7-415e-b777-b8c9ac0fe48c service swift] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:30.524116 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b86ac-fbc9-4eed-81fa-10af0bce3b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:30.525356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b86ac-fbc9-4eed-81fa-10af0bce3b72 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:30.525940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b86ac-fbc9-4eed-81fa-10af0bce3b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:30.526492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b86ac-fbc9-4eed-81fa-10af0bce3b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:30.529071 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4d2b86ac-fbc9-4eed-81fa-10af0bce3b72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:30.566738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b86ac-fbc9-4eed-81fa-10af0bce3b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:30.568427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b86ac-fbc9-4eed-81fa-10af0bce3b72 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:30.601673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1261/2518] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:48:34.854192 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7484f9f-0dd0-4d09-98c0-4faaacddd9b7 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:34.856417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f7484f9f-0dd0-4d09-98c0-4faaacddd9b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:34.883780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7484f9f-0dd0-4d09-98c0-4faaacddd9b7 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:34.899963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce995c-24b8-464b-88f6-4e2e6ee14027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:34.899963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce995c-24b8-464b-88f6-4e2e6ee14027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:34.899963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce995c-24b8-464b-88f6-4e2e6ee14027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:34.899963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce995c-24b8-464b-88f6-4e2e6ee14027 admin admin] PATH_INFO: `/v3/users/d4be9b38bc54460c8e8a0c08f8c6efed` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:34.901090 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce995c-24b8-464b-88f6-4e2e6ee14027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4be9b38bc54460c8e8a0c08f8c6efed)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:34.901090 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce995c-24b8-464b-88f6-4e2e6ee14027 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:35.197088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f5ce995c-24b8-464b-88f6-4e2e6ee14027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4be9b38bc54460c8e8a0c08f8c6efed'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:35.321791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f5ce995c-24b8-464b-88f6-4e2e6ee14027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4be9b38bc54460c8e8a0c08f8c6efed'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:35.336418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f5ce995c-24b8-464b-88f6-4e2e6ee14027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4be9b38bc54460c8e8a0c08f8c6efed'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:35.337547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f5ce995c-24b8-464b-88f6-4e2e6ee14027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4be9b38bc54460c8e8a0c08f8c6efed'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:35.350186 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:35.382591 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f5ce995c-24b8-464b-88f6-4e2e6ee14027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4be9b38bc54460c8e8a0c08f8c6efed'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:35.403287 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1258/2519] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:48:34 2022] DELETE /identity/v3/users/d4be9b38bc54460c8e8a0c08f8c6efed => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:35.732257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b86ac-fbc9-4eed-81fa-10af0bce3b72 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:35.758865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b86ac-fbc9-4eed-81fa-10af0bce3b72 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:35.831597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce995c-24b8-464b-88f6-4e2e6ee14027 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:35.834060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f5ce995c-24b8-464b-88f6-4e2e6ee14027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:35.870772 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fea89-7cbb-4574-88ce-da98e656996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:35.872541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fea89-7cbb-4574-88ce-da98e656996c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:35.872541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fea89-7cbb-4574-88ce-da98e656996c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:35.872541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fea89-7cbb-4574-88ce-da98e656996c admin admin] PATH_INFO: `/v3/projects/c9f11131027a40f88664d560e215481d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:35.873764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fea89-7cbb-4574-88ce-da98e656996c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f11131027a40f88664d560e215481d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:35.875770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fea89-7cbb-4574-88ce-da98e656996c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:36.009486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce995c-24b8-464b-88f6-4e2e6ee14027 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:36.014489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:36.030502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6f3fea89-7cbb-4574-88ce-da98e656996c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f11131027a40f88664d560e215481d', 'request_id': 'req-6f3fea89-7cbb-4574-88ce-da98e656996c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:36.048687 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6f3fea89-7cbb-4574-88ce-da98e656996c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f11131027a40f88664d560e215481d', 'request_id': 'req-6f3fea89-7cbb-4574-88ce-da98e656996c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:36.067204 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6f3fea89-7cbb-4574-88ce-da98e656996c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f11131027a40f88664d560e215481d', 'request_id': 'req-6f3fea89-7cbb-4574-88ce-da98e656996c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:36.189501 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698a9f7-2ad9-4ef5-8878-5f26e8707782 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fd088faaba4d5c9745638c14f1a7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:36.190693 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698a9f7-2ad9-4ef5-8878-5f26e8707782 service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:36.191086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6f3fea89-7cbb-4574-88ce-da98e656996c admin admin] The token cache is being invalidate because project c9f11131027a40f88664d560e215481d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:48:36.191276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698a9f7-2ad9-4ef5-8878-5f26e8707782 service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:36.191593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6f3fea89-7cbb-4574-88ce-da98e656996c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:36.191775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698a9f7-2ad9-4ef5-8878-5f26e8707782 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:36.192651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6f3fea89-7cbb-4574-88ce-da98e656996c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:36.194983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1262/2520] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:48:35 2022] DELETE /identity/v3/projects/c9f11131027a40f88664d560e215481d => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:48:36.198591 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1698a9f7-2ad9-4ef5-8878-5f26e8707782 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:36.198739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fea89-7cbb-4574-88ce-da98e656996c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:36.198739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6f3fea89-7cbb-4574-88ce-da98e656996c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:36.220159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698a9f7-2ad9-4ef5-8878-5f26e8707782 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:36.223603 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698a9f7-2ad9-4ef5-8878-5f26e8707782 service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:36.225630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fea89-7cbb-4574-88ce-da98e656996c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:36.234550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c825bad-2e11-434e-874b-2358ea921603 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fd088faaba4d5c9745638c14f1a7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:36.235785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c825bad-2e11-434e-874b-2358ea921603 service placement] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:36.236348 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c825bad-2e11-434e-874b-2358ea921603 service placement] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:36.237192 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c825bad-2e11-434e-874b-2358ea921603 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:36.240875 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0c825bad-2e11-434e-874b-2358ea921603 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:36.246506 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1259/2521] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:48:36.249940 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d87c4c-7487-4c68-8ca0-0f68a8e9ae6c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:36.250380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d87c4c-7487-4c68-8ca0-0f68a8e9ae6c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:36.250862 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d87c4c-7487-4c68-8ca0-0f68a8e9ae6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:36.274714 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c825bad-2e11-434e-874b-2358ea921603 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:36.277144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c825bad-2e11-434e-874b-2358ea921603 service placement] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:36.292313 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1263/2522] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:36.336144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e8d87c4c-7487-4c68-8ca0-0f68a8e9ae6c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:36.337382 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e8d87c4c-7487-4c68-8ca0-0f68a8e9ae6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:36.369769 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:36.422511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1260/2523] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:36.428933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cf649-68d8-4b01-a6ca-a14027b254ce None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:36.429221 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cf649-68d8-4b01-a6ca-a14027b254ce None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:36.429569 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cf649-68d8-4b01-a6ca-a14027b254ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:36.453930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-cf1cf649-68d8-4b01-a6ca-a14027b254ce None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:36.455294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-cf1cf649-68d8-4b01-a6ca-a14027b254ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:36.466370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1264/2524] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:36.479761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d87c4c-7487-4c68-8ca0-0f68a8e9ae6c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:36.491811 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d87c4c-7487-4c68-8ca0-0f68a8e9ae6c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:36.500422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441ef46-74a0-4016-aca4-dcf5c60d9b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:36.501561 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441ef46-74a0-4016-aca4-dcf5c60d9b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:36.504455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441ef46-74a0-4016-aca4-dcf5c60d9b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:36.504455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441ef46-74a0-4016-aca4-dcf5c60d9b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:36.506508 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441ef46-74a0-4016-aca4-dcf5c60d9b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:48:36.507119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441ef46-74a0-4016-aca4-dcf5c60d9b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:36.511347 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441ef46-74a0-4016-aca4-dcf5c60d9b06 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:36.538603 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1261/2525] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:48:36.539867 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cf649-68d8-4b01-a6ca-a14027b254ce None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:36.551246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cf649-68d8-4b01-a6ca-a14027b254ce None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:36.556501 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f43de-34f9-463d-8c42-c80c0bba59db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:36.557179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f43de-34f9-463d-8c42-c80c0bba59db admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:36.557457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f43de-34f9-463d-8c42-c80c0bba59db admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:36.557732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f43de-34f9-463d-8c42-c80c0bba59db admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:36.558473 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f43de-34f9-463d-8c42-c80c0bba59db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:36.560544 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f43de-34f9-463d-8c42-c80c0bba59db admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:36.690234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1265/2526] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:48:36 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:48:36.691525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441ef46-74a0-4016-aca4-dcf5c60d9b06 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:36.704412 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441ef46-74a0-4016-aca4-dcf5c60d9b06 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:36.787241 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5660c91-f3bf-4b54-82ce-4882e597472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:36.788396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5660c91-f3bf-4b54-82ce-4882e597472d admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:36.788897 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5660c91-f3bf-4b54-82ce-4882e597472d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:36.789403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5660c91-f3bf-4b54-82ce-4882e597472d admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:36.790851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5660c91-f3bf-4b54-82ce-4882e597472d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:36.793244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5660c91-f3bf-4b54-82ce-4882e597472d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:36.939594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1262/2527] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:48:36 2022] POST /identity/v3/users => generated 283 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:48:36.944183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f43de-34f9-463d-8c42-c80c0bba59db admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:36.958642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f43de-34f9-463d-8c42-c80c0bba59db admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:36.964386 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de072a4-1a61-46ea-85f5-21adf4ae0ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:36.965581 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de072a4-1a61-46ea-85f5-21adf4ae0ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:36.965956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de072a4-1a61-46ea-85f5-21adf4ae0ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:36.966243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de072a4-1a61-46ea-85f5-21adf4ae0ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:36.967568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de072a4-1a61-46ea-85f5-21adf4ae0ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:36.969782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de072a4-1a61-46ea-85f5-21adf4ae0ff4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:36.982277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1266/2528] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:36.989326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5660c91-f3bf-4b54-82ce-4882e597472d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:37.002090 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5660c91-f3bf-4b54-82ce-4882e597472d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:37.007360 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77fd1a-536e-48a1-8c75-3e69fbb1268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:37.008147 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77fd1a-536e-48a1-8c75-3e69fbb1268d admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:37.008434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77fd1a-536e-48a1-8c75-3e69fbb1268d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:37.008721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77fd1a-536e-48a1-8c75-3e69fbb1268d admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:37.009484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77fd1a-536e-48a1-8c75-3e69fbb1268d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:37.011211 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77fd1a-536e-48a1-8c75-3e69fbb1268d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:37.023064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1263/2529] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:37.028606 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de072a4-1a61-46ea-85f5-21adf4ae0ff4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:37.041721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de072a4-1a61-46ea-85f5-21adf4ae0ff4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:37.048591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79599804-2ba8-4e53-b41c-c92b343d7fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:37.049584 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79599804-2ba8-4e53-b41c-c92b343d7fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:37.049867 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79599804-2ba8-4e53-b41c-c92b343d7fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:37.050679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79599804-2ba8-4e53-b41c-c92b343d7fe6 admin admin] PATH_INFO: `/v3/projects/2a4cbb1301934cb5b165e477c585b317/users/9097da58b7f74820ba27ee4475b92e01/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:37.068044 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79599804-2ba8-4e53-b41c-c92b343d7fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4cbb1301934cb5b165e477c585b317, user_id=9097da58b7f74820ba27ee4475b92e01, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:37.070864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79599804-2ba8-4e53-b41c-c92b343d7fe6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:37.183040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1267/2530] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:48:37 2022] PUT /identity/v3/projects/2a4cbb1301934cb5b165e477c585b317/users/9097da58b7f74820ba27ee4475b92e01/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:37.194530 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da83b6a-7fed-4b45-9693-2f995df50671 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:37.194825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da83b6a-7fed-4b45-9693-2f995df50671 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:37.195111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da83b6a-7fed-4b45-9693-2f995df50671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:37.228379 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2da83b6a-7fed-4b45-9693-2f995df50671 None None] MFA Rules not processed for user `9097da58b7f74820ba27ee4475b92e01`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:37.229827 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2da83b6a-7fed-4b45-9693-2f995df50671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:37.331998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1264/2531] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:48:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:37.336736 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79599804-2ba8-4e53-b41c-c92b343d7fe6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:37.442658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79599804-2ba8-4e53-b41c-c92b343d7fe6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:37.447785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce6746-3485-4d01-8472-2a53cf6cbd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:37.448523 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce6746-3485-4d01-8472-2a53cf6cbd7d admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:37.448851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce6746-3485-4d01-8472-2a53cf6cbd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:37.449146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce6746-3485-4d01-8472-2a53cf6cbd7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:37.449933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce6746-3485-4d01-8472-2a53cf6cbd7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:37.452953 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce6746-3485-4d01-8472-2a53cf6cbd7d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:37.590413 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1268/2532] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:48:37 2022] POST /identity/v3/projects => generated 367 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:48:37.597371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da83b6a-7fed-4b45-9693-2f995df50671 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:37.613869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da83b6a-7fed-4b45-9693-2f995df50671 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:37.643047 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:37.695772 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb643fbc-bfef-4ee1-ac8c-92ad35ab046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:37.696580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb643fbc-bfef-4ee1-ac8c-92ad35ab046f admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:37.696875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb643fbc-bfef-4ee1-ac8c-92ad35ab046f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:37.697156 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb643fbc-bfef-4ee1-ac8c-92ad35ab046f admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:37.698230 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb643fbc-bfef-4ee1-ac8c-92ad35ab046f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:37.700537 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb643fbc-bfef-4ee1-ac8c-92ad35ab046f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:37.823938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1265/2533] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:48:37 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:48:37.825085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce6746-3485-4d01-8472-2a53cf6cbd7d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:37.836608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce6746-3485-4d01-8472-2a53cf6cbd7d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:37.841816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b2373-28dc-4970-9631-a604192cbc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:37.843231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b2373-28dc-4970-9631-a604192cbc2d admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:37.843541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b2373-28dc-4970-9631-a604192cbc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:37.843876 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b2373-28dc-4970-9631-a604192cbc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:37.844630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b2373-28dc-4970-9631-a604192cbc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:37.846315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b2373-28dc-4970-9631-a604192cbc2d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:37.862239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1269/2534] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:48:37.868028 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb643fbc-bfef-4ee1-ac8c-92ad35ab046f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:37.883848 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb643fbc-bfef-4ee1-ac8c-92ad35ab046f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:37.891432 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5abc30-aece-492d-9de0-20758ff6d685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:37.892399 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5abc30-aece-492d-9de0-20758ff6d685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:37.892685 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5abc30-aece-492d-9de0-20758ff6d685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:37.892966 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5abc30-aece-492d-9de0-20758ff6d685 admin admin] PATH_INFO: `/v3/projects/6ca1234c55ec43438d46dec9c382ec89/users/4209bb3149414f8ba89681b3ccf5dd53/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:37.912435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5abc30-aece-492d-9de0-20758ff6d685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca1234c55ec43438d46dec9c382ec89, user_id=4209bb3149414f8ba89681b3ccf5dd53, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:37.915374 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5abc30-aece-492d-9de0-20758ff6d685 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:38.052922 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1266/2535] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:48:37 2022] PUT /identity/v3/projects/6ca1234c55ec43438d46dec9c382ec89/users/4209bb3149414f8ba89681b3ccf5dd53/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:38.057129 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b2373-28dc-4970-9631-a604192cbc2d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:38.069245 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b2373-28dc-4970-9631-a604192cbc2d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:38.105147 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:38.143533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a731858-e7a3-4a2b-a88b-d2d066d5408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:38.144335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a731858-e7a3-4a2b-a88b-d2d066d5408d admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:38.144618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a731858-e7a3-4a2b-a88b-d2d066d5408d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:38.155016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a731858-e7a3-4a2b-a88b-d2d066d5408d admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:38.155016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a731858-e7a3-4a2b-a88b-d2d066d5408d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:38.155016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a731858-e7a3-4a2b-a88b-d2d066d5408d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:38.159808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1270/2536] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:38.164275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5abc30-aece-492d-9de0-20758ff6d685 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:38.176950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5abc30-aece-492d-9de0-20758ff6d685 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:38.182208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a222fa9-7f71-431c-b6d2-926491fc7b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:38.183184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a222fa9-7f71-431c-b6d2-926491fc7b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:38.183490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a222fa9-7f71-431c-b6d2-926491fc7b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:38.183752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a222fa9-7f71-431c-b6d2-926491fc7b21 admin admin] PATH_INFO: `/v3/projects/6ca1234c55ec43438d46dec9c382ec89/users/4209bb3149414f8ba89681b3ccf5dd53/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:38.186667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a222fa9-7f71-431c-b6d2-926491fc7b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca1234c55ec43438d46dec9c382ec89, user_id=4209bb3149414f8ba89681b3ccf5dd53, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:38.189638 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a222fa9-7f71-431c-b6d2-926491fc7b21 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:38.205447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1267/2537] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:48:38 2022] PUT /identity/v3/projects/6ca1234c55ec43438d46dec9c382ec89/users/4209bb3149414f8ba89681b3ccf5dd53/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:38.217105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974ec64-e2e6-4a7f-a287-06bba9c59cf1 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:38.217392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974ec64-e2e6-4a7f-a287-06bba9c59cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:38.217656 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974ec64-e2e6-4a7f-a287-06bba9c59cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:38.255922 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e974ec64-e2e6-4a7f-a287-06bba9c59cf1 None None] MFA Rules not processed for user `4209bb3149414f8ba89681b3ccf5dd53`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:38.256863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e974ec64-e2e6-4a7f-a287-06bba9c59cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:38.363867 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1271/2538] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:48:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:38.379727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a222fa9-7f71-431c-b6d2-926491fc7b21 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:38.384037 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3a222fa9-7f71-431c-b6d2-926491fc7b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:38.489231 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a222fa9-7f71-431c-b6d2-926491fc7b21 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:38.494132 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea770d69-f3d2-43e4-8203-96e16deb66d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:38.496342 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea770d69-f3d2-43e4-8203-96e16deb66d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:38.496861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea770d69-f3d2-43e4-8203-96e16deb66d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:38.498952 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea770d69-f3d2-43e4-8203-96e16deb66d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:38.520736 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea770d69-f3d2-43e4-8203-96e16deb66d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:38.523002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea770d69-f3d2-43e4-8203-96e16deb66d4 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:38.539751 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1268/2539] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:38 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:38.813414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974ec64-e2e6-4a7f-a287-06bba9c59cf1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:38.825007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974ec64-e2e6-4a7f-a287-06bba9c59cf1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:38.829719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58033a-101a-4ba3-a211-e947ac92c744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:38.830428 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58033a-101a-4ba3-a211-e947ac92c744 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:38.830719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58033a-101a-4ba3-a211-e947ac92c744 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:38.831016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58033a-101a-4ba3-a211-e947ac92c744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:38.919520 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58033a-101a-4ba3-a211-e947ac92c744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:38.922252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58033a-101a-4ba3-a211-e947ac92c744 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:38.938142 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1272/2540] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:41.229327 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea770d69-f3d2-43e4-8203-96e16deb66d4 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:41.231131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ea770d69-f3d2-43e4-8203-96e16deb66d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:41.312165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea770d69-f3d2-43e4-8203-96e16deb66d4 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:41.317027 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d9ce0-3cd7-44b2-a585-bdd3ead3e67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:41.317921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d9ce0-3cd7-44b2-a585-bdd3ead3e67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:41.318199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d9ce0-3cd7-44b2-a585-bdd3ead3e67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:41.318588 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d9ce0-3cd7-44b2-a585-bdd3ead3e67b admin admin] PATH_INFO: `/v3/users/217b7f5e31d849b389b1d2fbcda68332` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:41.319953 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d9ce0-3cd7-44b2-a585-bdd3ead3e67b admin admin] RBAC: Authorizing `identity:delete_user(user_id=217b7f5e31d849b389b1d2fbcda68332)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:41.326565 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d9ce0-3cd7-44b2-a585-bdd3ead3e67b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:41.370642 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:41.632664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-879d9ce0-3cd7-44b2-a585-bdd3ead3e67b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217b7f5e31d849b389b1d2fbcda68332'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:41.785185 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-879d9ce0-3cd7-44b2-a585-bdd3ead3e67b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217b7f5e31d849b389b1d2fbcda68332'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:41.793482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-879d9ce0-3cd7-44b2-a585-bdd3ead3e67b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217b7f5e31d849b389b1d2fbcda68332'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:41.796961 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-879d9ce0-3cd7-44b2-a585-bdd3ead3e67b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217b7f5e31d849b389b1d2fbcda68332'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:41.809161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-879d9ce0-3cd7-44b2-a585-bdd3ead3e67b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217b7f5e31d849b389b1d2fbcda68332'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:41.816273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1269/2541] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:48:41 2022] DELETE /identity/v3/users/217b7f5e31d849b389b1d2fbcda68332 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:42.144016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58033a-101a-4ba3-a211-e947ac92c744 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:42.159302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58033a-101a-4ba3-a211-e947ac92c744 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:42.221400 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:42.234818 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42750d47-b6eb-48b5-a62e-df0bdfc9761c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:42.238976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42750d47-b6eb-48b5-a62e-df0bdfc9761c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:42.238976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42750d47-b6eb-48b5-a62e-df0bdfc9761c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:42.238976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42750d47-b6eb-48b5-a62e-df0bdfc9761c admin admin] PATH_INFO: `/v3/projects/fc194617d91a4604ad9ae5491fd061ec` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:42.238976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42750d47-b6eb-48b5-a62e-df0bdfc9761c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc194617d91a4604ad9ae5491fd061ec)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:42.239623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42750d47-b6eb-48b5-a62e-df0bdfc9761c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:42.360520 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-42750d47-b6eb-48b5-a62e-df0bdfc9761c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc194617d91a4604ad9ae5491fd061ec', 'request_id': 'req-42750d47-b6eb-48b5-a62e-df0bdfc9761c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:42.367046 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-42750d47-b6eb-48b5-a62e-df0bdfc9761c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc194617d91a4604ad9ae5491fd061ec', 'request_id': 'req-42750d47-b6eb-48b5-a62e-df0bdfc9761c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:42.372582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-42750d47-b6eb-48b5-a62e-df0bdfc9761c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc194617d91a4604ad9ae5491fd061ec', 'request_id': 'req-42750d47-b6eb-48b5-a62e-df0bdfc9761c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:42.459496 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-42750d47-b6eb-48b5-a62e-df0bdfc9761c admin admin] The token cache is being invalidate because project fc194617d91a4604ad9ae5491fd061ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:48:42.459787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-42750d47-b6eb-48b5-a62e-df0bdfc9761c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:42.460415 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-42750d47-b6eb-48b5-a62e-df0bdfc9761c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:42.461980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1273/2542] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:48:42 2022] DELETE /identity/v3/projects/fc194617d91a4604ad9ae5491fd061ec => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:42.465993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d9ce0-3cd7-44b2-a585-bdd3ead3e67b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:42.467667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-879d9ce0-3cd7-44b2-a585-bdd3ead3e67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:42.481364 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d9ce0-3cd7-44b2-a585-bdd3ead3e67b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:42.556059 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944f587-0879-4d63-b31c-cf22022dcfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:42.556977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944f587-0879-4d63-b31c-cf22022dcfdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:42.557263 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944f587-0879-4d63-b31c-cf22022dcfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:42.557537 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944f587-0879-4d63-b31c-cf22022dcfdb admin admin] PATH_INFO: `/v3/users/50fbf833259c466d8d764fab65af0ac2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:42.558879 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944f587-0879-4d63-b31c-cf22022dcfdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=50fbf833259c466d8d764fab65af0ac2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:42.563304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944f587-0879-4d63-b31c-cf22022dcfdb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:42.825899 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3944f587-0879-4d63-b31c-cf22022dcfdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50fbf833259c466d8d764fab65af0ac2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:42.924271 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3944f587-0879-4d63-b31c-cf22022dcfdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50fbf833259c466d8d764fab65af0ac2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:42.932829 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3944f587-0879-4d63-b31c-cf22022dcfdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50fbf833259c466d8d764fab65af0ac2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:42.933600 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3944f587-0879-4d63-b31c-cf22022dcfdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50fbf833259c466d8d764fab65af0ac2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:42.948873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3944f587-0879-4d63-b31c-cf22022dcfdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50fbf833259c466d8d764fab65af0ac2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:42.955740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1270/2543] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:48:42 2022] DELETE /identity/v3/users/50fbf833259c466d8d764fab65af0ac2 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:43.331048 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42750d47-b6eb-48b5-a62e-df0bdfc9761c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:43.335213 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-42750d47-b6eb-48b5-a62e-df0bdfc9761c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:43.353397 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42750d47-b6eb-48b5-a62e-df0bdfc9761c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:43.421587 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5511259-38f2-4330-bbb1-3133ab0cd5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:43.422657 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5511259-38f2-4330-bbb1-3133ab0cd5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:43.423125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5511259-38f2-4330-bbb1-3133ab0cd5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:43.423612 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5511259-38f2-4330-bbb1-3133ab0cd5df admin admin] PATH_INFO: `/v3/projects/282f1948e2ad4e4b84bc80a5006dd3aa` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:43.425015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5511259-38f2-4330-bbb1-3133ab0cd5df admin admin] RBAC: Authorizing `identity:delete_project(project_id=282f1948e2ad4e4b84bc80a5006dd3aa)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:43.427029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5511259-38f2-4330-bbb1-3133ab0cd5df admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:43.652835 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b5511259-38f2-4330-bbb1-3133ab0cd5df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '282f1948e2ad4e4b84bc80a5006dd3aa', 'request_id': 'req-b5511259-38f2-4330-bbb1-3133ab0cd5df'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:43.663569 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b5511259-38f2-4330-bbb1-3133ab0cd5df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '282f1948e2ad4e4b84bc80a5006dd3aa', 'request_id': 'req-b5511259-38f2-4330-bbb1-3133ab0cd5df'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:43.673836 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b5511259-38f2-4330-bbb1-3133ab0cd5df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '282f1948e2ad4e4b84bc80a5006dd3aa', 'request_id': 'req-b5511259-38f2-4330-bbb1-3133ab0cd5df'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:43.786246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b5511259-38f2-4330-bbb1-3133ab0cd5df admin admin] The token cache is being invalidate because project 282f1948e2ad4e4b84bc80a5006dd3aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:48:43.789646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b5511259-38f2-4330-bbb1-3133ab0cd5df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:43.789646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b5511259-38f2-4330-bbb1-3133ab0cd5df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:43.789646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1274/2544] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:48:43 2022] DELETE /identity/v3/projects/282f1948e2ad4e4b84bc80a5006dd3aa => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:46.510547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944f587-0879-4d63-b31c-cf22022dcfdb admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:46.512051 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3944f587-0879-4d63-b31c-cf22022dcfdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:46.525823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944f587-0879-4d63-b31c-cf22022dcfdb admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:46.540481 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:46.587740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86655b8b-058d-41c4-b439-598974579fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:46.588635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86655b8b-058d-41c4-b439-598974579fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:46.588933 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86655b8b-058d-41c4-b439-598974579fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:46.589215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86655b8b-058d-41c4-b439-598974579fff admin admin] PATH_INFO: `/v3/users/9097da58b7f74820ba27ee4475b92e01` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:46.590493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86655b8b-058d-41c4-b439-598974579fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9097da58b7f74820ba27ee4475b92e01)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:46.593465 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86655b8b-058d-41c4-b439-598974579fff admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:46.830302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-86655b8b-058d-41c4-b439-598974579fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9097da58b7f74820ba27ee4475b92e01'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:46.907941 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-86655b8b-058d-41c4-b439-598974579fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9097da58b7f74820ba27ee4475b92e01'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:46.918160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-86655b8b-058d-41c4-b439-598974579fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9097da58b7f74820ba27ee4475b92e01'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:46.919057 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-86655b8b-058d-41c4-b439-598974579fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9097da58b7f74820ba27ee4475b92e01'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:46.932767 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-86655b8b-058d-41c4-b439-598974579fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9097da58b7f74820ba27ee4475b92e01'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:46.940480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1271/2545] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:48:46 2022] DELETE /identity/v3/users/9097da58b7f74820ba27ee4475b92e01 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:46.946630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3e836-235c-4d69-9231-2d6ac3e2d268 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:46.947510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3e836-235c-4d69-9231-2d6ac3e2d268 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:46.947695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3e836-235c-4d69-9231-2d6ac3e2d268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:46.971115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3ff3e836-235c-4d69-9231-2d6ac3e2d268 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:46.972355 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3ff3e836-235c-4d69-9231-2d6ac3e2d268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:46.976641 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:47.057171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1275/2546] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:47.068539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86655b8b-058d-41c4-b439-598974579fff admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:47.070050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-86655b8b-058d-41c4-b439-598974579fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:47.161748 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86655b8b-058d-41c4-b439-598974579fff admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:47.167655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1772401-985b-4135-b2c2-28ec5e25126d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:47.168877 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1772401-985b-4135-b2c2-28ec5e25126d service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:47.169204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1772401-985b-4135-b2c2-28ec5e25126d service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:47.169565 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1772401-985b-4135-b2c2-28ec5e25126d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:47.180830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1772401-985b-4135-b2c2-28ec5e25126d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:47.182429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1772401-985b-4135-b2c2-28ec5e25126d service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:47.194690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1272/2547] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:47.699249 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3e836-235c-4d69-9231-2d6ac3e2d268 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:47.700787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3ff3e836-235c-4d69-9231-2d6ac3e2d268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:47.715743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3e836-235c-4d69-9231-2d6ac3e2d268 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:47.721474 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e47e4-a1af-48ce-8009-3c5697f851cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:47.722409 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e47e4-a1af-48ce-8009-3c5697f851cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:47.722694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e47e4-a1af-48ce-8009-3c5697f851cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:47.722963 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e47e4-a1af-48ce-8009-3c5697f851cf admin admin] PATH_INFO: `/v3/projects/2a4cbb1301934cb5b165e477c585b317` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:47.724257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e47e4-a1af-48ce-8009-3c5697f851cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a4cbb1301934cb5b165e477c585b317)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:47.726626 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e47e4-a1af-48ce-8009-3c5697f851cf admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:47.857726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-477e47e4-a1af-48ce-8009-3c5697f851cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a4cbb1301934cb5b165e477c585b317', 'request_id': 'req-477e47e4-a1af-48ce-8009-3c5697f851cf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:47.864447 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-477e47e4-a1af-48ce-8009-3c5697f851cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a4cbb1301934cb5b165e477c585b317', 'request_id': 'req-477e47e4-a1af-48ce-8009-3c5697f851cf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:47.870108 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-477e47e4-a1af-48ce-8009-3c5697f851cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a4cbb1301934cb5b165e477c585b317', 'request_id': 'req-477e47e4-a1af-48ce-8009-3c5697f851cf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:47.971513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-477e47e4-a1af-48ce-8009-3c5697f851cf admin admin] The token cache is being invalidate because project 2a4cbb1301934cb5b165e477c585b317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:48:47.972217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-477e47e4-a1af-48ce-8009-3c5697f851cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:47.972564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-477e47e4-a1af-48ce-8009-3c5697f851cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:47.975231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1276/2548] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:48:47 2022] DELETE /identity/v3/projects/2a4cbb1301934cb5b165e477c585b317 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:47.980816 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1772401-985b-4135-b2c2-28ec5e25126d service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:47.993010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1772401-985b-4135-b2c2-28ec5e25126d service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:48.013359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:48.063122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271964ea-ccd1-4f80-b9ae-04d47b398e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:48.064641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271964ea-ccd1-4f80-b9ae-04d47b398e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:48.065268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271964ea-ccd1-4f80-b9ae-04d47b398e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:48.065768 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271964ea-ccd1-4f80-b9ae-04d47b398e9d admin admin] PATH_INFO: `/v3/users/4209bb3149414f8ba89681b3ccf5dd53` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:48.068188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271964ea-ccd1-4f80-b9ae-04d47b398e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4209bb3149414f8ba89681b3ccf5dd53)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:48.072039 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271964ea-ccd1-4f80-b9ae-04d47b398e9d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:48.267290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-271964ea-ccd1-4f80-b9ae-04d47b398e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4209bb3149414f8ba89681b3ccf5dd53'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:48.364149 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-271964ea-ccd1-4f80-b9ae-04d47b398e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4209bb3149414f8ba89681b3ccf5dd53'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:48.373373 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-271964ea-ccd1-4f80-b9ae-04d47b398e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4209bb3149414f8ba89681b3ccf5dd53'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:48.374278 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-271964ea-ccd1-4f80-b9ae-04d47b398e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4209bb3149414f8ba89681b3ccf5dd53'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:48.387948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-271964ea-ccd1-4f80-b9ae-04d47b398e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4209bb3149414f8ba89681b3ccf5dd53'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:48.394525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1273/2549] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:48:47 2022] DELETE /identity/v3/users/4209bb3149414f8ba89681b3ccf5dd53 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:48.898352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e47e4-a1af-48ce-8009-3c5697f851cf admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:48.899837 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-477e47e4-a1af-48ce-8009-3c5697f851cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:48.914532 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e47e4-a1af-48ce-8009-3c5697f851cf admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:48.980527 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2efd3-ec73-4156-9d14-b4b10a7c5ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:48.981396 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2efd3-ec73-4156-9d14-b4b10a7c5ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:48.981678 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2efd3-ec73-4156-9d14-b4b10a7c5ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:48.981955 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2efd3-ec73-4156-9d14-b4b10a7c5ba6 admin admin] PATH_INFO: `/v3/projects/6ca1234c55ec43438d46dec9c382ec89` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:48.983196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2efd3-ec73-4156-9d14-b4b10a7c5ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca1234c55ec43438d46dec9c382ec89)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:48.985358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2efd3-ec73-4156-9d14-b4b10a7c5ba6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:49.095151 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:49.106461 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5ea2efd3-ec73-4156-9d14-b4b10a7c5ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca1234c55ec43438d46dec9c382ec89', 'request_id': 'req-5ea2efd3-ec73-4156-9d14-b4b10a7c5ba6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:49.113807 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5ea2efd3-ec73-4156-9d14-b4b10a7c5ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca1234c55ec43438d46dec9c382ec89', 'request_id': 'req-5ea2efd3-ec73-4156-9d14-b4b10a7c5ba6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:49.120238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5ea2efd3-ec73-4156-9d14-b4b10a7c5ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca1234c55ec43438d46dec9c382ec89', 'request_id': 'req-5ea2efd3-ec73-4156-9d14-b4b10a7c5ba6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:49.197856 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5ea2efd3-ec73-4156-9d14-b4b10a7c5ba6 admin admin] The token cache is being invalidate because project 6ca1234c55ec43438d46dec9c382ec89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:48:49.198539 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5ea2efd3-ec73-4156-9d14-b4b10a7c5ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:49.199821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5ea2efd3-ec73-4156-9d14-b4b10a7c5ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:49.203882 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1277/2550] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:48:48 2022] DELETE /identity/v3/projects/6ca1234c55ec43438d46dec9c382ec89 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:48:49.209764 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79222541-58ac-4f96-bd29-493980da49ff None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:49.210713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79222541-58ac-4f96-bd29-493980da49ff None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:49.210713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79222541-58ac-4f96-bd29-493980da49ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:49.234040 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-79222541-58ac-4f96-bd29-493980da49ff None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:49.235426 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-79222541-58ac-4f96-bd29-493980da49ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:49.311992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1274/2551] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:49.320285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc9b9a-3e7d-4522-907b-c9c845afacc1 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:49.320569 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc9b9a-3e7d-4522-907b-c9c845afacc1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:49.320964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc9b9a-3e7d-4522-907b-c9c845afacc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:49.346236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c7fc9b9a-3e7d-4522-907b-c9c845afacc1 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:49.347668 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c7fc9b9a-3e7d-4522-907b-c9c845afacc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:49.356489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1278/2552] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:49.362268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79222541-58ac-4f96-bd29-493980da49ff None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:49.373498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79222541-58ac-4f96-bd29-493980da49ff None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:49.379054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ac3d9-c221-47a5-b954-555f4ac40b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:49.379822 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ac3d9-c221-47a5-b954-555f4ac40b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:49.380105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ac3d9-c221-47a5-b954-555f4ac40b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:49.380381 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ac3d9-c221-47a5-b954-555f4ac40b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:49.381331 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ac3d9-c221-47a5-b954-555f4ac40b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:48:49.381645 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ac3d9-c221-47a5-b954-555f4ac40b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:49.383535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ac3d9-c221-47a5-b954-555f4ac40b9c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:49.397899 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1275/2553] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:48:49.402625 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc9b9a-3e7d-4522-907b-c9c845afacc1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:49.413587 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc9b9a-3e7d-4522-907b-c9c845afacc1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:49.418986 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab69be-8cf7-493b-a13b-dff62604a739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:49.420613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab69be-8cf7-493b-a13b-dff62604a739 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:49.420957 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab69be-8cf7-493b-a13b-dff62604a739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:49.421253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab69be-8cf7-493b-a13b-dff62604a739 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:49.422080 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab69be-8cf7-493b-a13b-dff62604a739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:49.424111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab69be-8cf7-493b-a13b-dff62604a739 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:49.596845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1279/2554] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:48:49 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:48:49.602165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ac3d9-c221-47a5-b954-555f4ac40b9c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:49.616389 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ac3d9-c221-47a5-b954-555f4ac40b9c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:49.655992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:49.693069 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706a2d3-e8df-4b13-971e-e9c00df9e99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:49.693793 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706a2d3-e8df-4b13-971e-e9c00df9e99c admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:49.694081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706a2d3-e8df-4b13-971e-e9c00df9e99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:49.694391 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706a2d3-e8df-4b13-971e-e9c00df9e99c admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:49.695118 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706a2d3-e8df-4b13-971e-e9c00df9e99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:49.697073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706a2d3-e8df-4b13-971e-e9c00df9e99c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:49.823805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1276/2555] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:48:49 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:48:49.829086 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab69be-8cf7-493b-a13b-dff62604a739 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:49.840253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab69be-8cf7-493b-a13b-dff62604a739 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:49.845596 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac50a8-ced2-49a8-aae2-e69377f2c003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:49.846269 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac50a8-ced2-49a8-aae2-e69377f2c003 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:49.846588 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac50a8-ced2-49a8-aae2-e69377f2c003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:49.846865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac50a8-ced2-49a8-aae2-e69377f2c003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:49.847594 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac50a8-ced2-49a8-aae2-e69377f2c003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:49.849224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac50a8-ced2-49a8-aae2-e69377f2c003 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:49.861744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1280/2556] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:49.866055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706a2d3-e8df-4b13-971e-e9c00df9e99c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:49.876726 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706a2d3-e8df-4b13-971e-e9c00df9e99c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:49.881884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc10e96-fce6-4413-a79b-ad146edd2bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:49.882605 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc10e96-fce6-4413-a79b-ad146edd2bde admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:49.882891 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc10e96-fce6-4413-a79b-ad146edd2bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:49.883174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc10e96-fce6-4413-a79b-ad146edd2bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:49.883909 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc10e96-fce6-4413-a79b-ad146edd2bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:49.885535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc10e96-fce6-4413-a79b-ad146edd2bde admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:49.896925 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1277/2557] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:49.901227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac50a8-ced2-49a8-aae2-e69377f2c003 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:49.918865 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac50a8-ced2-49a8-aae2-e69377f2c003 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:49.927130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b7c9a-c3e9-4212-bca2-cdfee679bb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:49.928666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b7c9a-c3e9-4212-bca2-cdfee679bb92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:49.928953 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b7c9a-c3e9-4212-bca2-cdfee679bb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:49.929268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b7c9a-c3e9-4212-bca2-cdfee679bb92 admin admin] PATH_INFO: `/v3/projects/b50ac832c0b249a5a2b8af976fe7e231/users/1834b5cb44e0481daff66f6d91392c99/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:49.951929 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b7c9a-c3e9-4212-bca2-cdfee679bb92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50ac832c0b249a5a2b8af976fe7e231, user_id=1834b5cb44e0481daff66f6d91392c99, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:49.955040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b7c9a-c3e9-4212-bca2-cdfee679bb92 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:50.079524 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1281/2558] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:48:49 2022] PUT /identity/v3/projects/b50ac832c0b249a5a2b8af976fe7e231/users/1834b5cb44e0481daff66f6d91392c99/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:50.090378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a86778-7b87-4f84-9b13-566bcaf438f8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:50.090670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a86778-7b87-4f84-9b13-566bcaf438f8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:50.090951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a86778-7b87-4f84-9b13-566bcaf438f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:50.119859 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-26a86778-7b87-4f84-9b13-566bcaf438f8 None None] MFA Rules not processed for user `1834b5cb44e0481daff66f6d91392c99`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:50.121064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-26a86778-7b87-4f84-9b13-566bcaf438f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:50.194540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1278/2559] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:48:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:50.207220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b7c9a-c3e9-4212-bca2-cdfee679bb92 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:50.209030 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d33b7c9a-c3e9-4212-bca2-cdfee679bb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:50.296008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b7c9a-c3e9-4212-bca2-cdfee679bb92 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:50.299925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f123d-6513-41e9-9c9d-83af6c02d789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:50.300573 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f123d-6513-41e9-9c9d-83af6c02d789 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:50.300857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f123d-6513-41e9-9c9d-83af6c02d789 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:50.301140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f123d-6513-41e9-9c9d-83af6c02d789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:50.310296 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f123d-6513-41e9-9c9d-83af6c02d789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:50.312081 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f123d-6513-41e9-9c9d-83af6c02d789 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:50.321741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1282/2560] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:57.885806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a86778-7b87-4f84-9b13-566bcaf438f8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:57.954027 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a86778-7b87-4f84-9b13-566bcaf438f8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:57.958971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a876d27-290e-4ee5-b49e-c78221a300ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:57.959861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a876d27-290e-4ee5-b49e-c78221a300ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:57.960147 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a876d27-290e-4ee5-b49e-c78221a300ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:57.960437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a876d27-290e-4ee5-b49e-c78221a300ce admin admin] PATH_INFO: `/v3/users/1834b5cb44e0481daff66f6d91392c99` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:57.961704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a876d27-290e-4ee5-b49e-c78221a300ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1834b5cb44e0481daff66f6d91392c99)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:57.963729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a876d27-290e-4ee5-b49e-c78221a300ce admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:58.186105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:58.194881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8a876d27-290e-4ee5-b49e-c78221a300ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1834b5cb44e0481daff66f6d91392c99'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:58.301503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8a876d27-290e-4ee5-b49e-c78221a300ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1834b5cb44e0481daff66f6d91392c99'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:58.314654 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8a876d27-290e-4ee5-b49e-c78221a300ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1834b5cb44e0481daff66f6d91392c99'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:58.315650 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8a876d27-290e-4ee5-b49e-c78221a300ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1834b5cb44e0481daff66f6d91392c99'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:58.331233 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8a876d27-290e-4ee5-b49e-c78221a300ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1834b5cb44e0481daff66f6d91392c99'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:58.338458 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1279/2561] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:48:57 2022] DELETE /identity/v3/users/1834b5cb44e0481daff66f6d91392c99 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:58.343908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65281e8e-8d8b-410e-90fe-f0bac4fdaf42 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:58.344482 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65281e8e-8d8b-410e-90fe-f0bac4fdaf42 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:58.344615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65281e8e-8d8b-410e-90fe-f0bac4fdaf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:58.366658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-65281e8e-8d8b-410e-90fe-f0bac4fdaf42 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:58.367992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-65281e8e-8d8b-410e-90fe-f0bac4fdaf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:58.432070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:58.456256 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1283/2562] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:48:58.466412 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a876d27-290e-4ee5-b49e-c78221a300ce admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:58.468033 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8a876d27-290e-4ee5-b49e-c78221a300ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:58.570000 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a876d27-290e-4ee5-b49e-c78221a300ce admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:58.573743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a473-559c-441f-8f79-f5feebb93b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:58.574437 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a473-559c-441f-8f79-f5feebb93b8c service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:58.574728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a473-559c-441f-8f79-f5feebb93b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:58.574995 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a473-559c-441f-8f79-f5feebb93b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:58.585496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20a473-559c-441f-8f79-f5feebb93b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:58.587034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20a473-559c-441f-8f79-f5feebb93b8c service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:58.597902 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1280/2563] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:59.150157 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65281e8e-8d8b-410e-90fe-f0bac4fdaf42 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:59.151632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-65281e8e-8d8b-410e-90fe-f0bac4fdaf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:59.165853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65281e8e-8d8b-410e-90fe-f0bac4fdaf42 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:59.172231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696373be-bf7a-4b5d-82a7-1fd0e6694a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:59.173393 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696373be-bf7a-4b5d-82a7-1fd0e6694a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:59.173680 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696373be-bf7a-4b5d-82a7-1fd0e6694a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:59.173956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696373be-bf7a-4b5d-82a7-1fd0e6694a3c admin admin] PATH_INFO: `/v3/projects/b50ac832c0b249a5a2b8af976fe7e231` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:59.175216 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696373be-bf7a-4b5d-82a7-1fd0e6694a3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50ac832c0b249a5a2b8af976fe7e231)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:59.178399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696373be-bf7a-4b5d-82a7-1fd0e6694a3c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:59.334140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-696373be-bf7a-4b5d-82a7-1fd0e6694a3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50ac832c0b249a5a2b8af976fe7e231', 'request_id': 'req-696373be-bf7a-4b5d-82a7-1fd0e6694a3c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:59.341507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-696373be-bf7a-4b5d-82a7-1fd0e6694a3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50ac832c0b249a5a2b8af976fe7e231', 'request_id': 'req-696373be-bf7a-4b5d-82a7-1fd0e6694a3c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:59.348039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-696373be-bf7a-4b5d-82a7-1fd0e6694a3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50ac832c0b249a5a2b8af976fe7e231', 'request_id': 'req-696373be-bf7a-4b5d-82a7-1fd0e6694a3c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:59.482646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-696373be-bf7a-4b5d-82a7-1fd0e6694a3c admin admin] The token cache is being invalidate because project b50ac832c0b249a5a2b8af976fe7e231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:48:59.483007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-696373be-bf7a-4b5d-82a7-1fd0e6694a3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:59.484278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-696373be-bf7a-4b5d-82a7-1fd0e6694a3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:59.485908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1284/2564] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:48:59 2022] DELETE /identity/v3/projects/b50ac832c0b249a5a2b8af976fe7e231 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:59.490848 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36253e72-71a2-4569-a9e7-ca5c37dfac5f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:59.491360 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36253e72-71a2-4569-a9e7-ca5c37dfac5f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:59.491457 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36253e72-71a2-4569-a9e7-ca5c37dfac5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:59.508995 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-36253e72-71a2-4569-a9e7-ca5c37dfac5f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:59.510192 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-36253e72-71a2-4569-a9e7-ca5c37dfac5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:59.578696 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1281/2565] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:59.588195 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca13475-525a-4dbf-88a4-18f0fd398298 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:59.588460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca13475-525a-4dbf-88a4-18f0fd398298 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:59.588742 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca13475-525a-4dbf-88a4-18f0fd398298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:59.610345 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-4ca13475-525a-4dbf-88a4-18f0fd398298 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:59.611593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4ca13475-525a-4dbf-88a4-18f0fd398298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:59.619898 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1285/2566] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:59.624655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36253e72-71a2-4569-a9e7-ca5c37dfac5f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:59.635135 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36253e72-71a2-4569-a9e7-ca5c37dfac5f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:59.640905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f16ea9-4168-49c5-ba16-201ae23a78f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:59.641632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f16ea9-4168-49c5-ba16-201ae23a78f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:59.641909 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f16ea9-4168-49c5-ba16-201ae23a78f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:59.642236 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f16ea9-4168-49c5-ba16-201ae23a78f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:59.643019 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f16ea9-4168-49c5-ba16-201ae23a78f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:48:59.643323 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f16ea9-4168-49c5-ba16-201ae23a78f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:59.644956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f16ea9-4168-49c5-ba16-201ae23a78f1 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:59.659012 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1282/2567] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:48:59.663553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca13475-525a-4dbf-88a4-18f0fd398298 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:59.674696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca13475-525a-4dbf-88a4-18f0fd398298 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:59.679554 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520caec-c65e-4586-a93c-789a495f15dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:59.680219 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520caec-c65e-4586-a93c-789a495f15dd admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:59.680692 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520caec-c65e-4586-a93c-789a495f15dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:59.680973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520caec-c65e-4586-a93c-789a495f15dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:59.681691 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520caec-c65e-4586-a93c-789a495f15dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:59.683716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520caec-c65e-4586-a93c-789a495f15dd admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:59.793593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1286/2568] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:48:59 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:48:59.798516 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f16ea9-4168-49c5-ba16-201ae23a78f1 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:59.809528 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f16ea9-4168-49c5-ba16-201ae23a78f1 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:59.878799 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:59.905607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2156279-4531-43ba-8385-4d209c274586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:59.906779 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2156279-4531-43ba-8385-4d209c274586 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:59.907290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2156279-4531-43ba-8385-4d209c274586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:59.907801 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2156279-4531-43ba-8385-4d209c274586 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:59.909146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2156279-4531-43ba-8385-4d209c274586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:59.913010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2156279-4531-43ba-8385-4d209c274586 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:00.067921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1283/2569] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:48:59 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:00.072514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520caec-c65e-4586-a93c-789a495f15dd admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:00.083487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520caec-c65e-4586-a93c-789a495f15dd admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:00.088494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f39a13-6d0e-4fd4-8447-40f28fb335a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:00.089153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f39a13-6d0e-4fd4-8447-40f28fb335a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:00.089438 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f39a13-6d0e-4fd4-8447-40f28fb335a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:00.089709 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f39a13-6d0e-4fd4-8447-40f28fb335a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:00.090453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f39a13-6d0e-4fd4-8447-40f28fb335a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:00.092892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f39a13-6d0e-4fd4-8447-40f28fb335a2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:00.103814 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1287/2570] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:00.108088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2156279-4531-43ba-8385-4d209c274586 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:00.118660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2156279-4531-43ba-8385-4d209c274586 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:00.123415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a030b3-9c47-4247-a705-1b0a3c8fc45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:00.124082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a030b3-9c47-4247-a705-1b0a3c8fc45d admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:00.126977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a030b3-9c47-4247-a705-1b0a3c8fc45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:00.126977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a030b3-9c47-4247-a705-1b0a3c8fc45d admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:00.126977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a030b3-9c47-4247-a705-1b0a3c8fc45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:00.126977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a030b3-9c47-4247-a705-1b0a3c8fc45d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:00.138722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1284/2571] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:00.142998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f39a13-6d0e-4fd4-8447-40f28fb335a2 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:00.153265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f39a13-6d0e-4fd4-8447-40f28fb335a2 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:00.158665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45060446-88c0-48f5-bfb1-2605906df0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:00.159832 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45060446-88c0-48f5-bfb1-2605906df0bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:00.160114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45060446-88c0-48f5-bfb1-2605906df0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:00.160391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45060446-88c0-48f5-bfb1-2605906df0bb admin admin] PATH_INFO: `/v3/projects/86178bd898664045be1a770f132b1aa7/users/4350b53a3e964f93b0536849ea8c9066/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:00.179826 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45060446-88c0-48f5-bfb1-2605906df0bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=86178bd898664045be1a770f132b1aa7, user_id=4350b53a3e964f93b0536849ea8c9066, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:00.183039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45060446-88c0-48f5-bfb1-2605906df0bb admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:00.290472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1288/2572] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:00 2022] PUT /identity/v3/projects/86178bd898664045be1a770f132b1aa7/users/4350b53a3e964f93b0536849ea8c9066/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:00.301813 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cc3a3-aa60-4f57-a953-4efe83e28a99 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:00.302105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cc3a3-aa60-4f57-a953-4efe83e28a99 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:00.302419 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cc3a3-aa60-4f57-a953-4efe83e28a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:00.335789 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b21cc3a3-aa60-4f57-a953-4efe83e28a99 None None] MFA Rules not processed for user `4350b53a3e964f93b0536849ea8c9066`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:00.336930 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b21cc3a3-aa60-4f57-a953-4efe83e28a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:00.407791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1285/2573] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:00.421862 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45060446-88c0-48f5-bfb1-2605906df0bb admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:00.423729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-45060446-88c0-48f5-bfb1-2605906df0bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:00.487051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45060446-88c0-48f5-bfb1-2605906df0bb admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:00.491816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589e7e7-3109-4bc3-b931-f58a26049a57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:00.492500 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589e7e7-3109-4bc3-b931-f58a26049a57 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:00.492780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589e7e7-3109-4bc3-b931-f58a26049a57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:00.493060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589e7e7-3109-4bc3-b931-f58a26049a57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:00.504171 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589e7e7-3109-4bc3-b931-f58a26049a57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:00.506165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589e7e7-3109-4bc3-b931-f58a26049a57 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:00.516536 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1289/2574] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:03.728403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cc3a3-aa60-4f57-a953-4efe83e28a99 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:03.804580 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cc3a3-aa60-4f57-a953-4efe83e28a99 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:03.809455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201821f-b7c1-4bb9-bd38-1fb3ee34d7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:03.811499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201821f-b7c1-4bb9-bd38-1fb3ee34d7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:03.811499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201821f-b7c1-4bb9-bd38-1fb3ee34d7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:03.811760 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201821f-b7c1-4bb9-bd38-1fb3ee34d7b2 admin admin] PATH_INFO: `/v3/users/4350b53a3e964f93b0536849ea8c9066` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:03.813066 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201821f-b7c1-4bb9-bd38-1fb3ee34d7b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4350b53a3e964f93b0536849ea8c9066)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:03.814944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201821f-b7c1-4bb9-bd38-1fb3ee34d7b2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:04.036724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e201821f-b7c1-4bb9-bd38-1fb3ee34d7b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4350b53a3e964f93b0536849ea8c9066'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:04.146459 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e201821f-b7c1-4bb9-bd38-1fb3ee34d7b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4350b53a3e964f93b0536849ea8c9066'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:04.148057 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:04.154828 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e201821f-b7c1-4bb9-bd38-1fb3ee34d7b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4350b53a3e964f93b0536849ea8c9066'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:04.155503 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e201821f-b7c1-4bb9-bd38-1fb3ee34d7b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4350b53a3e964f93b0536849ea8c9066'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:04.170010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e201821f-b7c1-4bb9-bd38-1fb3ee34d7b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4350b53a3e964f93b0536849ea8c9066'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:04.176802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1286/2575] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:03 2022] DELETE /identity/v3/users/4350b53a3e964f93b0536849ea8c9066 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:04.181553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f10a1-776f-4024-8a47-a6f09c7a3350 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:04.182034 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f10a1-776f-4024-8a47-a6f09c7a3350 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:04.182139 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f10a1-776f-4024-8a47-a6f09c7a3350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:04.189761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:04.202302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a10f10a1-776f-4024-8a47-a6f09c7a3350 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:04.203608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a10f10a1-776f-4024-8a47-a6f09c7a3350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:04.271669 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1290/2576] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:04.281817 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201821f-b7c1-4bb9-bd38-1fb3ee34d7b2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:04.283316 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e201821f-b7c1-4bb9-bd38-1fb3ee34d7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:04.359739 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201821f-b7c1-4bb9-bd38-1fb3ee34d7b2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:04.363704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaef75-dab7-4731-93fd-71b28c913f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:04.364369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaef75-dab7-4731-93fd-71b28c913f88 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:04.364662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaef75-dab7-4731-93fd-71b28c913f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:04.364973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaef75-dab7-4731-93fd-71b28c913f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:04.376321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aaef75-dab7-4731-93fd-71b28c913f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:04.378481 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aaef75-dab7-4731-93fd-71b28c913f88 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:04.391167 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1287/2577] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:04.892200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f10a1-776f-4024-8a47-a6f09c7a3350 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:04.894148 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a10f10a1-776f-4024-8a47-a6f09c7a3350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:04.910895 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f10a1-776f-4024-8a47-a6f09c7a3350 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:04.915956 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446d9ba-3c44-4810-8489-9198aa285246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:04.916957 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446d9ba-3c44-4810-8489-9198aa285246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:04.917239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446d9ba-3c44-4810-8489-9198aa285246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:04.917667 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446d9ba-3c44-4810-8489-9198aa285246 admin admin] PATH_INFO: `/v3/projects/86178bd898664045be1a770f132b1aa7` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:04.918835 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446d9ba-3c44-4810-8489-9198aa285246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86178bd898664045be1a770f132b1aa7)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:04.921812 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446d9ba-3c44-4810-8489-9198aa285246 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:05.165481 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d446d9ba-3c44-4810-8489-9198aa285246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86178bd898664045be1a770f132b1aa7', 'request_id': 'req-d446d9ba-3c44-4810-8489-9198aa285246'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:05.178563 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d446d9ba-3c44-4810-8489-9198aa285246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86178bd898664045be1a770f132b1aa7', 'request_id': 'req-d446d9ba-3c44-4810-8489-9198aa285246'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:05.189726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d446d9ba-3c44-4810-8489-9198aa285246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86178bd898664045be1a770f132b1aa7', 'request_id': 'req-d446d9ba-3c44-4810-8489-9198aa285246'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:05.338661 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d446d9ba-3c44-4810-8489-9198aa285246 admin admin] The token cache is being invalidate because project 86178bd898664045be1a770f132b1aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:05.339289 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d446d9ba-3c44-4810-8489-9198aa285246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:05.340060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d446d9ba-3c44-4810-8489-9198aa285246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:05.349742 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36881e46-73a7-48c7-a0c5-0a7161347868 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:05.350699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36881e46-73a7-48c7-a0c5-0a7161347868 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:05.350882 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36881e46-73a7-48c7-a0c5-0a7161347868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:05.353534 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1291/2578] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:04 2022] DELETE /identity/v3/projects/86178bd898664045be1a770f132b1aa7 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:05.382297 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-36881e46-73a7-48c7-a0c5-0a7161347868 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:05.384306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-36881e46-73a7-48c7-a0c5-0a7161347868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:05.486377 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1288/2579] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:05.498430 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8c418-f65d-4678-b4bd-7d6363e7f9ba None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:05.499258 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8c418-f65d-4678-b4bd-7d6363e7f9ba None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:05.499711 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8c418-f65d-4678-b4bd-7d6363e7f9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:05.531363 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8aa8c418-f65d-4678-b4bd-7d6363e7f9ba None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:05.533223 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8aa8c418-f65d-4678-b4bd-7d6363e7f9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:05.541593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1292/2580] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:05.545926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36881e46-73a7-48c7-a0c5-0a7161347868 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:05.556689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36881e46-73a7-48c7-a0c5-0a7161347868 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:05.562371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcbb06-038b-48bc-9b96-006ee3592086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:05.563046 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcbb06-038b-48bc-9b96-006ee3592086 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:05.563330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcbb06-038b-48bc-9b96-006ee3592086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:05.563611 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcbb06-038b-48bc-9b96-006ee3592086 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:05.564338 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcbb06-038b-48bc-9b96-006ee3592086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:49:05.564650 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcbb06-038b-48bc-9b96-006ee3592086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:05.566276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcbb06-038b-48bc-9b96-006ee3592086 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:05.581578 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1289/2581] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:49:05.586000 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8c418-f65d-4678-b4bd-7d6363e7f9ba None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:05.596268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8c418-f65d-4678-b4bd-7d6363e7f9ba None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:05.602550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c440a-d5b9-4799-8ed3-8f48610dfbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:05.602858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c440a-d5b9-4799-8ed3-8f48610dfbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:05.602967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c440a-d5b9-4799-8ed3-8f48610dfbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:05.603217 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c440a-d5b9-4799-8ed3-8f48610dfbd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:05.603965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c440a-d5b9-4799-8ed3-8f48610dfbd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:05.605924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c440a-d5b9-4799-8ed3-8f48610dfbd6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:05.722568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1293/2582] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:05 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:05.727747 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcbb06-038b-48bc-9b96-006ee3592086 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:05.741476 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcbb06-038b-48bc-9b96-006ee3592086 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:05.832788 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23edd1d-a081-421f-ab8d-d1ff1c8a197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:05.833468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23edd1d-a081-421f-ab8d-d1ff1c8a197d admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:05.833751 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23edd1d-a081-421f-ab8d-d1ff1c8a197d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:05.834032 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23edd1d-a081-421f-ab8d-d1ff1c8a197d admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:05.834770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23edd1d-a081-421f-ab8d-d1ff1c8a197d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:05.836878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23edd1d-a081-421f-ab8d-d1ff1c8a197d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:05.846415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:05.944318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1290/2583] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:05 2022] POST /identity/v3/users => generated 285 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:05.948331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c440a-d5b9-4799-8ed3-8f48610dfbd6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:05.969150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c440a-d5b9-4799-8ed3-8f48610dfbd6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:05.975323 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002f4eb-aa42-45f3-92e4-dfb3be11085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:05.982117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002f4eb-aa42-45f3-92e4-dfb3be11085b admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:05.982117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002f4eb-aa42-45f3-92e4-dfb3be11085b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:05.982117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002f4eb-aa42-45f3-92e4-dfb3be11085b admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:05.982117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002f4eb-aa42-45f3-92e4-dfb3be11085b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:05.982117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002f4eb-aa42-45f3-92e4-dfb3be11085b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:05.993038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1294/2584] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:05.997221 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23edd1d-a081-421f-ab8d-d1ff1c8a197d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:06.009484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23edd1d-a081-421f-ab8d-d1ff1c8a197d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:06.015905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac38ce7-0d19-4d05-88ba-39093623485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:06.016722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac38ce7-0d19-4d05-88ba-39093623485d admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:06.017102 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac38ce7-0d19-4d05-88ba-39093623485d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:06.019098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac38ce7-0d19-4d05-88ba-39093623485d admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:06.019098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac38ce7-0d19-4d05-88ba-39093623485d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:06.020937 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac38ce7-0d19-4d05-88ba-39093623485d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:06.034239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1291/2585] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:06.039563 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002f4eb-aa42-45f3-92e4-dfb3be11085b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:06.053448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002f4eb-aa42-45f3-92e4-dfb3be11085b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:06.061833 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1080689-2390-4888-bbc3-1283cad6481a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:06.063453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1080689-2390-4888-bbc3-1283cad6481a admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:06.063952 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1080689-2390-4888-bbc3-1283cad6481a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:06.064436 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1080689-2390-4888-bbc3-1283cad6481a admin admin] PATH_INFO: `/v3/projects/2d50064b2e2c4e9a967b3753675cf4a5/users/47cc578e483c47a5967308ac5c977ab7/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:06.083373 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1080689-2390-4888-bbc3-1283cad6481a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d50064b2e2c4e9a967b3753675cf4a5, user_id=47cc578e483c47a5967308ac5c977ab7, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:06.086574 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1080689-2390-4888-bbc3-1283cad6481a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:06.229510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1295/2586] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:06 2022] PUT /identity/v3/projects/2d50064b2e2c4e9a967b3753675cf4a5/users/47cc578e483c47a5967308ac5c977ab7/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:06.232827 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daced60-142b-4248-8efd-2a3fcdc5e859 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:06.233700 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daced60-142b-4248-8efd-2a3fcdc5e859 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:06.234159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daced60-142b-4248-8efd-2a3fcdc5e859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:06.293438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6daced60-142b-4248-8efd-2a3fcdc5e859 None None] MFA Rules not processed for user `47cc578e483c47a5967308ac5c977ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:06.296225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6daced60-142b-4248-8efd-2a3fcdc5e859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:06.394465 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1292/2587] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:06.413117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1080689-2390-4888-bbc3-1283cad6481a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:06.420821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a1080689-2390-4888-bbc3-1283cad6481a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:06.470561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:06.544254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1080689-2390-4888-bbc3-1283cad6481a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:06.548753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96667b52-db4b-4d0c-890e-d1a44e9f4671 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f93de99555742ca9bd99d707d1cdbee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:06.549676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96667b52-db4b-4d0c-890e-d1a44e9f4671 service glance] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:06.550189 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96667b52-db4b-4d0c-890e-d1a44e9f4671 service glance] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:06.550732 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96667b52-db4b-4d0c-890e-d1a44e9f4671 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:06.563369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96667b52-db4b-4d0c-890e-d1a44e9f4671 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:06.564961 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96667b52-db4b-4d0c-890e-d1a44e9f4671 service glance] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:06.580799 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1296/2588] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:11.681128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daced60-142b-4248-8efd-2a3fcdc5e859 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:11.684904 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6daced60-142b-4248-8efd-2a3fcdc5e859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:11.757034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daced60-142b-4248-8efd-2a3fcdc5e859 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:11.763721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e0a47-d84e-47fc-abeb-4ea6ba36239a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:11.764655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e0a47-d84e-47fc-abeb-4ea6ba36239a service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:11.765115 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e0a47-d84e-47fc-abeb-4ea6ba36239a service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:11.765448 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e0a47-d84e-47fc-abeb-4ea6ba36239a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:11.768396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-592e0a47-d84e-47fc-abeb-4ea6ba36239a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:11.855575 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e0a47-d84e-47fc-abeb-4ea6ba36239a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:11.859861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e0a47-d84e-47fc-abeb-4ea6ba36239a service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:11.871563 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1293/2589] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:49:14.772330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141e59e-df30-4a57-bac9-4aea28b9d658 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:14.775815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141e59e-df30-4a57-bac9-4aea28b9d658 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:14.775815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141e59e-df30-4a57-bac9-4aea28b9d658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:14.795613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f141e59e-df30-4a57-bac9-4aea28b9d658 None None] MFA Rules not processed for user `6ab418830d774189899baaf615001e47`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:14.796858 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f141e59e-df30-4a57-bac9-4aea28b9d658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:14.859254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1297/2590] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:16.524863 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e0a47-d84e-47fc-abeb-4ea6ba36239a service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:16.526435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-592e0a47-d84e-47fc-abeb-4ea6ba36239a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:16.545275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e0a47-d84e-47fc-abeb-4ea6ba36239a service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:16.550255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f854771-4775-421f-bdb2-585adfb679f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:16.551321 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f854771-4775-421f-bdb2-585adfb679f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:16.551597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f854771-4775-421f-bdb2-585adfb679f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:16.551876 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f854771-4775-421f-bdb2-585adfb679f4 admin admin] PATH_INFO: `/v3/users/649b66b27ef44ad5b218f6e8bb790963` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:16.553170 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f854771-4775-421f-bdb2-585adfb679f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=649b66b27ef44ad5b218f6e8bb790963)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:16.555083 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f854771-4775-421f-bdb2-585adfb679f4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:16.573923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:DELETE=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:16.988256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8f854771-4775-421f-bdb2-585adfb679f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649b66b27ef44ad5b218f6e8bb790963'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.147299 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8f854771-4775-421f-bdb2-585adfb679f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649b66b27ef44ad5b218f6e8bb790963'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.158167 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8f854771-4775-421f-bdb2-585adfb679f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649b66b27ef44ad5b218f6e8bb790963'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.158973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8f854771-4775-421f-bdb2-585adfb679f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649b66b27ef44ad5b218f6e8bb790963'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.174673 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8f854771-4775-421f-bdb2-585adfb679f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649b66b27ef44ad5b218f6e8bb790963'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.181755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1294/2591] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:16 2022] DELETE /identity/v3/users/649b66b27ef44ad5b218f6e8bb790963 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:17.550804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141e59e-df30-4a57-bac9-4aea28b9d658 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:17.576790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141e59e-df30-4a57-bac9-4aea28b9d658 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:17.673439 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923b23e-225c-43c4-ad03-4c7343320384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:17.675084 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923b23e-225c-43c4-ad03-4c7343320384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:17.675584 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923b23e-225c-43c4-ad03-4c7343320384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:17.675980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923b23e-225c-43c4-ad03-4c7343320384 admin admin] PATH_INFO: `/v3/projects/046e211ba15a408190bff2e5d979c544` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:17.678106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923b23e-225c-43c4-ad03-4c7343320384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=046e211ba15a408190bff2e5d979c544)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:17.682085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923b23e-225c-43c4-ad03-4c7343320384 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:17.850808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9923b23e-225c-43c4-ad03-4c7343320384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046e211ba15a408190bff2e5d979c544', 'request_id': 'req-9923b23e-225c-43c4-ad03-4c7343320384'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.860383 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9923b23e-225c-43c4-ad03-4c7343320384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046e211ba15a408190bff2e5d979c544', 'request_id': 'req-9923b23e-225c-43c4-ad03-4c7343320384'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.868285 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9923b23e-225c-43c4-ad03-4c7343320384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046e211ba15a408190bff2e5d979c544', 'request_id': 'req-9923b23e-225c-43c4-ad03-4c7343320384'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.984405 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9923b23e-225c-43c4-ad03-4c7343320384 admin admin] The token cache is being invalidate because project 046e211ba15a408190bff2e5d979c544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:17.986561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9923b23e-225c-43c4-ad03-4c7343320384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.986561 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9923b23e-225c-43c4-ad03-4c7343320384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.988468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1298/2592] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:17 2022] DELETE /identity/v3/projects/046e211ba15a408190bff2e5d979c544 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:17.994596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58de219-04d8-41a7-970b-eafe6dc9a0b2 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:17.995185 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58de219-04d8-41a7-970b-eafe6dc9a0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:17.995185 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58de219-04d8-41a7-970b-eafe6dc9a0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:18.020915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b58de219-04d8-41a7-970b-eafe6dc9a0b2 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:18.020915 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b58de219-04d8-41a7-970b-eafe6dc9a0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:18.100768 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1295/2593] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:18.104318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93615270-95eb-46db-a369-b873fde83a71 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:18.104671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93615270-95eb-46db-a369-b873fde83a71 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:18.105050 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93615270-95eb-46db-a369-b873fde83a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:18.112421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:18.125695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-93615270-95eb-46db-a369-b873fde83a71 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:18.126964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-93615270-95eb-46db-a369-b873fde83a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:18.136170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1299/2594] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:18.142116 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58de219-04d8-41a7-970b-eafe6dc9a0b2 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:18.152144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58de219-04d8-41a7-970b-eafe6dc9a0b2 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:18.157505 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f1ea8-c3d2-464b-814a-d59e831bb974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:18.158164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f1ea8-c3d2-464b-814a-d59e831bb974 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:18.158497 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f1ea8-c3d2-464b-814a-d59e831bb974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:18.158783 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f1ea8-c3d2-464b-814a-d59e831bb974 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:18.159512 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f1ea8-c3d2-464b-814a-d59e831bb974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:49:18.160011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f1ea8-c3d2-464b-814a-d59e831bb974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:18.161635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f1ea8-c3d2-464b-814a-d59e831bb974 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:18.175727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1296/2595] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:49:18.180239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93615270-95eb-46db-a369-b873fde83a71 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:18.191170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93615270-95eb-46db-a369-b873fde83a71 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:18.196165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab27b1-b49f-4a9d-9c9a-d968454a669d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:18.196831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab27b1-b49f-4a9d-9c9a-d968454a669d admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:18.197201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab27b1-b49f-4a9d-9c9a-d968454a669d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:18.197474 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab27b1-b49f-4a9d-9c9a-d968454a669d admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:18.198163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab27b1-b49f-4a9d-9c9a-d968454a669d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:18.200216 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab27b1-b49f-4a9d-9c9a-d968454a669d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:18.395303 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1300/2596] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:18 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:18.397096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f1ea8-c3d2-464b-814a-d59e831bb974 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:18.413564 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f1ea8-c3d2-464b-814a-d59e831bb974 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:18.517538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb1ca-ee72-4f21-9af4-a1168d9afd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:18.518397 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb1ca-ee72-4f21-9af4-a1168d9afd54 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:18.518831 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb1ca-ee72-4f21-9af4-a1168d9afd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:18.519280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb1ca-ee72-4f21-9af4-a1168d9afd54 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:18.520225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaeb1ca-ee72-4f21-9af4-a1168d9afd54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:18.522539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaeb1ca-ee72-4f21-9af4-a1168d9afd54 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:18.645533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1297/2597] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:18 2022] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:18.650618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab27b1-b49f-4a9d-9c9a-d968454a669d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:18.662855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab27b1-b49f-4a9d-9c9a-d968454a669d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:18.667530 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccdf78-e8c8-4317-89d2-731b13b9bc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:18.668197 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccdf78-e8c8-4317-89d2-731b13b9bc39 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:18.668478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccdf78-e8c8-4317-89d2-731b13b9bc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:18.669009 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccdf78-e8c8-4317-89d2-731b13b9bc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:18.669853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccdf78-e8c8-4317-89d2-731b13b9bc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:18.671533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccdf78-e8c8-4317-89d2-731b13b9bc39 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:18.686385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1301/2598] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:18.688948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb1ca-ee72-4f21-9af4-a1168d9afd54 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:18.699434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb1ca-ee72-4f21-9af4-a1168d9afd54 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:18.704351 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861082d4-6c7a-457e-8034-d270eb4ac80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:18.705120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861082d4-6c7a-457e-8034-d270eb4ac80e admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:18.705461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861082d4-6c7a-457e-8034-d270eb4ac80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:18.705811 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861082d4-6c7a-457e-8034-d270eb4ac80e admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:18.706585 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861082d4-6c7a-457e-8034-d270eb4ac80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:18.708273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861082d4-6c7a-457e-8034-d270eb4ac80e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:18.711755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:18.723866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1298/2599] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:18.728857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccdf78-e8c8-4317-89d2-731b13b9bc39 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:18.743275 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccdf78-e8c8-4317-89d2-731b13b9bc39 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:18.749924 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dee878-b828-4552-9e3c-03cd0d1d74ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:18.750875 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dee878-b828-4552-9e3c-03cd0d1d74ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:18.751158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dee878-b828-4552-9e3c-03cd0d1d74ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:18.751468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dee878-b828-4552-9e3c-03cd0d1d74ac admin admin] PATH_INFO: `/v3/projects/e777409cdb8d47a893daf1cced54e768/users/b355f8c92a084d65b988fd8fa83622d9/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:18.768896 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dee878-b828-4552-9e3c-03cd0d1d74ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e777409cdb8d47a893daf1cced54e768, user_id=b355f8c92a084d65b988fd8fa83622d9, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:18.771758 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dee878-b828-4552-9e3c-03cd0d1d74ac admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:18.945670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1302/2600] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:18 2022] PUT /identity/v3/projects/e777409cdb8d47a893daf1cced54e768/users/b355f8c92a084d65b988fd8fa83622d9/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:18.966430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f17cf4-19e3-4ce8-aa77-137a755339ef None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:18.967973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f17cf4-19e3-4ce8-aa77-137a755339ef None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:18.968640 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f17cf4-19e3-4ce8-aa77-137a755339ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:19.004979 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-25f17cf4-19e3-4ce8-aa77-137a755339ef None None] MFA Rules not processed for user `b355f8c92a084d65b988fd8fa83622d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:19.006469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-25f17cf4-19e3-4ce8-aa77-137a755339ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:19.086023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1299/2601] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:19.098163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dee878-b828-4552-9e3c-03cd0d1d74ac admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:19.110496 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a3dee878-b828-4552-9e3c-03cd0d1d74ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:19.272031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dee878-b828-4552-9e3c-03cd0d1d74ac admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:19.279978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e6491-4d07-475e-9ac8-fbde59b4a0b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:19.283152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e6491-4d07-475e-9ac8-fbde59b4a0b2 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:19.283152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e6491-4d07-475e-9ac8-fbde59b4a0b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:19.283152 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e6491-4d07-475e-9ac8-fbde59b4a0b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:19.290174 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e6491-4d07-475e-9ac8-fbde59b4a0b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:19.291823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e6491-4d07-475e-9ac8-fbde59b4a0b2 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:19.305766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1303/2602] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:26.263539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f17cf4-19e3-4ce8-aa77-137a755339ef None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:26.346623 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f17cf4-19e3-4ce8-aa77-137a755339ef None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:26.351529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36569408-1445-4a23-a7b1-0db825574fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:26.352414 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36569408-1445-4a23-a7b1-0db825574fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:26.352695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36569408-1445-4a23-a7b1-0db825574fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:26.352968 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36569408-1445-4a23-a7b1-0db825574fb3 admin admin] PATH_INFO: `/v3/users/b355f8c92a084d65b988fd8fa83622d9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:26.354183 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36569408-1445-4a23-a7b1-0db825574fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b355f8c92a084d65b988fd8fa83622d9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:26.356719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36569408-1445-4a23-a7b1-0db825574fb3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:26.711231 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36569408-1445-4a23-a7b1-0db825574fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b355f8c92a084d65b988fd8fa83622d9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:26.849707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36569408-1445-4a23-a7b1-0db825574fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b355f8c92a084d65b988fd8fa83622d9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:26.873391 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36569408-1445-4a23-a7b1-0db825574fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b355f8c92a084d65b988fd8fa83622d9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:26.874656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36569408-1445-4a23-a7b1-0db825574fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b355f8c92a084d65b988fd8fa83622d9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:26.902285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36569408-1445-4a23-a7b1-0db825574fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b355f8c92a084d65b988fd8fa83622d9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:26.915198 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1300/2603] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:26 2022] DELETE /identity/v3/users/b355f8c92a084d65b988fd8fa83622d9 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:26.922310 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c65085-7b11-4b3b-a1ae-9e12792d487d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:26.922900 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c65085-7b11-4b3b-a1ae-9e12792d487d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:26.923099 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c65085-7b11-4b3b-a1ae-9e12792d487d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:26.951577 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-16c65085-7b11-4b3b-a1ae-9e12792d487d None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:26.953656 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-16c65085-7b11-4b3b-a1ae-9e12792d487d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:27.042524 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1304/2604] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:27.055384 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36569408-1445-4a23-a7b1-0db825574fb3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:27.057230 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-36569408-1445-4a23-a7b1-0db825574fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:27.069084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:27.133861 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36569408-1445-4a23-a7b1-0db825574fb3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:27.138692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f384fa-36bc-42bf-9fbe-f28d372f912c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:27.140059 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f384fa-36bc-42bf-9fbe-f28d372f912c service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:27.140562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f384fa-36bc-42bf-9fbe-f28d372f912c service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:27.141052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f384fa-36bc-42bf-9fbe-f28d372f912c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:27.154155 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f384fa-36bc-42bf-9fbe-f28d372f912c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:27.156500 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f384fa-36bc-42bf-9fbe-f28d372f912c service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:27.171597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1301/2605] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:27.751774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c65085-7b11-4b3b-a1ae-9e12792d487d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:27.753303 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-16c65085-7b11-4b3b-a1ae-9e12792d487d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:27.762999 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:27.768994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c65085-7b11-4b3b-a1ae-9e12792d487d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:27.774728 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc6630-95dd-4be1-8d1c-4752cad4eb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:27.775878 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc6630-95dd-4be1-8d1c-4752cad4eb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:27.776262 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc6630-95dd-4be1-8d1c-4752cad4eb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:27.776679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc6630-95dd-4be1-8d1c-4752cad4eb45 admin admin] PATH_INFO: `/v3/projects/e777409cdb8d47a893daf1cced54e768` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:27.779203 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc6630-95dd-4be1-8d1c-4752cad4eb45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e777409cdb8d47a893daf1cced54e768)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:27.781861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc6630-95dd-4be1-8d1c-4752cad4eb45 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:27.935997 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-27dc6630-95dd-4be1-8d1c-4752cad4eb45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e777409cdb8d47a893daf1cced54e768', 'request_id': 'req-27dc6630-95dd-4be1-8d1c-4752cad4eb45'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:27.943081 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-27dc6630-95dd-4be1-8d1c-4752cad4eb45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e777409cdb8d47a893daf1cced54e768', 'request_id': 'req-27dc6630-95dd-4be1-8d1c-4752cad4eb45'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:27.948958 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-27dc6630-95dd-4be1-8d1c-4752cad4eb45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e777409cdb8d47a893daf1cced54e768', 'request_id': 'req-27dc6630-95dd-4be1-8d1c-4752cad4eb45'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:28.058955 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-27dc6630-95dd-4be1-8d1c-4752cad4eb45 admin admin] The token cache is being invalidate because project e777409cdb8d47a893daf1cced54e768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:28.059239 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-27dc6630-95dd-4be1-8d1c-4752cad4eb45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:28.061389 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-27dc6630-95dd-4be1-8d1c-4752cad4eb45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:28.064188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1305/2606] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:27 2022] DELETE /identity/v3/projects/e777409cdb8d47a893daf1cced54e768 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:28.072067 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119aa17-9861-465d-82f3-a83adcc11fe7 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:28.072670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119aa17-9861-465d-82f3-a83adcc11fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:28.073119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119aa17-9861-465d-82f3-a83adcc11fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:28.109584 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d119aa17-9861-465d-82f3-a83adcc11fe7 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:28.111698 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d119aa17-9861-465d-82f3-a83adcc11fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:28.186712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1302/2607] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:28.195127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99726c61-7294-4c54-a22e-2608ac815a4e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:28.195558 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99726c61-7294-4c54-a22e-2608ac815a4e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:28.195839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99726c61-7294-4c54-a22e-2608ac815a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:28.216978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-99726c61-7294-4c54-a22e-2608ac815a4e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:28.218201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-99726c61-7294-4c54-a22e-2608ac815a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:28.230682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1306/2608] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:28.236131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119aa17-9861-465d-82f3-a83adcc11fe7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:28.249196 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119aa17-9861-465d-82f3-a83adcc11fe7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:28.254466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536da716-604d-499a-a6c1-89a1152e06bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:28.255263 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536da716-604d-499a-a6c1-89a1152e06bc admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:28.255552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536da716-604d-499a-a6c1-89a1152e06bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:28.255831 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536da716-604d-499a-a6c1-89a1152e06bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:28.256573 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536da716-604d-499a-a6c1-89a1152e06bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:49:28.256881 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536da716-604d-499a-a6c1-89a1152e06bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:28.258766 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536da716-604d-499a-a6c1-89a1152e06bc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:28.273007 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1303/2609] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:49:28.278169 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99726c61-7294-4c54-a22e-2608ac815a4e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:28.288229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99726c61-7294-4c54-a22e-2608ac815a4e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:28.293766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2346d-f709-433f-baa9-561845b7e1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:28.294506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2346d-f709-433f-baa9-561845b7e1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:28.294788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2346d-f709-433f-baa9-561845b7e1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:28.295300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2346d-f709-433f-baa9-561845b7e1f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:28.296064 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2346d-f709-433f-baa9-561845b7e1f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:28.297990 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2346d-f709-433f-baa9-561845b7e1f4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:28.406811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1307/2610] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:28 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:28.416485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536da716-604d-499a-a6c1-89a1152e06bc admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:28.430438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536da716-604d-499a-a6c1-89a1152e06bc admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:28.514869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4262e-ec27-438d-bbaa-44b6f675c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:28.515554 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4262e-ec27-438d-bbaa-44b6f675c4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:28.515841 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4262e-ec27-438d-bbaa-44b6f675c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:28.516254 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4262e-ec27-438d-bbaa-44b6f675c4e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:28.516866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4262e-ec27-438d-bbaa-44b6f675c4e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:28.518860 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4262e-ec27-438d-bbaa-44b6f675c4e8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:28.701540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1304/2611] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:28 2022] POST /identity/v3/users => generated 303 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:49:28.705733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2346d-f709-433f-baa9-561845b7e1f4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:28.718586 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2346d-f709-433f-baa9-561845b7e1f4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:28.724196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4124-e7c6-4eab-bc7d-a31ad5353ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:28.724994 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4124-e7c6-4eab-bc7d-a31ad5353ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:28.725325 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4124-e7c6-4eab-bc7d-a31ad5353ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:28.725641 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4124-e7c6-4eab-bc7d-a31ad5353ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:28.726577 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf4124-e7c6-4eab-bc7d-a31ad5353ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:28.728961 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf4124-e7c6-4eab-bc7d-a31ad5353ea9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:28.745886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1308/2612] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:28.751745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4262e-ec27-438d-bbaa-44b6f675c4e8 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:28.766078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4262e-ec27-438d-bbaa-44b6f675c4e8 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:28.774069 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080048ea-a678-428f-a0e4-f4e490697bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:28.774926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080048ea-a678-428f-a0e4-f4e490697bad admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:28.775301 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080048ea-a678-428f-a0e4-f4e490697bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:28.775698 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080048ea-a678-428f-a0e4-f4e490697bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:28.776542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080048ea-a678-428f-a0e4-f4e490697bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:28.779260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080048ea-a678-428f-a0e4-f4e490697bad admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:28.791190 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1305/2613] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:28.796940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4124-e7c6-4eab-bc7d-a31ad5353ea9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:28.807843 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4124-e7c6-4eab-bc7d-a31ad5353ea9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:28.815154 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209f014-3ad4-416a-bddb-279aebed3d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:28.816305 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209f014-3ad4-416a-bddb-279aebed3d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:28.816774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209f014-3ad4-416a-bddb-279aebed3d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:28.817138 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209f014-3ad4-416a-bddb-279aebed3d79 admin admin] PATH_INFO: `/v3/projects/fa04ca55a06b4dcc9dac71d95d424fa1/users/ebd21e76a1334b318e19000fbf1864d6/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:28.834717 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209f014-3ad4-416a-bddb-279aebed3d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa04ca55a06b4dcc9dac71d95d424fa1, user_id=ebd21e76a1334b318e19000fbf1864d6, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:28.838234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209f014-3ad4-416a-bddb-279aebed3d79 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:28.933207 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1309/2614] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:28 2022] PUT /identity/v3/projects/fa04ca55a06b4dcc9dac71d95d424fa1/users/ebd21e76a1334b318e19000fbf1864d6/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:28.945631 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93fae9-0a83-43be-875d-8d9dedd0ba4b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:28.946106 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93fae9-0a83-43be-875d-8d9dedd0ba4b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:28.946539 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93fae9-0a83-43be-875d-8d9dedd0ba4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:28.980687 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ed93fae9-0a83-43be-875d-8d9dedd0ba4b None None] MFA Rules not processed for user `ebd21e76a1334b318e19000fbf1864d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:28.988259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ed93fae9-0a83-43be-875d-8d9dedd0ba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:29.070337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1306/2615] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:29.075919 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209f014-3ad4-416a-bddb-279aebed3d79 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:29.149886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209f014-3ad4-416a-bddb-279aebed3d79 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:29.156004 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6d353-414c-4663-ae41-0d81fff6d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:29.160687 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6d353-414c-4663-ae41-0d81fff6d865 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:29.160687 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6d353-414c-4663-ae41-0d81fff6d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:29.160687 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6d353-414c-4663-ae41-0d81fff6d865 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:29.160687 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6d353-414c-4663-ae41-0d81fff6d865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:29.160687 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6d353-414c-4663-ae41-0d81fff6d865 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:29.286414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1310/2616] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:29 2022] POST /identity/v3/projects => generated 405 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:29.287662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93fae9-0a83-43be-875d-8d9dedd0ba4b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:29.300465 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93fae9-0a83-43be-875d-8d9dedd0ba4b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:29.330587 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:29.397162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b4bac-67d8-4765-bfd8-29f1f4ad9922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:29.398249 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b4bac-67d8-4765-bfd8-29f1f4ad9922 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:29.398876 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b4bac-67d8-4765-bfd8-29f1f4ad9922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:29.399512 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b4bac-67d8-4765-bfd8-29f1f4ad9922 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:29.400570 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b4bac-67d8-4765-bfd8-29f1f4ad9922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:29.404942 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b4bac-67d8-4765-bfd8-29f1f4ad9922 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:29.513497 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1307/2617] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:29 2022] POST /identity/v3/users => generated 309 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:49:29.519206 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6d353-414c-4663-ae41-0d81fff6d865 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:29.537730 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6d353-414c-4663-ae41-0d81fff6d865 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:29.545236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e6765-f7ff-41e2-8b03-fe5cc2c7391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:29.546370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e6765-f7ff-41e2-8b03-fe5cc2c7391c admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:29.546808 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e6765-f7ff-41e2-8b03-fe5cc2c7391c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:29.547220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e6765-f7ff-41e2-8b03-fe5cc2c7391c admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:29.548134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e6765-f7ff-41e2-8b03-fe5cc2c7391c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:29.550257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e6765-f7ff-41e2-8b03-fe5cc2c7391c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:29.553499 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:29.568682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1311/2618] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:29.570434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b4bac-67d8-4765-bfd8-29f1f4ad9922 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:29.582547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b4bac-67d8-4765-bfd8-29f1f4ad9922 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:29.588171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6b928-5c8b-4681-8bbf-3acf2480b2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:29.589101 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6b928-5c8b-4681-8bbf-3acf2480b2f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:29.589386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6b928-5c8b-4681-8bbf-3acf2480b2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:29.589659 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6b928-5c8b-4681-8bbf-3acf2480b2f2 admin admin] PATH_INFO: `/v3/projects/5d4eedb45e704eec9fe0bc4521768d39/users/74d52909238f4a88864d526c0462c9a8/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:29.622641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6b928-5c8b-4681-8bbf-3acf2480b2f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4eedb45e704eec9fe0bc4521768d39, user_id=74d52909238f4a88864d526c0462c9a8, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:29.628495 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6b928-5c8b-4681-8bbf-3acf2480b2f2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:29.714598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1308/2619] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:29 2022] PUT /identity/v3/projects/5d4eedb45e704eec9fe0bc4521768d39/users/74d52909238f4a88864d526c0462c9a8/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:29.720400 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e6765-f7ff-41e2-8b03-fe5cc2c7391c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:29.732497 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e6765-f7ff-41e2-8b03-fe5cc2c7391c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:29.801716 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e570d-8b60-4d58-9a67-f3bf8cc2f0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:29.802440 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e570d-8b60-4d58-9a67-f3bf8cc2f0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:29.802730 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e570d-8b60-4d58-9a67-f3bf8cc2f0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:29.803011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e570d-8b60-4d58-9a67-f3bf8cc2f0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:29.803751 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e570d-8b60-4d58-9a67-f3bf8cc2f0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:29.805426 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e570d-8b60-4d58-9a67-f3bf8cc2f0e0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:29.822233 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1312/2620] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:29.827978 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6b928-5c8b-4681-8bbf-3acf2480b2f2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:29.839293 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6b928-5c8b-4681-8bbf-3acf2480b2f2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:29.846399 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c63d69-422d-4a21-bc44-c01b9a13d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:29.847414 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c63d69-422d-4a21-bc44-c01b9a13d52a admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:29.847806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c63d69-422d-4a21-bc44-c01b9a13d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:29.848181 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c63d69-422d-4a21-bc44-c01b9a13d52a admin admin] PATH_INFO: `/v3/projects/5d4eedb45e704eec9fe0bc4521768d39/users/74d52909238f4a88864d526c0462c9a8/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:29.850870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c63d69-422d-4a21-bc44-c01b9a13d52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4eedb45e704eec9fe0bc4521768d39, user_id=74d52909238f4a88864d526c0462c9a8, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:29.854758 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c63d69-422d-4a21-bc44-c01b9a13d52a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:29.869589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1309/2621] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:29 2022] PUT /identity/v3/projects/5d4eedb45e704eec9fe0bc4521768d39/users/74d52909238f4a88864d526c0462c9a8/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:29.884272 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ce20d-c247-430c-9a8d-3ca9a2fbfd08 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:29.884598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ce20d-c247-430c-9a8d-3ca9a2fbfd08 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:29.884816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ce20d-c247-430c-9a8d-3ca9a2fbfd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:29.917286 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6f1ce20d-c247-430c-9a8d-3ca9a2fbfd08 None None] MFA Rules not processed for user `74d52909238f4a88864d526c0462c9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:29.918834 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6f1ce20d-c247-430c-9a8d-3ca9a2fbfd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:30.030449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1313/2622] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:30.044013 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c63d69-422d-4a21-bc44-c01b9a13d52a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:30.046639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f0c63d69-422d-4a21-bc44-c01b9a13d52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:30.129030 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c63d69-422d-4a21-bc44-c01b9a13d52a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:30.132927 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f5a10-5c6f-4ebf-b4d9-32bc22d76e31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:30.133634 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f5a10-5c6f-4ebf-b4d9-32bc22d76e31 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:30.133918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f5a10-5c6f-4ebf-b4d9-32bc22d76e31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:30.134195 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f5a10-5c6f-4ebf-b4d9-32bc22d76e31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:30.145682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f5a10-5c6f-4ebf-b4d9-32bc22d76e31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:30.147293 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f5a10-5c6f-4ebf-b4d9-32bc22d76e31 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:30.164482 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1310/2623] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:30 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:30.316516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ce20d-c247-430c-9a8d-3ca9a2fbfd08 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:30.396076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ce20d-c247-430c-9a8d-3ca9a2fbfd08 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:30.405829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afb176-c522-454f-8e34-12c876713baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:30.406777 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afb176-c522-454f-8e34-12c876713baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:30.407067 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afb176-c522-454f-8e34-12c876713baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:30.407591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afb176-c522-454f-8e34-12c876713baa admin admin] PATH_INFO: `/v3/users/ebd21e76a1334b318e19000fbf1864d6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:30.409014 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afb176-c522-454f-8e34-12c876713baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd21e76a1334b318e19000fbf1864d6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:30.411075 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afb176-c522-454f-8e34-12c876713baa admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:30.667064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:30.734169 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f8afb176-c522-454f-8e34-12c876713baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd21e76a1334b318e19000fbf1864d6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:30.826578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f8afb176-c522-454f-8e34-12c876713baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd21e76a1334b318e19000fbf1864d6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:30.836839 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f8afb176-c522-454f-8e34-12c876713baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd21e76a1334b318e19000fbf1864d6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:30.838102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f8afb176-c522-454f-8e34-12c876713baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd21e76a1334b318e19000fbf1864d6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:30.855246 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f8afb176-c522-454f-8e34-12c876713baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd21e76a1334b318e19000fbf1864d6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:30.865292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1314/2624] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:30 2022] DELETE /identity/v3/users/ebd21e76a1334b318e19000fbf1864d6 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:30.868707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae99f65-7d1f-4b98-9dc5-9f4ca5705694 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:30.868999 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae99f65-7d1f-4b98-9dc5-9f4ca5705694 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:30.869278 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae99f65-7d1f-4b98-9dc5-9f4ca5705694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:30.898917 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8ae99f65-7d1f-4b98-9dc5-9f4ca5705694 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:30.900875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8ae99f65-7d1f-4b98-9dc5-9f4ca5705694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:30.973014 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1311/2625] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:30.985641 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afb176-c522-454f-8e34-12c876713baa admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:30.987489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f8afb176-c522-454f-8e34-12c876713baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:31.042309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:31.070218 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afb176-c522-454f-8e34-12c876713baa admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:31.076976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf2d98-834a-444a-b7eb-b0dd9f2c1e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:31.078132 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2d98-834a-444a-b7eb-b0dd9f2c1e7d service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:31.078655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2d98-834a-444a-b7eb-b0dd9f2c1e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:31.079165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2d98-834a-444a-b7eb-b0dd9f2c1e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:31.097187 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf2d98-834a-444a-b7eb-b0dd9f2c1e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:31.100197 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf2d98-834a-444a-b7eb-b0dd9f2c1e7d service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:31.119227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1315/2626] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:31.811443 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae99f65-7d1f-4b98-9dc5-9f4ca5705694 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:31.813324 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8ae99f65-7d1f-4b98-9dc5-9f4ca5705694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:31.830770 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae99f65-7d1f-4b98-9dc5-9f4ca5705694 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:31.850481 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644ff3d-c8ec-466c-b67e-6e605435c56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:31.851754 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644ff3d-c8ec-466c-b67e-6e605435c56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:31.852212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644ff3d-c8ec-466c-b67e-6e605435c56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:31.852940 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644ff3d-c8ec-466c-b67e-6e605435c56b admin admin] PATH_INFO: `/v3/projects/fa04ca55a06b4dcc9dac71d95d424fa1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:31.854374 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644ff3d-c8ec-466c-b67e-6e605435c56b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa04ca55a06b4dcc9dac71d95d424fa1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:31.857579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644ff3d-c8ec-466c-b67e-6e605435c56b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:32.016699 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2644ff3d-c8ec-466c-b67e-6e605435c56b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa04ca55a06b4dcc9dac71d95d424fa1', 'request_id': 'req-2644ff3d-c8ec-466c-b67e-6e605435c56b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.028888 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2644ff3d-c8ec-466c-b67e-6e605435c56b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa04ca55a06b4dcc9dac71d95d424fa1', 'request_id': 'req-2644ff3d-c8ec-466c-b67e-6e605435c56b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.040518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2644ff3d-c8ec-466c-b67e-6e605435c56b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa04ca55a06b4dcc9dac71d95d424fa1', 'request_id': 'req-2644ff3d-c8ec-466c-b67e-6e605435c56b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.146182 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2644ff3d-c8ec-466c-b67e-6e605435c56b admin admin] The token cache is being invalidate because project fa04ca55a06b4dcc9dac71d95d424fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:32.146510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2644ff3d-c8ec-466c-b67e-6e605435c56b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.147221 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2644ff3d-c8ec-466c-b67e-6e605435c56b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.148845 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1312/2627] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:31 2022] DELETE /identity/v3/projects/fa04ca55a06b4dcc9dac71d95d424fa1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:32.154883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf2d98-834a-444a-b7eb-b0dd9f2c1e7d service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:32.166970 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf2d98-834a-444a-b7eb-b0dd9f2c1e7d service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:32.250469 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de41f0b-732c-49f7-b9e6-0682be527a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:32.251363 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de41f0b-732c-49f7-b9e6-0682be527a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:32.251641 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de41f0b-732c-49f7-b9e6-0682be527a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:32.251913 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de41f0b-732c-49f7-b9e6-0682be527a3c admin admin] PATH_INFO: `/v3/users/74d52909238f4a88864d526c0462c9a8` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:32.253469 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de41f0b-732c-49f7-b9e6-0682be527a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d52909238f4a88864d526c0462c9a8)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:32.255604 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de41f0b-732c-49f7-b9e6-0682be527a3c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:32.545569 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:32.548325 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4de41f0b-732c-49f7-b9e6-0682be527a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d52909238f4a88864d526c0462c9a8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.616610 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644ff3d-c8ec-466c-b67e-6e605435c56b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:32.618716 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2644ff3d-c8ec-466c-b67e-6e605435c56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:32.633812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644ff3d-c8ec-466c-b67e-6e605435c56b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:32.640682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0475c-11ab-4a6d-99b4-9f0a7d9ede51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:32.641150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0475c-11ab-4a6d-99b4-9f0a7d9ede51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:32.641438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0475c-11ab-4a6d-99b4-9f0a7d9ede51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:32.641803 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0475c-11ab-4a6d-99b4-9f0a7d9ede51 admin admin] PATH_INFO: `/v3/users/47cc578e483c47a5967308ac5c977ab7` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:32.644464 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0475c-11ab-4a6d-99b4-9f0a7d9ede51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47cc578e483c47a5967308ac5c977ab7)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:32.645308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0475c-11ab-4a6d-99b4-9f0a7d9ede51 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:32.678069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4de41f0b-732c-49f7-b9e6-0682be527a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d52909238f4a88864d526c0462c9a8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.695338 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4de41f0b-732c-49f7-b9e6-0682be527a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d52909238f4a88864d526c0462c9a8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.696541 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4de41f0b-732c-49f7-b9e6-0682be527a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d52909238f4a88864d526c0462c9a8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.715809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4de41f0b-732c-49f7-b9e6-0682be527a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d52909238f4a88864d526c0462c9a8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.723486 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1316/2628] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:32 2022] DELETE /identity/v3/users/74d52909238f4a88864d526c0462c9a8 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:32.889349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e6e0475c-11ab-4a6d-99b4-9f0a7d9ede51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47cc578e483c47a5967308ac5c977ab7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.964171 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e6e0475c-11ab-4a6d-99b4-9f0a7d9ede51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47cc578e483c47a5967308ac5c977ab7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.978460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e6e0475c-11ab-4a6d-99b4-9f0a7d9ede51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47cc578e483c47a5967308ac5c977ab7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.980356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e6e0475c-11ab-4a6d-99b4-9f0a7d9ede51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47cc578e483c47a5967308ac5c977ab7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:33.012430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:33.014297 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e6e0475c-11ab-4a6d-99b4-9f0a7d9ede51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47cc578e483c47a5967308ac5c977ab7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:33.021582 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1313/2629] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:32 2022] DELETE /identity/v3/users/47cc578e483c47a5967308ac5c977ab7 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:33.039760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a8bad-774b-4e1d-9ebf-beb317d7ee8e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:33.040393 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a8bad-774b-4e1d-9ebf-beb317d7ee8e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:33.040671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a8bad-774b-4e1d-9ebf-beb317d7ee8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:33.063177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3c9a8bad-774b-4e1d-9ebf-beb317d7ee8e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:33.064621 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3c9a8bad-774b-4e1d-9ebf-beb317d7ee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:33.154539 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1317/2630] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:33.166165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0475c-11ab-4a6d-99b4-9f0a7d9ede51 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:33.169191 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e6e0475c-11ab-4a6d-99b4-9f0a7d9ede51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:33.299596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0475c-11ab-4a6d-99b4-9f0a7d9ede51 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:33.306609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efc90a-f4fb-4479-b763-4fa70f2dfe2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:33.307765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc90a-f4fb-4479-b763-4fa70f2dfe2f service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:33.308274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc90a-f4fb-4479-b763-4fa70f2dfe2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:33.309343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc90a-f4fb-4479-b763-4fa70f2dfe2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:33.327374 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efc90a-f4fb-4479-b763-4fa70f2dfe2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:33.330187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efc90a-f4fb-4479-b763-4fa70f2dfe2f service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:33.352865 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1314/2631] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:33.473644 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a8bad-774b-4e1d-9ebf-beb317d7ee8e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:33.476513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3c9a8bad-774b-4e1d-9ebf-beb317d7ee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:33.503089 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a8bad-774b-4e1d-9ebf-beb317d7ee8e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:33.515234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b08b87-1768-4b11-bfc8-518252639de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:33.516873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b08b87-1768-4b11-bfc8-518252639de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:33.517359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b08b87-1768-4b11-bfc8-518252639de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:33.518816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b08b87-1768-4b11-bfc8-518252639de2 admin admin] PATH_INFO: `/v3/projects/5d4eedb45e704eec9fe0bc4521768d39` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:33.522075 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b08b87-1768-4b11-bfc8-518252639de2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4eedb45e704eec9fe0bc4521768d39)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:33.526056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b08b87-1768-4b11-bfc8-518252639de2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:33.720448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-58b08b87-1768-4b11-bfc8-518252639de2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4eedb45e704eec9fe0bc4521768d39', 'request_id': 'req-58b08b87-1768-4b11-bfc8-518252639de2'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:33.728552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-58b08b87-1768-4b11-bfc8-518252639de2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4eedb45e704eec9fe0bc4521768d39', 'request_id': 'req-58b08b87-1768-4b11-bfc8-518252639de2'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:33.736872 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-58b08b87-1768-4b11-bfc8-518252639de2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4eedb45e704eec9fe0bc4521768d39', 'request_id': 'req-58b08b87-1768-4b11-bfc8-518252639de2'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:33.835507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-58b08b87-1768-4b11-bfc8-518252639de2 admin admin] The token cache is being invalidate because project 5d4eedb45e704eec9fe0bc4521768d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:33.835891 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-58b08b87-1768-4b11-bfc8-518252639de2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:33.836988 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-58b08b87-1768-4b11-bfc8-518252639de2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:33.840793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1318/2632] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:33 2022] DELETE /identity/v3/projects/5d4eedb45e704eec9fe0bc4521768d39 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:33.848399 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb0b84-095b-4ef9-b217-e740dd01558f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:33.849054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb0b84-095b-4ef9-b217-e740dd01558f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:33.856591 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb0b84-095b-4ef9-b217-e740dd01558f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:33.872434 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-5ceb0b84-095b-4ef9-b217-e740dd01558f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:33.874364 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5ceb0b84-095b-4ef9-b217-e740dd01558f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:33.969981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1315/2633] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:33.984698 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd16269-2feb-485d-bfdb-c2eaff5c37b8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:33.985173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd16269-2feb-485d-bfdb-c2eaff5c37b8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:33.985665 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd16269-2feb-485d-bfdb-c2eaff5c37b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.011186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0cd16269-2feb-485d-bfdb-c2eaff5c37b8 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:34.012983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0cd16269-2feb-485d-bfdb-c2eaff5c37b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:34.021679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1319/2634] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:34.026653 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb0b84-095b-4ef9-b217-e740dd01558f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.037348 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb0b84-095b-4ef9-b217-e740dd01558f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.044891 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89f364-0b99-4435-ade2-ff07ab3b0db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.045773 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89f364-0b99-4435-ade2-ff07ab3b0db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.053354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89f364-0b99-4435-ade2-ff07ab3b0db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.053354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89f364-0b99-4435-ade2-ff07ab3b0db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.053354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89f364-0b99-4435-ade2-ff07ab3b0db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:49:34.053354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89f364-0b99-4435-ade2-ff07ab3b0db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.053354 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89f364-0b99-4435-ade2-ff07ab3b0db3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.068747 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1316/2635] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:49:34.073766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd16269-2feb-485d-bfdb-c2eaff5c37b8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.085761 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd16269-2feb-485d-bfdb-c2eaff5c37b8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.096739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ae148-fb97-4ae8-a5c3-06e54aec0560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.096739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae148-fb97-4ae8-a5c3-06e54aec0560 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.096739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae148-fb97-4ae8-a5c3-06e54aec0560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.096739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae148-fb97-4ae8-a5c3-06e54aec0560 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.097673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ae148-fb97-4ae8-a5c3-06e54aec0560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.097673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ae148-fb97-4ae8-a5c3-06e54aec0560 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.101163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89f364-0b99-4435-ade2-ff07ab3b0db3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.104335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5f89f364-0b99-4435-ade2-ff07ab3b0db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:34.129637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89f364-0b99-4435-ade2-ff07ab3b0db3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.135682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ef64c-dd3d-475e-94c0-e75805679c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.137880 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ef64c-dd3d-475e-94c0-e75805679c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.138274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ef64c-dd3d-475e-94c0-e75805679c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.138688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ef64c-dd3d-475e-94c0-e75805679c16 admin admin] PATH_INFO: `/v3/projects/2d50064b2e2c4e9a967b3753675cf4a5` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.140423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ef64c-dd3d-475e-94c0-e75805679c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d50064b2e2c4e9a967b3753675cf4a5)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.142815 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ef64c-dd3d-475e-94c0-e75805679c16 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.197027 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1320/2636] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:34 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:34.202381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ae148-fb97-4ae8-a5c3-06e54aec0560 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.223003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:34.282153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ae148-fb97-4ae8-a5c3-06e54aec0560 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.287480 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2279998-8958-4d93-95f8-c379c0e28a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.288173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2279998-8958-4d93-95f8-c379c0e28a16 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.288477 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2279998-8958-4d93-95f8-c379c0e28a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.288723 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2279998-8958-4d93-95f8-c379c0e28a16 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.289442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2279998-8958-4d93-95f8-c379c0e28a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.291471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2279998-8958-4d93-95f8-c379c0e28a16 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.303284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-df7ef64c-dd3d-475e-94c0-e75805679c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d50064b2e2c4e9a967b3753675cf4a5', 'request_id': 'req-df7ef64c-dd3d-475e-94c0-e75805679c16'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:34.310259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-df7ef64c-dd3d-475e-94c0-e75805679c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d50064b2e2c4e9a967b3753675cf4a5', 'request_id': 'req-df7ef64c-dd3d-475e-94c0-e75805679c16'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:34.318347 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-df7ef64c-dd3d-475e-94c0-e75805679c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d50064b2e2c4e9a967b3753675cf4a5', 'request_id': 'req-df7ef64c-dd3d-475e-94c0-e75805679c16'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:34.405191 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1321/2637] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:34 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:49:34.409437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2279998-8958-4d93-95f8-c379c0e28a16 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.421160 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2279998-8958-4d93-95f8-c379c0e28a16 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.443108 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-df7ef64c-dd3d-475e-94c0-e75805679c16 admin admin] The token cache is being invalidate because project 2d50064b2e2c4e9a967b3753675cf4a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:34.445626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-df7ef64c-dd3d-475e-94c0-e75805679c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:34.445626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-df7ef64c-dd3d-475e-94c0-e75805679c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:34.446795 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1317/2638] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:34 2022] DELETE /identity/v3/projects/2d50064b2e2c4e9a967b3753675cf4a5 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:34.452343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4bf19-9f34-4947-9150-8e82ca112104 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.452629 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4bf19-9f34-4947-9150-8e82ca112104 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.453006 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4bf19-9f34-4947-9150-8e82ca112104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.471088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-eaf4bf19-9f34-4947-9150-8e82ca112104 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:34.472306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-eaf4bf19-9f34-4947-9150-8e82ca112104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:34.477216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:34.489434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63b77e-8e69-42b1-8323-c3ae95764ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.489434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63b77e-8e69-42b1-8323-c3ae95764ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.489434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63b77e-8e69-42b1-8323-c3ae95764ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.489434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63b77e-8e69-42b1-8323-c3ae95764ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.490623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63b77e-8e69-42b1-8323-c3ae95764ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.490623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63b77e-8e69-42b1-8323-c3ae95764ab2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.505265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1322/2639] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:49:34.506515 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63b77e-8e69-42b1-8323-c3ae95764ab2 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.508489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ac63b77e-8e69-42b1-8323-c3ae95764ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:34.521494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63b77e-8e69-42b1-8323-c3ae95764ab2 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.528766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4538f-ab3c-4aa9-a090-7782c08e259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.535019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4538f-ab3c-4aa9-a090-7782c08e259b admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.535019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4538f-ab3c-4aa9-a090-7782c08e259b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.535019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4538f-ab3c-4aa9-a090-7782c08e259b admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.535019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4538f-ab3c-4aa9-a090-7782c08e259b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.535019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4538f-ab3c-4aa9-a090-7782c08e259b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.545367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1323/2640] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:34.551025 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4538f-ab3c-4aa9-a090-7782c08e259b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.570314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1318/2641] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:34.570901 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4538f-ab3c-4aa9-a090-7782c08e259b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.579068 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3841cf2-3508-45cf-9408-c33902b18792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.586623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3841cf2-3508-45cf-9408-c33902b18792 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.586623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3841cf2-3508-45cf-9408-c33902b18792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.586623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3841cf2-3508-45cf-9408-c33902b18792 admin admin] PATH_INFO: `/v3/projects/e4cb125eb1b6430bb88393082683e519/users/0d2c256e81fa479caba3ad92b21a03b4/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.594189 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e652bee-5c4f-4216-a9f5-5d89fd6dc6f9 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.594767 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e652bee-5c4f-4216-a9f5-5d89fd6dc6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.595159 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e652bee-5c4f-4216-a9f5-5d89fd6dc6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.612163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3841cf2-3508-45cf-9408-c33902b18792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4cb125eb1b6430bb88393082683e519, user_id=0d2c256e81fa479caba3ad92b21a03b4, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.617105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3841cf2-3508-45cf-9408-c33902b18792 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.625242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2e652bee-5c4f-4216-a9f5-5d89fd6dc6f9 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:34.627513 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2e652bee-5c4f-4216-a9f5-5d89fd6dc6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:34.640743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1319/2642] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:34.647445 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e652bee-5c4f-4216-a9f5-5d89fd6dc6f9 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.662469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e652bee-5c4f-4216-a9f5-5d89fd6dc6f9 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.664189 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31c155-49b0-4382-8f71-4f7c66cc7a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.664878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31c155-49b0-4382-8f71-4f7c66cc7a8c admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.665161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31c155-49b0-4382-8f71-4f7c66cc7a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.665443 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31c155-49b0-4382-8f71-4f7c66cc7a8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.666185 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31c155-49b0-4382-8f71-4f7c66cc7a8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:49:34.666526 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31c155-49b0-4382-8f71-4f7c66cc7a8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.668777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31c155-49b0-4382-8f71-4f7c66cc7a8c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.683210 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1320/2643] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:49:34.688586 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31c155-49b0-4382-8f71-4f7c66cc7a8c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.700008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31c155-49b0-4382-8f71-4f7c66cc7a8c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.705280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5bb76-be1f-4451-b8c3-4a01e51bc4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.712703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5bb76-be1f-4451-b8c3-4a01e51bc4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.712703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5bb76-be1f-4451-b8c3-4a01e51bc4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.712703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5bb76-be1f-4451-b8c3-4a01e51bc4b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.712703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5bb76-be1f-4451-b8c3-4a01e51bc4b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.712703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5bb76-be1f-4451-b8c3-4a01e51bc4b0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.764553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1324/2644] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:34 2022] PUT /identity/v3/projects/e4cb125eb1b6430bb88393082683e519/users/0d2c256e81fa479caba3ad92b21a03b4/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:34.776640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82f023-706f-4c4d-b67a-148fba6085ca None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.777197 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82f023-706f-4c4d-b67a-148fba6085ca None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.778189 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82f023-706f-4c4d-b67a-148fba6085ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.826619 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6b82f023-706f-4c4d-b67a-148fba6085ca None None] MFA Rules not processed for user `0d2c256e81fa479caba3ad92b21a03b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:34.828227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6b82f023-706f-4c4d-b67a-148fba6085ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:34.903024 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:34.918200 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1325/2645] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:34.920376 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82f023-706f-4c4d-b67a-148fba6085ca None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.936609 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1321/2646] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:34 2022] POST /identity/v3/projects => generated 375 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:49:34.937996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5bb76-be1f-4451-b8c3-4a01e51bc4b0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:35.023350 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5bb76-be1f-4451-b8c3-4a01e51bc4b0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:35.028640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82f023-706f-4c4d-b67a-148fba6085ca None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:35.030442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2bc54-35c4-48fe-b922-b1baca053749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:35.031362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2bc54-35c4-48fe-b922-b1baca053749 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:35.031743 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2bc54-35c4-48fe-b922-b1baca053749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:35.032109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2bc54-35c4-48fe-b922-b1baca053749 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:35.032804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2bc54-35c4-48fe-b922-b1baca053749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:35.034511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d6524-ded0-4c88-b9ef-6446cdd3a70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:35.034831 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2bc54-35c4-48fe-b922-b1baca053749 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:35.035297 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d6524-ded0-4c88-b9ef-6446cdd3a70d admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:35.035554 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d6524-ded0-4c88-b9ef-6446cdd3a70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:35.035827 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d6524-ded0-4c88-b9ef-6446cdd3a70d admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:35.036527 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d6524-ded0-4c88-b9ef-6446cdd3a70d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:35.038577 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d6524-ded0-4c88-b9ef-6446cdd3a70d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:35.179484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1322/2647] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:34 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:35.184780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2bc54-35c4-48fe-b922-b1baca053749 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:35.201216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2bc54-35c4-48fe-b922-b1baca053749 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:35.207909 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70ca35-f16f-4dbf-91e8-1c4588145991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:35.209187 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70ca35-f16f-4dbf-91e8-1c4588145991 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:35.209532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70ca35-f16f-4dbf-91e8-1c4588145991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:35.209818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70ca35-f16f-4dbf-91e8-1c4588145991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:35.211065 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70ca35-f16f-4dbf-91e8-1c4588145991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:35.213088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70ca35-f16f-4dbf-91e8-1c4588145991 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:35.224637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1326/2648] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:34 2022] POST /identity/v3/projects => generated 381 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:49:35.226376 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1323/2649] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:49:35.232244 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d6524-ded0-4c88-b9ef-6446cdd3a70d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:35.234622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70ca35-f16f-4dbf-91e8-1c4588145991 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:35.246369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70ca35-f16f-4dbf-91e8-1c4588145991 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:35.340800 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:35.359356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d6524-ded0-4c88-b9ef-6446cdd3a70d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:35.364775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7949a8-6fd7-4c18-803e-e62bee0693a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:35.368964 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7949a8-6fd7-4c18-803e-e62bee0693a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:35.368964 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7949a8-6fd7-4c18-803e-e62bee0693a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:35.368964 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7949a8-6fd7-4c18-803e-e62bee0693a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:35.369441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7949a8-6fd7-4c18-803e-e62bee0693a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:35.369772 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8d0e-73ed-46e1-a99c-1fc6f00d3971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:35.370677 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8d0e-73ed-46e1-a99c-1fc6f00d3971 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:35.371609 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8d0e-73ed-46e1-a99c-1fc6f00d3971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:35.372000 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8d0e-73ed-46e1-a99c-1fc6f00d3971 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:35.372887 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7949a8-6fd7-4c18-803e-e62bee0693a3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:35.373300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae8d0e-73ed-46e1-a99c-1fc6f00d3971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:35.377252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae8d0e-73ed-46e1-a99c-1fc6f00d3971 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:35.400714 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1324/2650] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:35.403431 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7949a8-6fd7-4c18-803e-e62bee0693a3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:35.416551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7949a8-6fd7-4c18-803e-e62bee0693a3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:35.422424 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4d504-dc14-4700-99bb-dfc968cc6a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:35.423362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4d504-dc14-4700-99bb-dfc968cc6a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:35.429566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4d504-dc14-4700-99bb-dfc968cc6a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:35.429566 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4d504-dc14-4700-99bb-dfc968cc6a50 admin admin] PATH_INFO: `/v3/projects/3a894b4902ef4c0b865dc1ccc5bdd6e9/users/71879f8c1dde45e3a8bed3db4c3142d5/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:35.443003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4d504-dc14-4700-99bb-dfc968cc6a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a894b4902ef4c0b865dc1ccc5bdd6e9, user_id=71879f8c1dde45e3a8bed3db4c3142d5, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:35.446862 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4d504-dc14-4700-99bb-dfc968cc6a50 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:35.553707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1327/2651] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:35 2022] POST /identity/v3/users => generated 297 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:35.561082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8d0e-73ed-46e1-a99c-1fc6f00d3971 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:35.573434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8d0e-73ed-46e1-a99c-1fc6f00d3971 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:35.579129 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9372e-f82d-415b-afaa-e0861b559ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:35.579853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9372e-f82d-415b-afaa-e0861b559ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:35.580162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9372e-f82d-415b-afaa-e0861b559ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:35.580413 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9372e-f82d-415b-afaa-e0861b559ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:35.581154 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9372e-f82d-415b-afaa-e0861b559ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:35.582848 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9372e-f82d-415b-afaa-e0861b559ae4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:35.595564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1328/2652] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:35.600119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1325/2653] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:35 2022] PUT /identity/v3/projects/3a894b4902ef4c0b865dc1ccc5bdd6e9/users/71879f8c1dde45e3a8bed3db4c3142d5/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:35.602212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9372e-f82d-415b-afaa-e0861b559ae4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:35.615996 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9372e-f82d-415b-afaa-e0861b559ae4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:35.671755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4804e2-c310-4e5c-aaa6-e7627f2f3a4e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:35.672157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4804e2-c310-4e5c-aaa6-e7627f2f3a4e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:35.672547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4804e2-c310-4e5c-aaa6-e7627f2f3a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:35.706454 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea728b-cb1d-49a3-a5aa-df66ee1b86c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:35.707571 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea728b-cb1d-49a3-a5aa-df66ee1b86c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:35.707968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea728b-cb1d-49a3-a5aa-df66ee1b86c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:35.708347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea728b-cb1d-49a3-a5aa-df66ee1b86c2 admin admin] PATH_INFO: `/v3/projects/37142961b3ab4645bd4938dc3fde9f40/users/2e84fc9b18304cfd9cd046f58eb468bf/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:35.712416 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:35.720593 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8b4804e2-c310-4e5c-aaa6-e7627f2f3a4e None None] MFA Rules not processed for user `71879f8c1dde45e3a8bed3db4c3142d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:35.723784 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8b4804e2-c310-4e5c-aaa6-e7627f2f3a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:35.731357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea728b-cb1d-49a3-a5aa-df66ee1b86c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37142961b3ab4645bd4938dc3fde9f40, user_id=2e84fc9b18304cfd9cd046f58eb468bf, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:35.735102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea728b-cb1d-49a3-a5aa-df66ee1b86c2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:35.807683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1329/2654] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:35 2022] PUT /identity/v3/projects/37142961b3ab4645bd4938dc3fde9f40/users/2e84fc9b18304cfd9cd046f58eb468bf/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:35.813590 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea728b-cb1d-49a3-a5aa-df66ee1b86c2 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:35.836085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1326/2655] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:35.847567 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4804e2-c310-4e5c-aaa6-e7627f2f3a4e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:35.849538 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8b4804e2-c310-4e5c-aaa6-e7627f2f3a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:35.912902 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea728b-cb1d-49a3-a5aa-df66ee1b86c2 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:35.918800 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6316546-284a-4bcf-93fe-86f79b4b1dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:35.919495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6316546-284a-4bcf-93fe-86f79b4b1dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:35.919781 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6316546-284a-4bcf-93fe-86f79b4b1dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:35.920061 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6316546-284a-4bcf-93fe-86f79b4b1dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:35.920810 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6316546-284a-4bcf-93fe-86f79b4b1dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:35.922513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6316546-284a-4bcf-93fe-86f79b4b1dc9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:35.937889 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1330/2656] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:49:35.942488 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6316546-284a-4bcf-93fe-86f79b4b1dc9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:35.956829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6316546-284a-4bcf-93fe-86f79b4b1dc9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:35.957095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4804e2-c310-4e5c-aaa6-e7627f2f3a4e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:35.963022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a0b7d-78b2-4b28-a669-9612cc8839f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:35.964294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a0b7d-78b2-4b28-a669-9612cc8839f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:35.964675 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a0b7d-78b2-4b28-a669-9612cc8839f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:35.965159 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a0b7d-78b2-4b28-a669-9612cc8839f0 admin admin] PATH_INFO: `/v3/projects/37142961b3ab4645bd4938dc3fde9f40/users/2e84fc9b18304cfd9cd046f58eb468bf/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:35.968113 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a0b7d-78b2-4b28-a669-9612cc8839f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37142961b3ab4645bd4938dc3fde9f40, user_id=2e84fc9b18304cfd9cd046f58eb468bf, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:35.970967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a0b7d-78b2-4b28-a669-9612cc8839f0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:35.986398 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1331/2657] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:35 2022] PUT /identity/v3/projects/37142961b3ab4645bd4938dc3fde9f40/users/2e84fc9b18304cfd9cd046f58eb468bf/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:35.998686 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a22d59-aabe-4163-a8b1-82465094efbd None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:35.999118 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a22d59-aabe-4163-a8b1-82465094efbd None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:35.999495 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a22d59-aabe-4163-a8b1-82465094efbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:36.036040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b4a22d59-aabe-4163-a8b1-82465094efbd None None] MFA Rules not processed for user `2e84fc9b18304cfd9cd046f58eb468bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:36.037422 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b4a22d59-aabe-4163-a8b1-82465094efbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:36.048697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce979cb-62fa-4ec5-b7f1-8b5e07f028a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:36.049395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce979cb-62fa-4ec5-b7f1-8b5e07f028a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:36.049663 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce979cb-62fa-4ec5-b7f1-8b5e07f028a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:36.049945 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce979cb-62fa-4ec5-b7f1-8b5e07f028a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:36.077816 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:36.135311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1332/2658] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:36.144689 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce979cb-62fa-4ec5-b7f1-8b5e07f028a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:36.146802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce979cb-62fa-4ec5-b7f1-8b5e07f028a0 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:36.155806 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a22d59-aabe-4163-a8b1-82465094efbd None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:36.155806 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b4a22d59-aabe-4163-a8b1-82465094efbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:36.163913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1327/2659] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:49:36.247818 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a22d59-aabe-4163-a8b1-82465094efbd None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:36.252947 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94509bcc-e25a-4105-992b-1069bcb2144e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:36.253687 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94509bcc-e25a-4105-992b-1069bcb2144e service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:36.253972 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94509bcc-e25a-4105-992b-1069bcb2144e service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:36.254257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94509bcc-e25a-4105-992b-1069bcb2144e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:36.261405 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:36.266128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94509bcc-e25a-4105-992b-1069bcb2144e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:36.267977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94509bcc-e25a-4105-992b-1069bcb2144e service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:36.287228 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1333/2660] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:49:36.529903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce979cb-62fa-4ec5-b7f1-8b5e07f028a0 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:36.542934 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce979cb-62fa-4ec5-b7f1-8b5e07f028a0 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:36.549157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a7d85-0869-4443-825c-fb68d7ab640d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:36.549971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a7d85-0869-4443-825c-fb68d7ab640d service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:36.550529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a7d85-0869-4443-825c-fb68d7ab640d service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:36.551020 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a7d85-0869-4443-825c-fb68d7ab640d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:36.631940 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a7d85-0869-4443-825c-fb68d7ab640d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:36.633885 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a7d85-0869-4443-825c-fb68d7ab640d service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:36.645741 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1328/2661] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:46.426740 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:46.640411 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=47 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:47.964507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94509bcc-e25a-4105-992b-1069bcb2144e service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:48.047323 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94509bcc-e25a-4105-992b-1069bcb2144e service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:48.052572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb733bdf-2a67-49b5-b98c-252012072d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:48.053428 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb733bdf-2a67-49b5-b98c-252012072d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:48.053720 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb733bdf-2a67-49b5-b98c-252012072d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:48.054001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb733bdf-2a67-49b5-b98c-252012072d2e admin admin] PATH_INFO: `/v3/users/0d2c256e81fa479caba3ad92b21a03b4` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:48.055434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb733bdf-2a67-49b5-b98c-252012072d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d2c256e81fa479caba3ad92b21a03b4)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:48.057415 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb733bdf-2a67-49b5-b98c-252012072d2e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:48.301043 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fb733bdf-2a67-49b5-b98c-252012072d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d2c256e81fa479caba3ad92b21a03b4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:48.447815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fb733bdf-2a67-49b5-b98c-252012072d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d2c256e81fa479caba3ad92b21a03b4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:48.465229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fb733bdf-2a67-49b5-b98c-252012072d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d2c256e81fa479caba3ad92b21a03b4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:48.465229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fb733bdf-2a67-49b5-b98c-252012072d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d2c256e81fa479caba3ad92b21a03b4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:48.484021 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fb733bdf-2a67-49b5-b98c-252012072d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d2c256e81fa479caba3ad92b21a03b4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:48.491379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1334/2662] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:47 2022] DELETE /identity/v3/users/0d2c256e81fa479caba3ad92b21a03b4 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:48.496765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c3a8e-8697-4987-8812-9edb3137f25c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:48.497442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c3a8e-8697-4987-8812-9edb3137f25c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:48.497442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c3a8e-8697-4987-8812-9edb3137f25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:48.517075 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-021c3a8e-8697-4987-8812-9edb3137f25c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:48.518406 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-021c3a8e-8697-4987-8812-9edb3137f25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:48.606797 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1329/2663] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:48.607557 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb733bdf-2a67-49b5-b98c-252012072d2e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:48.608211 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fb733bdf-2a67-49b5-b98c-252012072d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:48.687738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb733bdf-2a67-49b5-b98c-252012072d2e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:48.693442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ce000-5381-427c-96bd-93209d47a0ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:48.694650 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce000-5381-427c-96bd-93209d47a0ec service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:48.695095 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce000-5381-427c-96bd-93209d47a0ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:48.695514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce000-5381-427c-96bd-93209d47a0ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:48.709691 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ce000-5381-427c-96bd-93209d47a0ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:48.712960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ce000-5381-427c-96bd-93209d47a0ec service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:48.731282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1335/2664] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:49.316218 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c3a8e-8697-4987-8812-9edb3137f25c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:49.317926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-021c3a8e-8697-4987-8812-9edb3137f25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:49.335269 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c3a8e-8697-4987-8812-9edb3137f25c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:49.342359 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1a28d-3745-4325-ae36-c31b10c4f663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:49.343258 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1a28d-3745-4325-ae36-c31b10c4f663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:49.343546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1a28d-3745-4325-ae36-c31b10c4f663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:49.343830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1a28d-3745-4325-ae36-c31b10c4f663 admin admin] PATH_INFO: `/v3/projects/e4cb125eb1b6430bb88393082683e519` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:49.345487 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1a28d-3745-4325-ae36-c31b10c4f663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4cb125eb1b6430bb88393082683e519)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:49.347682 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1a28d-3745-4325-ae36-c31b10c4f663 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:49.464362 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-02f1a28d-3745-4325-ae36-c31b10c4f663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4cb125eb1b6430bb88393082683e519', 'request_id': 'req-02f1a28d-3745-4325-ae36-c31b10c4f663'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:49.472558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-02f1a28d-3745-4325-ae36-c31b10c4f663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4cb125eb1b6430bb88393082683e519', 'request_id': 'req-02f1a28d-3745-4325-ae36-c31b10c4f663'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:49.484532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-02f1a28d-3745-4325-ae36-c31b10c4f663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4cb125eb1b6430bb88393082683e519', 'request_id': 'req-02f1a28d-3745-4325-ae36-c31b10c4f663'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:49.507870 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ce000-5381-427c-96bd-93209d47a0ec service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:49.508509 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-327ce000-5381-427c-96bd-93209d47a0ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:49.522427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ce000-5381-427c-96bd-93209d47a0ec service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:49.547361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:49.570728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-02f1a28d-3745-4325-ae36-c31b10c4f663 admin admin] The token cache is being invalidate because project e4cb125eb1b6430bb88393082683e519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:49.570728 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-02f1a28d-3745-4325-ae36-c31b10c4f663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:49.572113 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-02f1a28d-3745-4325-ae36-c31b10c4f663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:49.576095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1330/2665] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:49 2022] DELETE /identity/v3/projects/e4cb125eb1b6430bb88393082683e519 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:49.580016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1a28d-3745-4325-ae36-c31b10c4f663 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:49.582363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-02f1a28d-3745-4325-ae36-c31b10c4f663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:49.612048 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1becb0-b214-44ce-8ff8-edd49afb318c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:49.613153 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1becb0-b214-44ce-8ff8-edd49afb318c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:49.613547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1becb0-b214-44ce-8ff8-edd49afb318c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:49.614039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1becb0-b214-44ce-8ff8-edd49afb318c admin admin] PATH_INFO: `/v3/users/71879f8c1dde45e3a8bed3db4c3142d5` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:49.616041 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1becb0-b214-44ce-8ff8-edd49afb318c admin admin] RBAC: Authorizing `identity:delete_user(user_id=71879f8c1dde45e3a8bed3db4c3142d5)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:49.618484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1becb0-b214-44ce-8ff8-edd49afb318c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:49.800552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1a28d-3745-4325-ae36-c31b10c4f663 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:49.806486 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296781-c375-4da8-bf69-f87022182382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:49.807533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296781-c375-4da8-bf69-f87022182382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:49.807912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296781-c375-4da8-bf69-f87022182382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:49.808919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296781-c375-4da8-bf69-f87022182382 admin admin] PATH_INFO: `/v3/users/2e84fc9b18304cfd9cd046f58eb468bf` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:49.810948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef296781-c375-4da8-bf69-f87022182382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e84fc9b18304cfd9cd046f58eb468bf)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:49.812909 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fe1becb0-b214-44ce-8ff8-edd49afb318c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71879f8c1dde45e3a8bed3db4c3142d5'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:49.813206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef296781-c375-4da8-bf69-f87022182382 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:49.894897 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fe1becb0-b214-44ce-8ff8-edd49afb318c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71879f8c1dde45e3a8bed3db4c3142d5'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:49.905088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fe1becb0-b214-44ce-8ff8-edd49afb318c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71879f8c1dde45e3a8bed3db4c3142d5'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:49.905883 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fe1becb0-b214-44ce-8ff8-edd49afb318c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71879f8c1dde45e3a8bed3db4c3142d5'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:49.921014 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fe1becb0-b214-44ce-8ff8-edd49afb318c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71879f8c1dde45e3a8bed3db4c3142d5'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:49.924542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:49.930120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1336/2666] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:49 2022] DELETE /identity/v3/users/71879f8c1dde45e3a8bed3db4c3142d5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:49.936057 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f25782-5fb0-466c-89a6-5cb47d907073 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:49.936352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f25782-5fb0-466c-89a6-5cb47d907073 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:49.936638 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f25782-5fb0-466c-89a6-5cb47d907073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:49.958029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d6f25782-5fb0-466c-89a6-5cb47d907073 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:49.958773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d6f25782-5fb0-466c-89a6-5cb47d907073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:50.033510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1337/2667] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:50.045557 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f25782-5fb0-466c-89a6-5cb47d907073 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:50.047866 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d6f25782-5fb0-466c-89a6-5cb47d907073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:50.068243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ef296781-c375-4da8-bf69-f87022182382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e84fc9b18304cfd9cd046f58eb468bf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:50.123470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:50.134966 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ef296781-c375-4da8-bf69-f87022182382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e84fc9b18304cfd9cd046f58eb468bf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:50.141820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f25782-5fb0-466c-89a6-5cb47d907073 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:50.148288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e26b86-1e5b-455e-bbf5-07d50af2a536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:50.148457 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ef296781-c375-4da8-bf69-f87022182382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e84fc9b18304cfd9cd046f58eb468bf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:50.149262 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e26b86-1e5b-455e-bbf5-07d50af2a536 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:50.149409 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ef296781-c375-4da8-bf69-f87022182382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e84fc9b18304cfd9cd046f58eb468bf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:50.149714 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e26b86-1e5b-455e-bbf5-07d50af2a536 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:50.150159 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e26b86-1e5b-455e-bbf5-07d50af2a536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:50.153177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-61e26b86-1e5b-455e-bbf5-07d50af2a536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:50.170472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ef296781-c375-4da8-bf69-f87022182382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e84fc9b18304cfd9cd046f58eb468bf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:50.174119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e26b86-1e5b-455e-bbf5-07d50af2a536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:50.176862 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e26b86-1e5b-455e-bbf5-07d50af2a536 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:50.181826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1331/2668] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:49 2022] DELETE /identity/v3/users/2e84fc9b18304cfd9cd046f58eb468bf => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:50.193580 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1338/2669] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:49:50.813120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296781-c375-4da8-bf69-f87022182382 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:50.815036 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ef296781-c375-4da8-bf69-f87022182382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:50.846745 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e26b86-1e5b-455e-bbf5-07d50af2a536 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:50.849082 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-61e26b86-1e5b-455e-bbf5-07d50af2a536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:50.876946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e26b86-1e5b-455e-bbf5-07d50af2a536 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:50.925385 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296781-c375-4da8-bf69-f87022182382 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:50.932736 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad84175-6a19-4e68-9ec8-111bc1a28521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:50.934236 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad84175-6a19-4e68-9ec8-111bc1a28521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:50.934727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad84175-6a19-4e68-9ec8-111bc1a28521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:50.935157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad84175-6a19-4e68-9ec8-111bc1a28521 admin admin] PATH_INFO: `/v3/projects/37142961b3ab4645bd4938dc3fde9f40` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:50.937449 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad84175-6a19-4e68-9ec8-111bc1a28521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37142961b3ab4645bd4938dc3fde9f40)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:50.941401 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad84175-6a19-4e68-9ec8-111bc1a28521 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:50.981964 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d52e33-c206-4ad1-b647-1991d58e04b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:50.983505 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d52e33-c206-4ad1-b647-1991d58e04b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:50.983889 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d52e33-c206-4ad1-b647-1991d58e04b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:50.984392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d52e33-c206-4ad1-b647-1991d58e04b2 admin admin] PATH_INFO: `/v3/projects/3a894b4902ef4c0b865dc1ccc5bdd6e9` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:50.986035 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d52e33-c206-4ad1-b647-1991d58e04b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a894b4902ef4c0b865dc1ccc5bdd6e9)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:50.988484 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d52e33-c206-4ad1-b647-1991d58e04b2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:51.161408 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bad84175-6a19-4e68-9ec8-111bc1a28521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37142961b3ab4645bd4938dc3fde9f40', 'request_id': 'req-bad84175-6a19-4e68-9ec8-111bc1a28521'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:51.167666 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bad84175-6a19-4e68-9ec8-111bc1a28521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37142961b3ab4645bd4938dc3fde9f40', 'request_id': 'req-bad84175-6a19-4e68-9ec8-111bc1a28521'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:51.176267 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bad84175-6a19-4e68-9ec8-111bc1a28521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37142961b3ab4645bd4938dc3fde9f40', 'request_id': 'req-bad84175-6a19-4e68-9ec8-111bc1a28521'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:51.206091 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30d52e33-c206-4ad1-b647-1991d58e04b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a894b4902ef4c0b865dc1ccc5bdd6e9', 'request_id': 'req-30d52e33-c206-4ad1-b647-1991d58e04b2'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:51.213968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30d52e33-c206-4ad1-b647-1991d58e04b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a894b4902ef4c0b865dc1ccc5bdd6e9', 'request_id': 'req-30d52e33-c206-4ad1-b647-1991d58e04b2'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:51.223856 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30d52e33-c206-4ad1-b647-1991d58e04b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a894b4902ef4c0b865dc1ccc5bdd6e9', 'request_id': 'req-30d52e33-c206-4ad1-b647-1991d58e04b2'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:51.283805 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bad84175-6a19-4e68-9ec8-111bc1a28521 admin admin] The token cache is being invalidate because project 37142961b3ab4645bd4938dc3fde9f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:51.284184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bad84175-6a19-4e68-9ec8-111bc1a28521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:51.285308 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bad84175-6a19-4e68-9ec8-111bc1a28521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:51.288264 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1332/2670] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:50 2022] DELETE /identity/v3/projects/37142961b3ab4645bd4938dc3fde9f40 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:51.296713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994b603-578b-440e-a958-e854170e27ae None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:51.297254 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994b603-578b-440e-a958-e854170e27ae None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:51.297723 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994b603-578b-440e-a958-e854170e27ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:51.331017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1994b603-578b-440e-a958-e854170e27ae None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:51.333169 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1994b603-578b-440e-a958-e854170e27ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:51.386569 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30d52e33-c206-4ad1-b647-1991d58e04b2 admin admin] The token cache is being invalidate because project 3a894b4902ef4c0b865dc1ccc5bdd6e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:51.387564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30d52e33-c206-4ad1-b647-1991d58e04b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:51.387905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30d52e33-c206-4ad1-b647-1991d58e04b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:51.389591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1339/2671] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:50 2022] DELETE /identity/v3/projects/3a894b4902ef4c0b865dc1ccc5bdd6e9 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:51.395314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aa7c1-a9c7-4614-ae74-99696825dcbc None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:51.395790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aa7c1-a9c7-4614-ae74-99696825dcbc None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:51.396216 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aa7c1-a9c7-4614-ae74-99696825dcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:51.402568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:51.423385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-fe1aa7c1-a9c7-4614-ae74-99696825dcbc None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:51.424930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fe1aa7c1-a9c7-4614-ae74-99696825dcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:51.443794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1333/2672] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:51.452579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853744c-046a-41b2-9d18-c632e15dea66 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:51.452866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853744c-046a-41b2-9d18-c632e15dea66 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:51.453122 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853744c-046a-41b2-9d18-c632e15dea66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:51.474640 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c853744c-046a-41b2-9d18-c632e15dea66 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:51.475908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c853744c-046a-41b2-9d18-c632e15dea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:51.485995 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1334/2673] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:51.490942 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853744c-046a-41b2-9d18-c632e15dea66 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:51.503732 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853744c-046a-41b2-9d18-c632e15dea66 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:51.510087 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025872b9-b46a-42d8-a5d0-f8e1aeb2e947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:51.511166 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025872b9-b46a-42d8-a5d0-f8e1aeb2e947 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:51.511690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025872b9-b46a-42d8-a5d0-f8e1aeb2e947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:51.512020 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025872b9-b46a-42d8-a5d0-f8e1aeb2e947 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:51.512884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025872b9-b46a-42d8-a5d0-f8e1aeb2e947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:49:51.513265 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025872b9-b46a-42d8-a5d0-f8e1aeb2e947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:51.515747 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025872b9-b46a-42d8-a5d0-f8e1aeb2e947 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:51.523185 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1340/2674] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:51.536703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1335/2675] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:49:51.536976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a5b2b-fe35-43d0-a37a-f29e1b3fb8dc None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:51.536976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a5b2b-fe35-43d0-a37a-f29e1b3fb8dc None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:51.536976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a5b2b-fe35-43d0-a37a-f29e1b3fb8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:51.538364 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025872b9-b46a-42d8-a5d0-f8e1aeb2e947 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:51.552525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025872b9-b46a-42d8-a5d0-f8e1aeb2e947 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:51.555715 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-264a5b2b-fe35-43d0-a37a-f29e1b3fb8dc None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:51.557003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-264a5b2b-fe35-43d0-a37a-f29e1b3fb8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:51.559208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371f2e3-861d-427f-a6ba-eeb74bf1d517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:51.560006 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371f2e3-861d-427f-a6ba-eeb74bf1d517 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:51.560388 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371f2e3-861d-427f-a6ba-eeb74bf1d517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:51.560846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371f2e3-861d-427f-a6ba-eeb74bf1d517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:51.561734 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371f2e3-861d-427f-a6ba-eeb74bf1d517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:51.564152 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371f2e3-861d-427f-a6ba-eeb74bf1d517 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:51.572038 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1341/2676] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:51.579820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a5b2b-fe35-43d0-a37a-f29e1b3fb8dc None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:51.594632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a5b2b-fe35-43d0-a37a-f29e1b3fb8dc None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:51.600334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcfdaf-f19c-47a7-850d-a3b68eb9021e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:51.601016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcfdaf-f19c-47a7-850d-a3b68eb9021e admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:51.601318 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcfdaf-f19c-47a7-850d-a3b68eb9021e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:51.601578 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcfdaf-f19c-47a7-850d-a3b68eb9021e admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:51.602355 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcfdaf-f19c-47a7-850d-a3b68eb9021e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:49:51.602664 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcfdaf-f19c-47a7-850d-a3b68eb9021e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:51.604354 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcfdaf-f19c-47a7-850d-a3b68eb9021e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:51.608255 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:51.620295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1342/2677] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:49:51.625988 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcfdaf-f19c-47a7-850d-a3b68eb9021e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:51.638492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcfdaf-f19c-47a7-850d-a3b68eb9021e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:51.643773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c20001-9547-4aa9-98dc-ffe499cff46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:51.644450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c20001-9547-4aa9-98dc-ffe499cff46d admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:51.644733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c20001-9547-4aa9-98dc-ffe499cff46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:51.645008 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c20001-9547-4aa9-98dc-ffe499cff46d admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:51.645737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c20001-9547-4aa9-98dc-ffe499cff46d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:51.647969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c20001-9547-4aa9-98dc-ffe499cff46d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:51.709923 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1336/2678] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:51 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:49:51.713907 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371f2e3-861d-427f-a6ba-eeb74bf1d517 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:51.788427 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1343/2679] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:51 2022] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:49:51.796077 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c20001-9547-4aa9-98dc-ffe499cff46d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:51.819255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371f2e3-861d-427f-a6ba-eeb74bf1d517 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:51.889540 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c20001-9547-4aa9-98dc-ffe499cff46d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:51.895165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860005f-c339-4c4c-b2d0-ec689ae751da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:51.895860 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860005f-c339-4c4c-b2d0-ec689ae751da admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:51.896133 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860005f-c339-4c4c-b2d0-ec689ae751da admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:51.896405 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860005f-c339-4c4c-b2d0-ec689ae751da admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:51.897131 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860005f-c339-4c4c-b2d0-ec689ae751da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:51.899147 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860005f-c339-4c4c-b2d0-ec689ae751da admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:51.902659 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9622a-c5e8-4cf1-8987-71df326fdfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:51.903569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9622a-c5e8-4cf1-8987-71df326fdfda admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:51.903894 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9622a-c5e8-4cf1-8987-71df326fdfda admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:51.904294 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9622a-c5e8-4cf1-8987-71df326fdfda admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:51.905107 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9622a-c5e8-4cf1-8987-71df326fdfda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:51.907533 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9622a-c5e8-4cf1-8987-71df326fdfda admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:52.016341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1344/2680] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:51 2022] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:49:52.021104 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860005f-c339-4c4c-b2d0-ec689ae751da admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:52.033254 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860005f-c339-4c4c-b2d0-ec689ae751da admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:52.038568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cc3d1-573d-44d7-8945-bfbf5a660902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:52.039160 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cc3d1-573d-44d7-8945-bfbf5a660902 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:52.039435 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cc3d1-573d-44d7-8945-bfbf5a660902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:52.039707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cc3d1-573d-44d7-8945-bfbf5a660902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:52.040443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cc3d1-573d-44d7-8945-bfbf5a660902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:52.042131 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cc3d1-573d-44d7-8945-bfbf5a660902 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:52.054844 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1345/2681] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:49:52.057745 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1337/2682] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:51 2022] POST /identity/v3/users => generated 287 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:49:52.061805 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cc3d1-573d-44d7-8945-bfbf5a660902 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:52.063083 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9622a-c5e8-4cf1-8987-71df326fdfda admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:52.074973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9622a-c5e8-4cf1-8987-71df326fdfda admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:52.079973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0144f64-e616-4d8e-8898-f987941225db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:52.080658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0144f64-e616-4d8e-8898-f987941225db admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:52.080949 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0144f64-e616-4d8e-8898-f987941225db admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:52.081224 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0144f64-e616-4d8e-8898-f987941225db admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:52.082161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cc3d1-573d-44d7-8945-bfbf5a660902 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:52.082364 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0144f64-e616-4d8e-8898-f987941225db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:52.084113 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0144f64-e616-4d8e-8898-f987941225db admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:52.091774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bef68-4fc5-412c-995b-840c68b9cd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:52.092940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bef68-4fc5-412c-995b-840c68b9cd69 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:52.093460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bef68-4fc5-412c-995b-840c68b9cd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:52.093978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bef68-4fc5-412c-995b-840c68b9cd69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:52.095351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bef68-4fc5-412c-995b-840c68b9cd69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:52.097257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1338/2683] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:49:52.098743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bef68-4fc5-412c-995b-840c68b9cd69 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:52.102511 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0144f64-e616-4d8e-8898-f987941225db admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:52.114448 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0144f64-e616-4d8e-8898-f987941225db admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:52.119331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1346/2684] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:52.119669 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9a66d-d82f-4001-93a5-5212eb438178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:52.120303 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9a66d-d82f-4001-93a5-5212eb438178 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:52.120597 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9a66d-d82f-4001-93a5-5212eb438178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:52.120880 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9a66d-d82f-4001-93a5-5212eb438178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:52.122125 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9a66d-d82f-4001-93a5-5212eb438178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:52.123842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9a66d-d82f-4001-93a5-5212eb438178 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:52.126849 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bef68-4fc5-412c-995b-840c68b9cd69 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:52.140340 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bef68-4fc5-412c-995b-840c68b9cd69 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:52.141231 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1339/2685] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:49:52.145688 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9a66d-d82f-4001-93a5-5212eb438178 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:52.149399 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d55e1-a3c9-4967-92b2-7b3be567e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:52.150468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d55e1-a3c9-4967-92b2-7b3be567e97d admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:52.150871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d55e1-a3c9-4967-92b2-7b3be567e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:52.151253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d55e1-a3c9-4967-92b2-7b3be567e97d admin admin] PATH_INFO: `/v3/projects/f07c01ee11b048e792bbd2483a5fd4b5/users/53461d6ba1f04f3482281c99c324cc08/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:52.160641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9a66d-d82f-4001-93a5-5212eb438178 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:52.169529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af43c5e-bc33-4d5a-8ac9-d0f394f78ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:52.171161 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af43c5e-bc33-4d5a-8ac9-d0f394f78ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:52.171655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af43c5e-bc33-4d5a-8ac9-d0f394f78ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:52.172129 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af43c5e-bc33-4d5a-8ac9-d0f394f78ee6 admin admin] PATH_INFO: `/v3/projects/ffcdf8d1024748b095dfb25b6990d999/users/1d03837bdbf0480b981696b1e8965e26/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:52.174710 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d55e1-a3c9-4967-92b2-7b3be567e97d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07c01ee11b048e792bbd2483a5fd4b5, user_id=53461d6ba1f04f3482281c99c324cc08, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:52.176555 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:52.178939 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d55e1-a3c9-4967-92b2-7b3be567e97d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:52.200792 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af43c5e-bc33-4d5a-8ac9-d0f394f78ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffcdf8d1024748b095dfb25b6990d999, user_id=1d03837bdbf0480b981696b1e8965e26, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:52.205631 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af43c5e-bc33-4d5a-8ac9-d0f394f78ee6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:52.308057 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1347/2686] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:52 2022] PUT /identity/v3/projects/f07c01ee11b048e792bbd2483a5fd4b5/users/53461d6ba1f04f3482281c99c324cc08/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:52.320299 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc3525-1570-4638-b96d-927fed8222e5 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:52.320724 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc3525-1570-4638-b96d-927fed8222e5 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:52.321111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc3525-1570-4638-b96d-927fed8222e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:52.355737 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1340/2687] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:52 2022] PUT /identity/v3/projects/ffcdf8d1024748b095dfb25b6990d999/users/1d03837bdbf0480b981696b1e8965e26/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:52.359736 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6bcc3525-1570-4638-b96d-927fed8222e5 None None] MFA Rules not processed for user `53461d6ba1f04f3482281c99c324cc08`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:52.361385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6bcc3525-1570-4638-b96d-927fed8222e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:52.368095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce3402-1a1b-49ed-bff5-300474ef9555 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:52.368428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce3402-1a1b-49ed-bff5-300474ef9555 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:52.368752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce3402-1a1b-49ed-bff5-300474ef9555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:52.404938 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-50ce3402-1a1b-49ed-bff5-300474ef9555 None None] MFA Rules not processed for user `1d03837bdbf0480b981696b1e8965e26`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:52.410975 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-50ce3402-1a1b-49ed-bff5-300474ef9555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:52.473097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1348/2688] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:52.490066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc3525-1570-4638-b96d-927fed8222e5 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:52.493172 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6bcc3525-1570-4638-b96d-927fed8222e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:52.503119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1341/2689] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:52.508568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:52.508867 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce3402-1a1b-49ed-bff5-300474ef9555 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:52.595336 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc3525-1570-4638-b96d-927fed8222e5 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:52.600948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de094e-47e0-42aa-9e85-57bb44769ce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:52.601783 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de094e-47e0-42aa-9e85-57bb44769ce2 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:52.602103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de094e-47e0-42aa-9e85-57bb44769ce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:52.602450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de094e-47e0-42aa-9e85-57bb44769ce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:52.614700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de094e-47e0-42aa-9e85-57bb44769ce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:52.616201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de094e-47e0-42aa-9e85-57bb44769ce2 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:52.627738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1349/2690] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:52.636733 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce3402-1a1b-49ed-bff5-300474ef9555 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:52.643761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa6469-e1df-4eff-b6c5-18f4990b07c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:52.644746 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa6469-e1df-4eff-b6c5-18f4990b07c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:52.645168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa6469-e1df-4eff-b6c5-18f4990b07c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:52.645459 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa6469-e1df-4eff-b6c5-18f4990b07c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:52.646550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa6469-e1df-4eff-b6c5-18f4990b07c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:52.648812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa6469-e1df-4eff-b6c5-18f4990b07c9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:52.763266 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1342/2691] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:52 2022] POST /identity/v3/projects => generated 373 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:49:52.768124 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de094e-47e0-42aa-9e85-57bb44769ce2 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:52.787550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de094e-47e0-42aa-9e85-57bb44769ce2 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:52.902950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f830d3d-6e0f-4c68-82a0-74d31f269999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:52.903819 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f830d3d-6e0f-4c68-82a0-74d31f269999 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:52.904133 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f830d3d-6e0f-4c68-82a0-74d31f269999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:52.904457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f830d3d-6e0f-4c68-82a0-74d31f269999 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:52.905227 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f830d3d-6e0f-4c68-82a0-74d31f269999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:52.909077 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f830d3d-6e0f-4c68-82a0-74d31f269999 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:53.061032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1350/2692] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:52 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:53.066557 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa6469-e1df-4eff-b6c5-18f4990b07c9 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:53.080129 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa6469-e1df-4eff-b6c5-18f4990b07c9 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:53.086047 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75288d26-f607-426d-b241-da698720a4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:53.086784 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75288d26-f607-426d-b241-da698720a4fa admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:53.087190 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75288d26-f607-426d-b241-da698720a4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:53.087474 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75288d26-f607-426d-b241-da698720a4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:53.088505 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75288d26-f607-426d-b241-da698720a4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:53.090966 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75288d26-f607-426d-b241-da698720a4fa admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:53.109649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1343/2693] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:49:53.115809 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f830d3d-6e0f-4c68-82a0-74d31f269999 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:53.129467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f830d3d-6e0f-4c68-82a0-74d31f269999 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:53.135279 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d8f70-086f-4771-a81e-d68848a3f036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:53.136741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d8f70-086f-4771-a81e-d68848a3f036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:53.137020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d8f70-086f-4771-a81e-d68848a3f036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:53.137383 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d8f70-086f-4771-a81e-d68848a3f036 admin admin] PATH_INFO: `/v3/projects/e9d50f1d81244561818743ad324265f7/users/8bffe9fcf3d7412c94403b5375f533c9/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:53.157143 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d8f70-086f-4771-a81e-d68848a3f036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d50f1d81244561818743ad324265f7, user_id=8bffe9fcf3d7412c94403b5375f533c9, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:53.159920 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d8f70-086f-4771-a81e-d68848a3f036 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:53.296141 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1351/2694] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:53 2022] PUT /identity/v3/projects/e9d50f1d81244561818743ad324265f7/users/8bffe9fcf3d7412c94403b5375f533c9/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:53.301061 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75288d26-f607-426d-b241-da698720a4fa admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:53.312727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75288d26-f607-426d-b241-da698720a4fa admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:53.371709 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:53.390981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7bf5f-dae0-4256-91a1-ec99cb96629a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:53.392534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7bf5f-dae0-4256-91a1-ec99cb96629a admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:53.392838 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7bf5f-dae0-4256-91a1-ec99cb96629a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:53.393144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7bf5f-dae0-4256-91a1-ec99cb96629a admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:53.393974 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7bf5f-dae0-4256-91a1-ec99cb96629a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:53.395677 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7bf5f-dae0-4256-91a1-ec99cb96629a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:53.411664 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1344/2695] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:53.416462 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d8f70-086f-4771-a81e-d68848a3f036 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:53.428637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d8f70-086f-4771-a81e-d68848a3f036 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:53.434700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f474fa1-e5ed-4482-839f-11925556e3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:53.435927 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f474fa1-e5ed-4482-839f-11925556e3a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:53.436210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f474fa1-e5ed-4482-839f-11925556e3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:53.436493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f474fa1-e5ed-4482-839f-11925556e3a2 admin admin] PATH_INFO: `/v3/projects/e9d50f1d81244561818743ad324265f7/users/8bffe9fcf3d7412c94403b5375f533c9/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:53.438884 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f474fa1-e5ed-4482-839f-11925556e3a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d50f1d81244561818743ad324265f7, user_id=8bffe9fcf3d7412c94403b5375f533c9, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:53.441817 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f474fa1-e5ed-4482-839f-11925556e3a2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:53.455502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1352/2696] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:53 2022] PUT /identity/v3/projects/e9d50f1d81244561818743ad324265f7/users/8bffe9fcf3d7412c94403b5375f533c9/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:53.468621 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa559b-bc63-43f9-b203-c514d7bb700d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:53.469003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa559b-bc63-43f9-b203-c514d7bb700d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:53.469327 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa559b-bc63-43f9-b203-c514d7bb700d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:53.514754 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b2aa559b-bc63-43f9-b203-c514d7bb700d None None] MFA Rules not processed for user `8bffe9fcf3d7412c94403b5375f533c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:53.518724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b2aa559b-bc63-43f9-b203-c514d7bb700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:53.668761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1345/2697] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:53.681711 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f474fa1-e5ed-4482-839f-11925556e3a2 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:53.789257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f474fa1-e5ed-4482-839f-11925556e3a2 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:53.796235 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779c4d3-79ee-4480-81d8-fcdedfba5f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:53.808767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779c4d3-79ee-4480-81d8-fcdedfba5f8b service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:53.808767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779c4d3-79ee-4480-81d8-fcdedfba5f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:53.808767 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779c4d3-79ee-4480-81d8-fcdedfba5f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:53.812333 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779c4d3-79ee-4480-81d8-fcdedfba5f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:53.814002 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779c4d3-79ee-4480-81d8-fcdedfba5f8b service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:53.831096 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1353/2698] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:49:55.481048 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa559b-bc63-43f9-b203-c514d7bb700d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:55.583825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa559b-bc63-43f9-b203-c514d7bb700d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:55.589493 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f257003-9555-4fcb-b77f-f890e089f576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:55.590700 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f257003-9555-4fcb-b77f-f890e089f576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:55.591069 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f257003-9555-4fcb-b77f-f890e089f576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:55.591424 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f257003-9555-4fcb-b77f-f890e089f576 admin admin] PATH_INFO: `/v3/users/1d03837bdbf0480b981696b1e8965e26` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:55.595160 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f257003-9555-4fcb-b77f-f890e089f576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d03837bdbf0480b981696b1e8965e26)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:55.597802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f257003-9555-4fcb-b77f-f890e089f576 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:56.032206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7f257003-9555-4fcb-b77f-f890e089f576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d03837bdbf0480b981696b1e8965e26'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:56.180510 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7f257003-9555-4fcb-b77f-f890e089f576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d03837bdbf0480b981696b1e8965e26'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:56.191211 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7f257003-9555-4fcb-b77f-f890e089f576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d03837bdbf0480b981696b1e8965e26'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:56.192144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7f257003-9555-4fcb-b77f-f890e089f576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d03837bdbf0480b981696b1e8965e26'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:56.199856 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:56.209592 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7f257003-9555-4fcb-b77f-f890e089f576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d03837bdbf0480b981696b1e8965e26'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:56.218462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1346/2699] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:55 2022] DELETE /identity/v3/users/1d03837bdbf0480b981696b1e8965e26 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:56.223842 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84430c9-534f-4d94-a38c-53af2f605ea6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:56.224455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84430c9-534f-4d94-a38c-53af2f605ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:56.224455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84430c9-534f-4d94-a38c-53af2f605ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:56.233019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:56.247903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a84430c9-534f-4d94-a38c-53af2f605ea6 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:56.249489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a84430c9-534f-4d94-a38c-53af2f605ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:56.324366 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1354/2700] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:56.338665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f257003-9555-4fcb-b77f-f890e089f576 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:56.340701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7f257003-9555-4fcb-b77f-f890e089f576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:56.421147 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f257003-9555-4fcb-b77f-f890e089f576 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:56.428554 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec5877-bd57-413e-b871-c08993a9962c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:56.430133 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec5877-bd57-413e-b871-c08993a9962c service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:56.430998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec5877-bd57-413e-b871-c08993a9962c service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:56.431700 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec5877-bd57-413e-b871-c08993a9962c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:56.452630 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec5877-bd57-413e-b871-c08993a9962c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:56.454695 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec5877-bd57-413e-b871-c08993a9962c service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:56.475405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1347/2701] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:57.325458 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84430c9-534f-4d94-a38c-53af2f605ea6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:57.327125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a84430c9-534f-4d94-a38c-53af2f605ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:57.341207 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84430c9-534f-4d94-a38c-53af2f605ea6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:57.348527 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff163f47-c2d3-419a-93a9-1bafa210789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:57.371198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff163f47-c2d3-419a-93a9-1bafa210789b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:57.371198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff163f47-c2d3-419a-93a9-1bafa210789b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:57.371198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff163f47-c2d3-419a-93a9-1bafa210789b admin admin] PATH_INFO: `/v3/projects/ffcdf8d1024748b095dfb25b6990d999` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:57.371198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff163f47-c2d3-419a-93a9-1bafa210789b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffcdf8d1024748b095dfb25b6990d999)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:57.371198 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff163f47-c2d3-419a-93a9-1bafa210789b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:57.603524 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ff163f47-c2d3-419a-93a9-1bafa210789b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffcdf8d1024748b095dfb25b6990d999', 'request_id': 'req-ff163f47-c2d3-419a-93a9-1bafa210789b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:57.617142 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ff163f47-c2d3-419a-93a9-1bafa210789b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffcdf8d1024748b095dfb25b6990d999', 'request_id': 'req-ff163f47-c2d3-419a-93a9-1bafa210789b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:57.627188 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ff163f47-c2d3-419a-93a9-1bafa210789b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffcdf8d1024748b095dfb25b6990d999', 'request_id': 'req-ff163f47-c2d3-419a-93a9-1bafa210789b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:57.769776 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ff163f47-c2d3-419a-93a9-1bafa210789b admin admin] The token cache is being invalidate because project ffcdf8d1024748b095dfb25b6990d999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:57.770127 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ff163f47-c2d3-419a-93a9-1bafa210789b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:57.770825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ff163f47-c2d3-419a-93a9-1bafa210789b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:57.772683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1355/2702] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:57 2022] DELETE /identity/v3/projects/ffcdf8d1024748b095dfb25b6990d999 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:57.777221 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec5877-bd57-413e-b871-c08993a9962c service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:57.788987 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec5877-bd57-413e-b871-c08993a9962c service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:57.866481 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e61f29-12b0-4e3a-9086-03035ad09284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:57.867547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e61f29-12b0-4e3a-9086-03035ad09284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:57.867935 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e61f29-12b0-4e3a-9086-03035ad09284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:57.868326 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e61f29-12b0-4e3a-9086-03035ad09284 admin admin] PATH_INFO: `/v3/users/8bffe9fcf3d7412c94403b5375f533c9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:57.870318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e61f29-12b0-4e3a-9086-03035ad09284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bffe9fcf3d7412c94403b5375f533c9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:57.873662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e61f29-12b0-4e3a-9086-03035ad09284 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:58.131456 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-70e61f29-12b0-4e3a-9086-03035ad09284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bffe9fcf3d7412c94403b5375f533c9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:58.243233 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-70e61f29-12b0-4e3a-9086-03035ad09284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bffe9fcf3d7412c94403b5375f533c9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:58.257661 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-70e61f29-12b0-4e3a-9086-03035ad09284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bffe9fcf3d7412c94403b5375f533c9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:58.258872 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-70e61f29-12b0-4e3a-9086-03035ad09284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bffe9fcf3d7412c94403b5375f533c9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:58.285004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-70e61f29-12b0-4e3a-9086-03035ad09284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bffe9fcf3d7412c94403b5375f533c9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:58.297369 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1348/2703] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:57 2022] DELETE /identity/v3/users/8bffe9fcf3d7412c94403b5375f533c9 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:58.876861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff163f47-c2d3-419a-93a9-1bafa210789b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:58.879375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ff163f47-c2d3-419a-93a9-1bafa210789b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:58.902696 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff163f47-c2d3-419a-93a9-1bafa210789b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:58.979707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99e895-9852-4e7b-aa50-f3ea974290d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:58.980673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99e895-9852-4e7b-aa50-f3ea974290d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:58.981108 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99e895-9852-4e7b-aa50-f3ea974290d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:58.981446 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99e895-9852-4e7b-aa50-f3ea974290d6 admin admin] PATH_INFO: `/v3/projects/e9d50f1d81244561818743ad324265f7` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:58.983209 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99e895-9852-4e7b-aa50-f3ea974290d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d50f1d81244561818743ad324265f7)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:58.985566 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99e895-9852-4e7b-aa50-f3ea974290d6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:59.083161 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:59.099815 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1b99e895-9852-4e7b-aa50-f3ea974290d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d50f1d81244561818743ad324265f7', 'request_id': 'req-1b99e895-9852-4e7b-aa50-f3ea974290d6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:59.108087 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1b99e895-9852-4e7b-aa50-f3ea974290d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d50f1d81244561818743ad324265f7', 'request_id': 'req-1b99e895-9852-4e7b-aa50-f3ea974290d6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:59.114797 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1b99e895-9852-4e7b-aa50-f3ea974290d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d50f1d81244561818743ad324265f7', 'request_id': 'req-1b99e895-9852-4e7b-aa50-f3ea974290d6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:59.263550 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1b99e895-9852-4e7b-aa50-f3ea974290d6 admin admin] The token cache is being invalidate because project e9d50f1d81244561818743ad324265f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:59.264035 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1b99e895-9852-4e7b-aa50-f3ea974290d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:59.265225 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1b99e895-9852-4e7b-aa50-f3ea974290d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:59.267356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1356/2704] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:58 2022] DELETE /identity/v3/projects/e9d50f1d81244561818743ad324265f7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:59.274066 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74157b4-1937-4f3b-9681-869b0d38b8fb None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:59.274970 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74157b4-1937-4f3b-9681-869b0d38b8fb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:59.275614 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74157b4-1937-4f3b-9681-869b0d38b8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:59.299065 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e74157b4-1937-4f3b-9681-869b0d38b8fb None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:59.304019 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e74157b4-1937-4f3b-9681-869b0d38b8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:59.305957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:59.380928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1349/2705] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:59.390472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e0cc8-1062-467f-8261-fc9276ee4d39 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:59.390811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e0cc8-1062-467f-8261-fc9276ee4d39 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:59.391134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e0cc8-1062-467f-8261-fc9276ee4d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:59.414968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1a7e0cc8-1062-467f-8261-fc9276ee4d39 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:59.416210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1a7e0cc8-1062-467f-8261-fc9276ee4d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:59.427041 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1357/2706] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:59.431750 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74157b4-1937-4f3b-9681-869b0d38b8fb None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:59.444627 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74157b4-1937-4f3b-9681-869b0d38b8fb None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:59.450356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da05bc-7673-4bd8-87c5-3522cedfcebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:59.451044 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da05bc-7673-4bd8-87c5-3522cedfcebe admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:59.451327 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da05bc-7673-4bd8-87c5-3522cedfcebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:59.458738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da05bc-7673-4bd8-87c5-3522cedfcebe admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:59.458738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da05bc-7673-4bd8-87c5-3522cedfcebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:49:59.458738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da05bc-7673-4bd8-87c5-3522cedfcebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:59.458738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da05bc-7673-4bd8-87c5-3522cedfcebe admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:59.470430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1350/2707] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:49:59.476050 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e0cc8-1062-467f-8261-fc9276ee4d39 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:59.493423 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e0cc8-1062-467f-8261-fc9276ee4d39 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:59.500207 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b41bc-77ea-44d3-a825-4f53bed17dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:59.500929 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b41bc-77ea-44d3-a825-4f53bed17dda admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:59.501219 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b41bc-77ea-44d3-a825-4f53bed17dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:59.501491 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b41bc-77ea-44d3-a825-4f53bed17dda admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:59.502195 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b41bc-77ea-44d3-a825-4f53bed17dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:59.504314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b41bc-77ea-44d3-a825-4f53bed17dda admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:59.634851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1358/2708] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:59 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:59.641761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da05bc-7673-4bd8-87c5-3522cedfcebe admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:59.654222 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da05bc-7673-4bd8-87c5-3522cedfcebe admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:59.754818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e6834-0a68-404d-84c9-415e7b4c7838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:59.755606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e6834-0a68-404d-84c9-415e7b4c7838 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:59.756016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e6834-0a68-404d-84c9-415e7b4c7838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:59.756363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e6834-0a68-404d-84c9-415e7b4c7838 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:59.757172 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e6834-0a68-404d-84c9-415e7b4c7838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:59.759410 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e6834-0a68-404d-84c9-415e7b4c7838 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:59.890721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1351/2709] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:59 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:59.892163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b41bc-77ea-44d3-a825-4f53bed17dda admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:59.904232 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b41bc-77ea-44d3-a825-4f53bed17dda admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:59.909568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32789613-8091-4a8f-a6d8-ba5034877fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:59.910437 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32789613-8091-4a8f-a6d8-ba5034877fef admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:59.910792 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32789613-8091-4a8f-a6d8-ba5034877fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:59.911110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32789613-8091-4a8f-a6d8-ba5034877fef admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:59.911946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32789613-8091-4a8f-a6d8-ba5034877fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:59.913904 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32789613-8091-4a8f-a6d8-ba5034877fef admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:59.927474 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1359/2710] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:59.934244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e6834-0a68-404d-84c9-415e7b4c7838 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:59.948520 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e6834-0a68-404d-84c9-415e7b4c7838 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:59.958858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef91133-ea03-4273-9662-c887cbee66b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:59.960064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef91133-ea03-4273-9662-c887cbee66b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:59.960568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef91133-ea03-4273-9662-c887cbee66b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:59.961061 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef91133-ea03-4273-9662-c887cbee66b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:59.962423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef91133-ea03-4273-9662-c887cbee66b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:59.965777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef91133-ea03-4273-9662-c887cbee66b2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:59.987391 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1352/2711] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:59.993323 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32789613-8091-4a8f-a6d8-ba5034877fef admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:00.006157 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32789613-8091-4a8f-a6d8-ba5034877fef admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:00.011461 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b31fa4-86fa-4664-a468-48bfb7e3af37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:00.012517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b31fa4-86fa-4664-a468-48bfb7e3af37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:00.012963 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b31fa4-86fa-4664-a468-48bfb7e3af37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:00.013288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b31fa4-86fa-4664-a468-48bfb7e3af37 admin admin] PATH_INFO: `/v3/projects/b93d4a1155cb49acb297248875fdf277/users/b4cf9bf834ef41d79b519583cc69f453/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:00.031973 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b31fa4-86fa-4664-a468-48bfb7e3af37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93d4a1155cb49acb297248875fdf277, user_id=b4cf9bf834ef41d79b519583cc69f453, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:00.034862 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b31fa4-86fa-4664-a468-48bfb7e3af37 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:00.147130 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1360/2712] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:59 2022] PUT /identity/v3/projects/b93d4a1155cb49acb297248875fdf277/users/b4cf9bf834ef41d79b519583cc69f453/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:50:00.160091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441bd8a-27fa-4192-b9b4-7974e8bf2e74 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:00.160617 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441bd8a-27fa-4192-b9b4-7974e8bf2e74 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:00.161043 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441bd8a-27fa-4192-b9b4-7974e8bf2e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:00.195229 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9441bd8a-27fa-4192-b9b4-7974e8bf2e74 None None] MFA Rules not processed for user `b4cf9bf834ef41d79b519583cc69f453`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:50:00.196504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9441bd8a-27fa-4192-b9b4-7974e8bf2e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:00.281663 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1353/2713] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:50:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:50:00.287022 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b31fa4-86fa-4664-a468-48bfb7e3af37 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:00.363967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b31fa4-86fa-4664-a468-48bfb7e3af37 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:00.369268 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b65c9-76a3-4955-bc55-f0aff53a9647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:00.369950 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b65c9-76a3-4955-bc55-f0aff53a9647 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:00.370236 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b65c9-76a3-4955-bc55-f0aff53a9647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:00.370595 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b65c9-76a3-4955-bc55-f0aff53a9647 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:00.371343 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b65c9-76a3-4955-bc55-f0aff53a9647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:00.373355 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b65c9-76a3-4955-bc55-f0aff53a9647 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:00.502510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1361/2714] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:50:00 2022] POST /identity/v3/projects => generated 381 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:50:00.507702 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441bd8a-27fa-4192-b9b4-7974e8bf2e74 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:00.519723 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:00.529857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441bd8a-27fa-4192-b9b4-7974e8bf2e74 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:00.643096 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcec2b3-4637-45ba-b056-5c5cc6248585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:00.644120 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcec2b3-4637-45ba-b056-5c5cc6248585 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:00.644601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcec2b3-4637-45ba-b056-5c5cc6248585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:00.645119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcec2b3-4637-45ba-b056-5c5cc6248585 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:00.646480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcec2b3-4637-45ba-b056-5c5cc6248585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:00.650469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcec2b3-4637-45ba-b056-5c5cc6248585 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:00.787983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1354/2715] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:50:00 2022] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:50:00.793607 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b65c9-76a3-4955-bc55-f0aff53a9647 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:00.809304 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b65c9-76a3-4955-bc55-f0aff53a9647 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:00.817737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6393d-82d5-47b7-a973-83340a08bf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:00.819243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6393d-82d5-47b7-a973-83340a08bf9b admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:00.819774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6393d-82d5-47b7-a973-83340a08bf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:00.820265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6393d-82d5-47b7-a973-83340a08bf9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:00.821562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6393d-82d5-47b7-a973-83340a08bf9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:00.825542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6393d-82d5-47b7-a973-83340a08bf9b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:00.846374 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1362/2716] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:50:00.851856 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcec2b3-4637-45ba-b056-5c5cc6248585 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:00.873247 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcec2b3-4637-45ba-b056-5c5cc6248585 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:00.881895 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9e548-c3d8-4b4d-8a43-8dade1f73aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:00.883427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9e548-c3d8-4b4d-8a43-8dade1f73aff admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:00.883886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9e548-c3d8-4b4d-8a43-8dade1f73aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:00.884349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9e548-c3d8-4b4d-8a43-8dade1f73aff admin admin] PATH_INFO: `/v3/projects/9c06fc9a6c9349d3afc373f3fe0c4275/users/f0fc011f2d894495ad09cdcb781ed158/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:00.914942 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9e548-c3d8-4b4d-8a43-8dade1f73aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c06fc9a6c9349d3afc373f3fe0c4275, user_id=f0fc011f2d894495ad09cdcb781ed158, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:00.920778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9e548-c3d8-4b4d-8a43-8dade1f73aff admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:01.073963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1355/2717] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:50:00 2022] PUT /identity/v3/projects/9c06fc9a6c9349d3afc373f3fe0c4275/users/f0fc011f2d894495ad09cdcb781ed158/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:50:01.090993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6393d-82d5-47b7-a973-83340a08bf9b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:01.108392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6393d-82d5-47b7-a973-83340a08bf9b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:01.151341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:01.188850 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13686fc3-1319-4c11-97ba-547751ebbbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:01.189894 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13686fc3-1319-4c11-97ba-547751ebbbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:01.190353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13686fc3-1319-4c11-97ba-547751ebbbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:01.190519 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13686fc3-1319-4c11-97ba-547751ebbbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:01.191275 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13686fc3-1319-4c11-97ba-547751ebbbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:01.193277 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13686fc3-1319-4c11-97ba-547751ebbbb1 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:01.207139 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1363/2718] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:50:01.228047 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9e548-c3d8-4b4d-8a43-8dade1f73aff admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:01.241045 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9e548-c3d8-4b4d-8a43-8dade1f73aff admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:01.247980 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2f49e-6717-436c-9ac1-8eab0fba8f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:01.250985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2f49e-6717-436c-9ac1-8eab0fba8f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:01.250985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2f49e-6717-436c-9ac1-8eab0fba8f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:01.250985 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2f49e-6717-436c-9ac1-8eab0fba8f9f admin admin] PATH_INFO: `/v3/projects/9c06fc9a6c9349d3afc373f3fe0c4275/users/f0fc011f2d894495ad09cdcb781ed158/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:01.252302 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2f49e-6717-436c-9ac1-8eab0fba8f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c06fc9a6c9349d3afc373f3fe0c4275, user_id=f0fc011f2d894495ad09cdcb781ed158, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:01.255459 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2f49e-6717-436c-9ac1-8eab0fba8f9f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:01.270862 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1356/2719] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:50:01 2022] PUT /identity/v3/projects/9c06fc9a6c9349d3afc373f3fe0c4275/users/f0fc011f2d894495ad09cdcb781ed158/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:50:01.281627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f012d6-8392-4366-8b10-5764d6421606 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:01.282079 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f012d6-8392-4366-8b10-5764d6421606 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:01.282570 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f012d6-8392-4366-8b10-5764d6421606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:01.330666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-83f012d6-8392-4366-8b10-5764d6421606 None None] MFA Rules not processed for user `f0fc011f2d894495ad09cdcb781ed158`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:50:01.330666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-83f012d6-8392-4366-8b10-5764d6421606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:01.459667 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1364/2720] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:50:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:50:01.474651 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2f49e-6717-436c-9ac1-8eab0fba8f9f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:01.477416 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8ed2f49e-6717-436c-9ac1-8eab0fba8f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:01.572234 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2f49e-6717-436c-9ac1-8eab0fba8f9f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:01.578273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded8e81-17c4-4baa-9951-17b059c4e4a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:01.578983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded8e81-17c4-4baa-9951-17b059c4e4a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:01.579267 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded8e81-17c4-4baa-9951-17b059c4e4a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:01.579727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded8e81-17c4-4baa-9951-17b059c4e4a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:01.591588 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded8e81-17c4-4baa-9951-17b059c4e4a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:01.592850 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded8e81-17c4-4baa-9951-17b059c4e4a8 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:01.606078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1357/2721] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:50:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:50:01.768928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f012d6-8392-4366-8b10-5764d6421606 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:01.780957 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f012d6-8392-4366-8b10-5764d6421606 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:01.785518 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3306c-b296-4141-932f-0ce78090f823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:01.786196 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3306c-b296-4141-932f-0ce78090f823 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:01.786530 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3306c-b296-4141-932f-0ce78090f823 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:01.786812 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3306c-b296-4141-932f-0ce78090f823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:01.903756 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3306c-b296-4141-932f-0ce78090f823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:01.906685 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3306c-b296-4141-932f-0ce78090f823 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:01.926363 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1365/2722] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:50:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:50:05.548823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded8e81-17c4-4baa-9951-17b059c4e4a8 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:05.634142 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded8e81-17c4-4baa-9951-17b059c4e4a8 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:05.640722 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b3128-24c0-4b53-a3c6-936cd9925351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:05.641692 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b3128-24c0-4b53-a3c6-936cd9925351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:05.641969 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b3128-24c0-4b53-a3c6-936cd9925351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:05.642243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b3128-24c0-4b53-a3c6-936cd9925351 admin admin] PATH_INFO: `/v3/users/b4cf9bf834ef41d79b519583cc69f453` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:05.643657 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b3128-24c0-4b53-a3c6-936cd9925351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4cf9bf834ef41d79b519583cc69f453)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:05.645662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b3128-24c0-4b53-a3c6-936cd9925351 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:05.647787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:05.973846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-cc0b3128-24c0-4b53-a3c6-936cd9925351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4cf9bf834ef41d79b519583cc69f453'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:06.071499 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-cc0b3128-24c0-4b53-a3c6-936cd9925351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4cf9bf834ef41d79b519583cc69f453'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:06.081977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-cc0b3128-24c0-4b53-a3c6-936cd9925351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4cf9bf834ef41d79b519583cc69f453'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:06.082830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-cc0b3128-24c0-4b53-a3c6-936cd9925351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4cf9bf834ef41d79b519583cc69f453'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:06.097655 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-cc0b3128-24c0-4b53-a3c6-936cd9925351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4cf9bf834ef41d79b519583cc69f453'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:06.105351 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1358/2723] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:50:05 2022] DELETE /identity/v3/users/b4cf9bf834ef41d79b519583cc69f453 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:50:06.111005 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39243e0f-266a-4ec5-99b6-70a6bdb45e3f None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:06.112032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39243e0f-266a-4ec5-99b6-70a6bdb45e3f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:06.112032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39243e0f-266a-4ec5-99b6-70a6bdb45e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:06.138149 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-39243e0f-266a-4ec5-99b6-70a6bdb45e3f None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:50:06.140224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-39243e0f-266a-4ec5-99b6-70a6bdb45e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:06.229313 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:06.249503 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1366/2724] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:50:06.261261 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b3128-24c0-4b53-a3c6-936cd9925351 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:06.263687 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cc0b3128-24c0-4b53-a3c6-936cd9925351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:06.351905 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b3128-24c0-4b53-a3c6-936cd9925351 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:06.356337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9209be8-4728-4e74-afe1-f4480a852ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:06.357109 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9209be8-4728-4e74-afe1-f4480a852ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:06.357762 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9209be8-4728-4e74-afe1-f4480a852ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:06.358103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9209be8-4728-4e74-afe1-f4480a852ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:06.370669 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9209be8-4728-4e74-afe1-f4480a852ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:06.372484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9209be8-4728-4e74-afe1-f4480a852ad6 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:06.384407 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1359/2725] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:50:06.786076 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39243e0f-266a-4ec5-99b6-70a6bdb45e3f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:06.788943 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-39243e0f-266a-4ec5-99b6-70a6bdb45e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:06.812260 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39243e0f-266a-4ec5-99b6-70a6bdb45e3f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:06.847164 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788c9df-1e91-4948-9d3f-df1c9de43cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:06.848083 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788c9df-1e91-4948-9d3f-df1c9de43cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:06.848365 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788c9df-1e91-4948-9d3f-df1c9de43cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:06.848825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788c9df-1e91-4948-9d3f-df1c9de43cac admin admin] PATH_INFO: `/v3/users/53461d6ba1f04f3482281c99c324cc08` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:06.850110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788c9df-1e91-4948-9d3f-df1c9de43cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=53461d6ba1f04f3482281c99c324cc08)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:06.852134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788c9df-1e91-4948-9d3f-df1c9de43cac admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:07.098820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2788c9df-1e91-4948-9d3f-df1c9de43cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53461d6ba1f04f3482281c99c324cc08'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:07.117143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9209be8-4728-4e74-afe1-f4480a852ad6 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:07.119576 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e9209be8-4728-4e74-afe1-f4480a852ad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:07.159244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9209be8-4728-4e74-afe1-f4480a852ad6 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:07.167008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:07.168078 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:07.168457 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:07.168936 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad admin admin] PATH_INFO: `/v3/projects/b93d4a1155cb49acb297248875fdf277` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:07.170601 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=b93d4a1155cb49acb297248875fdf277)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:07.172846 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:07.180507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2788c9df-1e91-4948-9d3f-df1c9de43cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53461d6ba1f04f3482281c99c324cc08'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:07.190923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2788c9df-1e91-4948-9d3f-df1c9de43cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53461d6ba1f04f3482281c99c324cc08'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:07.191701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2788c9df-1e91-4948-9d3f-df1c9de43cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53461d6ba1f04f3482281c99c324cc08'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:07.211459 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2788c9df-1e91-4948-9d3f-df1c9de43cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53461d6ba1f04f3482281c99c324cc08'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:07.220694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1367/2726] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:50:06 2022] DELETE /identity/v3/users/53461d6ba1f04f3482281c99c324cc08 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:50:07.225445 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d92eb-f249-4844-8dde-104f07d8b970 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:07.225745 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d92eb-f249-4844-8dde-104f07d8b970 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:07.226006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d92eb-f249-4844-8dde-104f07d8b970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:07.246465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-973d92eb-f249-4844-8dde-104f07d8b970 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:50:07.247803 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-973d92eb-f249-4844-8dde-104f07d8b970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:07.329033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1368/2727] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:50:07.341519 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d92eb-f249-4844-8dde-104f07d8b970 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:07.344642 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-973d92eb-f249-4844-8dde-104f07d8b970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:07.359547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b93d4a1155cb49acb297248875fdf277', 'request_id': 'req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:07.371509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b93d4a1155cb49acb297248875fdf277', 'request_id': 'req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:07.384607 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b93d4a1155cb49acb297248875fdf277', 'request_id': 'req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:07.435836 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d92eb-f249-4844-8dde-104f07d8b970 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:07.452488 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:07.503148 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad admin admin] The token cache is being invalidate because project b93d4a1155cb49acb297248875fdf277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:50:07.504061 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:07.505297 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:07.508545 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1360/2728] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:50:07 2022] DELETE /identity/v3/projects/b93d4a1155cb49acb297248875fdf277 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:50:07.514797 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:07.516396 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:07.519069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef9f43-1860-42f7-a882-a4f870746248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:07.519737 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef9f43-1860-42f7-a882-a4f870746248 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:07.520960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef9f43-1860-42f7-a882-a4f870746248 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:07.520960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef9f43-1860-42f7-a882-a4f870746248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:07.523221 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e4ef9f43-1860-42f7-a882-a4f870746248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:07.524149 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:07.610119 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb568b0-420e-43bc-8ebb-6590e5ef42ad admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:07.613129 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef9f43-1860-42f7-a882-a4f870746248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:07.615123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef9f43-1860-42f7-a882-a4f870746248 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:07.615572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9123887-9170-42c7-ac61-e250cfc9ad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:07.616496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9123887-9170-42c7-ac61-e250cfc9ad02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:07.616780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9123887-9170-42c7-ac61-e250cfc9ad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:07.617058 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9123887-9170-42c7-ac61-e250cfc9ad02 admin admin] PATH_INFO: `/v3/users/f0fc011f2d894495ad09cdcb781ed158` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:07.618455 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9123887-9170-42c7-ac61-e250cfc9ad02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0fc011f2d894495ad09cdcb781ed158)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:07.621374 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9123887-9170-42c7-ac61-e250cfc9ad02 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:07.628489 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1369/2729] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:50:07.876598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e9123887-9170-42c7-ac61-e250cfc9ad02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0fc011f2d894495ad09cdcb781ed158'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:07.986153 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e9123887-9170-42c7-ac61-e250cfc9ad02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0fc011f2d894495ad09cdcb781ed158'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:07.995906 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e9123887-9170-42c7-ac61-e250cfc9ad02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0fc011f2d894495ad09cdcb781ed158'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:07.997880 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e9123887-9170-42c7-ac61-e250cfc9ad02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0fc011f2d894495ad09cdcb781ed158'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:08.014376 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e9123887-9170-42c7-ac61-e250cfc9ad02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0fc011f2d894495ad09cdcb781ed158'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:08.022346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1361/2730] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:50:07 2022] DELETE /identity/v3/users/f0fc011f2d894495ad09cdcb781ed158 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:50:08.316447 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef9f43-1860-42f7-a882-a4f870746248 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:08.318487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e4ef9f43-1860-42f7-a882-a4f870746248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:08.332916 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef9f43-1860-42f7-a882-a4f870746248 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:08.453379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b194c6b-3bb5-4b85-a669-49729c5beeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:08.464658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b194c6b-3bb5-4b85-a669-49729c5beeed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:08.464658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b194c6b-3bb5-4b85-a669-49729c5beeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:08.464658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b194c6b-3bb5-4b85-a669-49729c5beeed admin admin] PATH_INFO: `/v3/projects/f07c01ee11b048e792bbd2483a5fd4b5` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:08.464658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b194c6b-3bb5-4b85-a669-49729c5beeed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07c01ee11b048e792bbd2483a5fd4b5)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:08.464658 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b194c6b-3bb5-4b85-a669-49729c5beeed admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:08.669671 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8b194c6b-3bb5-4b85-a669-49729c5beeed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07c01ee11b048e792bbd2483a5fd4b5', 'request_id': 'req-8b194c6b-3bb5-4b85-a669-49729c5beeed'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:08.678462 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8b194c6b-3bb5-4b85-a669-49729c5beeed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07c01ee11b048e792bbd2483a5fd4b5', 'request_id': 'req-8b194c6b-3bb5-4b85-a669-49729c5beeed'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:08.685167 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8b194c6b-3bb5-4b85-a669-49729c5beeed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07c01ee11b048e792bbd2483a5fd4b5', 'request_id': 'req-8b194c6b-3bb5-4b85-a669-49729c5beeed'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:08.802902 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8b194c6b-3bb5-4b85-a669-49729c5beeed admin admin] The token cache is being invalidate because project f07c01ee11b048e792bbd2483a5fd4b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:50:08.803533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8b194c6b-3bb5-4b85-a669-49729c5beeed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:08.805123 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8b194c6b-3bb5-4b85-a669-49729c5beeed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:08.811314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1370/2731] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:50:08 2022] DELETE /identity/v3/projects/f07c01ee11b048e792bbd2483a5fd4b5 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:50:08.850683 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:09.091636 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9123887-9170-42c7-ac61-e250cfc9ad02 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:09.094649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e9123887-9170-42c7-ac61-e250cfc9ad02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:09.129399 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9123887-9170-42c7-ac61-e250cfc9ad02 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:09.226781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61de2b-5e16-4163-9043-52bbf368e676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:09.227707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61de2b-5e16-4163-9043-52bbf368e676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:09.227996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61de2b-5e16-4163-9043-52bbf368e676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:09.228269 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61de2b-5e16-4163-9043-52bbf368e676 admin admin] PATH_INFO: `/v3/projects/9c06fc9a6c9349d3afc373f3fe0c4275` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:09.229958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61de2b-5e16-4163-9043-52bbf368e676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c06fc9a6c9349d3afc373f3fe0c4275)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:09.231998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61de2b-5e16-4163-9043-52bbf368e676 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:09.411670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:09.443913 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1b61de2b-5e16-4163-9043-52bbf368e676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c06fc9a6c9349d3afc373f3fe0c4275', 'request_id': 'req-1b61de2b-5e16-4163-9043-52bbf368e676'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:09.455456 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1b61de2b-5e16-4163-9043-52bbf368e676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c06fc9a6c9349d3afc373f3fe0c4275', 'request_id': 'req-1b61de2b-5e16-4163-9043-52bbf368e676'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:09.468564 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1b61de2b-5e16-4163-9043-52bbf368e676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c06fc9a6c9349d3afc373f3fe0c4275', 'request_id': 'req-1b61de2b-5e16-4163-9043-52bbf368e676'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:09.610201 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1b61de2b-5e16-4163-9043-52bbf368e676 admin admin] The token cache is being invalidate because project 9c06fc9a6c9349d3afc373f3fe0c4275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:50:09.610525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1b61de2b-5e16-4163-9043-52bbf368e676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:09.611275 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1b61de2b-5e16-4163-9043-52bbf368e676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:50:09.613063 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1362/2732] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:50:09 2022] DELETE /identity/v3/projects/9c06fc9a6c9349d3afc373f3fe0c4275 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:50:09.619452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4dfb8-cf28-44e8-abcc-54918607cabc None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:09.620056 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4dfb8-cf28-44e8-abcc-54918607cabc None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:09.621590 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4dfb8-cf28-44e8-abcc-54918607cabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:09.655276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0cd4dfb8-cf28-44e8-abcc-54918607cabc None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:50:09.657338 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0cd4dfb8-cf28-44e8-abcc-54918607cabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:09.787302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1371/2733] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:50:09.796987 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4646-22fd-4bfa-9712-30d07df0358c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:09.797535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4646-22fd-4bfa-9712-30d07df0358c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:09.798053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4646-22fd-4bfa-9712-30d07df0358c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:09.828462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8b6c4646-22fd-4bfa-9712-30d07df0358c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:50:09.830690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8b6c4646-22fd-4bfa-9712-30d07df0358c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:09.849011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1363/2734] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:50:09.850469 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4dfb8-cf28-44e8-abcc-54918607cabc None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:09.862812 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4dfb8-cf28-44e8-abcc-54918607cabc None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:09.868586 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02433132-711a-4831-9f6f-df5885cb1ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:09.868818 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02433132-711a-4831-9f6f-df5885cb1ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:09.869027 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02433132-711a-4831-9f6f-df5885cb1ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:09.869326 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02433132-711a-4831-9f6f-df5885cb1ab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:09.870150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02433132-711a-4831-9f6f-df5885cb1ab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:50:09.870744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02433132-711a-4831-9f6f-df5885cb1ab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:09.872490 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02433132-711a-4831-9f6f-df5885cb1ab0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:09.891379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1372/2735] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:50:09.893249 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c4646-22fd-4bfa-9712-30d07df0358c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:09.910368 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c4646-22fd-4bfa-9712-30d07df0358c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:09.918869 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137a28e-b24c-465e-bb72-090bb359ff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:09.920053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137a28e-b24c-465e-bb72-090bb359ff60 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:09.920418 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137a28e-b24c-465e-bb72-090bb359ff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:09.920981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137a28e-b24c-465e-bb72-090bb359ff60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:09.922265 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137a28e-b24c-465e-bb72-090bb359ff60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:09.935225 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137a28e-b24c-465e-bb72-090bb359ff60 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:10.085800 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1364/2736] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:50:09 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:50:10.091033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02433132-711a-4831-9f6f-df5885cb1ab0 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:10.114787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02433132-711a-4831-9f6f-df5885cb1ab0 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:10.300261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d7c91-645e-4edd-9309-6229dae369ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:10.301201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d7c91-645e-4edd-9309-6229dae369ff admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:10.301574 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d7c91-645e-4edd-9309-6229dae369ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:10.303507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d7c91-645e-4edd-9309-6229dae369ff admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:10.303507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d7c91-645e-4edd-9309-6229dae369ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:10.307335 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d7c91-645e-4edd-9309-6229dae369ff admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:10.497593 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1373/2737] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:50:10 2022] POST /identity/v3/users => generated 286 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:50:10.499126 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137a28e-b24c-465e-bb72-090bb359ff60 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:10.521955 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137a28e-b24c-465e-bb72-090bb359ff60 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:10.530968 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac095f0d-0a43-4274-9592-da727d6df827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:10.532156 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac095f0d-0a43-4274-9592-da727d6df827 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:10.532842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac095f0d-0a43-4274-9592-da727d6df827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:10.533346 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac095f0d-0a43-4274-9592-da727d6df827 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:10.534844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac095f0d-0a43-4274-9592-da727d6df827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:10.538101 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac095f0d-0a43-4274-9592-da727d6df827 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:10.559930 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1365/2738] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:50:10.565478 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d7c91-645e-4edd-9309-6229dae369ff admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:10.587656 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d7c91-645e-4edd-9309-6229dae369ff admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:10.605547 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9a1c8-59aa-442c-b638-299dcc0514fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:10.606746 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9a1c8-59aa-442c-b638-299dcc0514fb admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:10.612741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9a1c8-59aa-442c-b638-299dcc0514fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:10.612741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9a1c8-59aa-442c-b638-299dcc0514fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:10.612741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9a1c8-59aa-442c-b638-299dcc0514fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:10.612741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9a1c8-59aa-442c-b638-299dcc0514fb admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:10.630163 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac095f0d-0a43-4274-9592-da727d6df827 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:10.630731 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1374/2739] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:50:10.648921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac095f0d-0a43-4274-9592-da727d6df827 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:10.655804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b734-e784-4f18-b730-595a599d7980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:10.656779 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b734-e784-4f18-b730-595a599d7980 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:10.657069 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b734-e784-4f18-b730-595a599d7980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:10.657569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b734-e784-4f18-b730-595a599d7980 admin admin] PATH_INFO: `/v3/projects/70ca8a5e439c464db942457f1b716758/users/100b7a8fab984d95939011b177465de8/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:10.685515 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880b734-e784-4f18-b730-595a599d7980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ca8a5e439c464db942457f1b716758, user_id=100b7a8fab984d95939011b177465de8, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:10.691023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880b734-e784-4f18-b730-595a599d7980 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:10.808064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1366/2740] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:50:10 2022] PUT /identity/v3/projects/70ca8a5e439c464db942457f1b716758/users/100b7a8fab984d95939011b177465de8/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:50:10.814114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee40da8-19ec-417a-94ec-868ea58c3239 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:10.814424 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee40da8-19ec-417a-94ec-868ea58c3239 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:10.814703 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee40da8-19ec-417a-94ec-868ea58c3239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:10.836170 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8ee40da8-19ec-417a-94ec-868ea58c3239 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:50:10.837457 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8ee40da8-19ec-417a-94ec-868ea58c3239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:10.924542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1375/2741] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:50:10.939038 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b734-e784-4f18-b730-595a599d7980 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:10.941003 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f880b734-e784-4f18-b730-595a599d7980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:11.012819 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b734-e784-4f18-b730-595a599d7980 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:11.017116 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6f167-72d6-4b54-b83e-012cae4ff3de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:11.017782 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6f167-72d6-4b54-b83e-012cae4ff3de service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:11.018062 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6f167-72d6-4b54-b83e-012cae4ff3de service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:11.018421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6f167-72d6-4b54-b83e-012cae4ff3de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:11.029884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6f167-72d6-4b54-b83e-012cae4ff3de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:11.031412 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6f167-72d6-4b54-b83e-012cae4ff3de service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:11.043569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1367/2742] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:50:13.450106 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ba196-31b1-472f-ba61-7621a4c662f5 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:13.451066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ba196-31b1-472f-ba61-7621a4c662f5 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:13.451220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ba196-31b1-472f-ba61-7621a4c662f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:13.459502 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:13.489524 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-072ba196-31b1-472f-ba61-7621a4c662f5 None None] MFA Rules not processed for user `100b7a8fab984d95939011b177465de8`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:50:13.490819 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-072ba196-31b1-472f-ba61-7621a4c662f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:13.598797 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1376/2743] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:50:13.605730 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6f167-72d6-4b54-b83e-012cae4ff3de service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:13.618419 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6f167-72d6-4b54-b83e-012cae4ff3de service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:13.623884 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daf6ae-4b50-4932-8c82-724cef26aa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:13.624572 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daf6ae-4b50-4932-8c82-724cef26aa88 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:13.624851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daf6ae-4b50-4932-8c82-724cef26aa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:13.625127 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daf6ae-4b50-4932-8c82-724cef26aa88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:13.625849 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25daf6ae-4b50-4932-8c82-724cef26aa88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:13.627831 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25daf6ae-4b50-4932-8c82-724cef26aa88 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:13.814157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1368/2744] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:50:13 2022] POST /identity/v3/projects => generated 371 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:50:13.824694 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ba196-31b1-472f-ba61-7621a4c662f5 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:13.841003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ba196-31b1-472f-ba61-7621a4c662f5 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:13.922003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a9226-225c-41e3-a9e4-d6e86273305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:13.922003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a9226-225c-41e3-a9e4-d6e86273305f admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:13.922003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a9226-225c-41e3-a9e4-d6e86273305f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:13.922003 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a9226-225c-41e3-a9e4-d6e86273305f admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:13.922752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a9226-225c-41e3-a9e4-d6e86273305f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:13.924641 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a9226-225c-41e3-a9e4-d6e86273305f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:14.062385 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1377/2745] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:50:13 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:50:14.066992 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daf6ae-4b50-4932-8c82-724cef26aa88 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:14.080076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daf6ae-4b50-4932-8c82-724cef26aa88 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:14.085554 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98a947-b7a9-49bc-9c49-4cb8123cc103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:14.086438 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98a947-b7a9-49bc-9c49-4cb8123cc103 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:14.086796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98a947-b7a9-49bc-9c49-4cb8123cc103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:14.087146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98a947-b7a9-49bc-9c49-4cb8123cc103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:14.087963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98a947-b7a9-49bc-9c49-4cb8123cc103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:14.090598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98a947-b7a9-49bc-9c49-4cb8123cc103 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:14.103306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1369/2746] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:50:14.113177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a9226-225c-41e3-a9e4-d6e86273305f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:14.127147 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a9226-225c-41e3-a9e4-d6e86273305f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:14.133768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f83be-9d9f-4ec4-9760-2f7bc04ef71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:14.134757 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f83be-9d9f-4ec4-9760-2f7bc04ef71c admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:14.135016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f83be-9d9f-4ec4-9760-2f7bc04ef71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:14.135296 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f83be-9d9f-4ec4-9760-2f7bc04ef71c admin admin] PATH_INFO: `/v3/projects/b2b60471ee5f4d8f8bb62c9dd2d7cdf2/users/e8a6aa42059246d0a3bacf482891b548/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:14.155326 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f83be-9d9f-4ec4-9760-2f7bc04ef71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b60471ee5f4d8f8bb62c9dd2d7cdf2, user_id=e8a6aa42059246d0a3bacf482891b548, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:14.158507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f83be-9d9f-4ec4-9760-2f7bc04ef71c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:14.318391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1378/2747] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:50:14 2022] PUT /identity/v3/projects/b2b60471ee5f4d8f8bb62c9dd2d7cdf2/users/e8a6aa42059246d0a3bacf482891b548/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:50:14.324342 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98a947-b7a9-49bc-9c49-4cb8123cc103 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:14.340198 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98a947-b7a9-49bc-9c49-4cb8123cc103 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:14.364487 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:14.417202 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cdc89-b358-45c1-85c4-9b2b5eb9a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:14.418423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cdc89-b358-45c1-85c4-9b2b5eb9a55a admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:14.418727 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cdc89-b358-45c1-85c4-9b2b5eb9a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:14.419016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cdc89-b358-45c1-85c4-9b2b5eb9a55a admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:14.419777 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cdc89-b358-45c1-85c4-9b2b5eb9a55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:14.421684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cdc89-b358-45c1-85c4-9b2b5eb9a55a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:14.438450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1370/2748] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:50:14.455733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f83be-9d9f-4ec4-9760-2f7bc04ef71c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:14.468679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f83be-9d9f-4ec4-9760-2f7bc04ef71c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:14.474414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf453b-e012-4332-9f99-d9fe41521ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:14.475359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf453b-e012-4332-9f99-d9fe41521ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:14.475679 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf453b-e012-4332-9f99-d9fe41521ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:14.475975 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf453b-e012-4332-9f99-d9fe41521ef9 admin admin] PATH_INFO: `/v3/projects/b2b60471ee5f4d8f8bb62c9dd2d7cdf2/users/e8a6aa42059246d0a3bacf482891b548/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:14.479558 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf453b-e012-4332-9f99-d9fe41521ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b60471ee5f4d8f8bb62c9dd2d7cdf2, user_id=e8a6aa42059246d0a3bacf482891b548, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:14.482861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf453b-e012-4332-9f99-d9fe41521ef9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:14.496863 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1379/2749] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:50:14 2022] PUT /identity/v3/projects/b2b60471ee5f4d8f8bb62c9dd2d7cdf2/users/e8a6aa42059246d0a3bacf482891b548/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:50:16.333149 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee83c23-133b-4fed-8376-1f836a7b4973 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:16.334055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee83c23-133b-4fed-8376-1f836a7b4973 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:16.334055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee83c23-133b-4fed-8376-1f836a7b4973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:16.365046 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-cee83c23-133b-4fed-8376-1f836a7b4973 None None] MFA Rules not processed for user `e8a6aa42059246d0a3bacf482891b548`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:50:16.366562 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cee83c23-133b-4fed-8376-1f836a7b4973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:16.459507 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1371/2750] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:50:16 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:50:16.471272 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f0932-fd82-44fd-b8e7-f5ef006a971b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:16.471912 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f0932-fd82-44fd-b8e7-f5ef006a971b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:16.471912 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f0932-fd82-44fd-b8e7-f5ef006a971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:16.493176 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e38f0932-fd82-44fd-b8e7-f5ef006a971b None None] MFA Rules not processed for user `100b7a8fab984d95939011b177465de8`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:50:16.495860 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e38f0932-fd82-44fd-b8e7-f5ef006a971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:16.549639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:16.565728 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1380/2751] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:50:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:50:16.579428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee83c23-133b-4fed-8376-1f836a7b4973 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:16.584088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cee83c23-133b-4fed-8376-1f836a7b4973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:16.674205 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee83c23-133b-4fed-8376-1f836a7b4973 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:16.680473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1afcc-567a-40be-9b9f-68deebe06428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:16.681178 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1afcc-567a-40be-9b9f-68deebe06428 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:16.681463 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1afcc-567a-40be-9b9f-68deebe06428 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:16.681738 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1afcc-567a-40be-9b9f-68deebe06428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:16.691833 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1afcc-567a-40be-9b9f-68deebe06428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:16.693627 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1afcc-567a-40be-9b9f-68deebe06428 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:16.705277 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1372/2752] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:50:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:50:25.836546 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652679-4a8e-485c-85d0-b1459c158d76 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:25.837311 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652679-4a8e-485c-85d0-b1459c158d76 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:25.837506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652679-4a8e-485c-85d0-b1459c158d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:25.868332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ca652679-4a8e-485c-85d0-b1459c158d76 None None] MFA Rules not processed for user `6ab418830d774189899baaf615001e47`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:50:25.871023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ca652679-4a8e-485c-85d0-b1459c158d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:25.946774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1381/2753] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:50:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:50:26.700043 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=88 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:32.205789 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1afcc-567a-40be-9b9f-68deebe06428 service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:32.274209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1afcc-567a-40be-9b9f-68deebe06428 service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:32.278654 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086a24d-0f3a-49dc-88c5-861a431ca2ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:32.279337 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086a24d-0f3a-49dc-88c5-861a431ca2ea service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:32.279757 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086a24d-0f3a-49dc-88c5-861a431ca2ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:32.280097 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086a24d-0f3a-49dc-88c5-861a431ca2ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:32.282522 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c086a24d-0f3a-49dc-88c5-861a431ca2ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:32.297557 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086a24d-0f3a-49dc-88c5-861a431ca2ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:32.299151 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086a24d-0f3a-49dc-88c5-861a431ca2ea service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:32.311590 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1373/2754] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:50:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:50:35.159334 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca652679-4a8e-485c-85d0-b1459c158d76 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:35.160909 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ca652679-4a8e-485c-85d0-b1459c158d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:35.234784 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca652679-4a8e-485c-85d0-b1459c158d76 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:35.239423 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05fb09-622b-45ba-971a-576ec449b56c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:35.240165 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05fb09-622b-45ba-971a-576ec449b56c service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:35.240573 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05fb09-622b-45ba-971a-576ec449b56c service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:35.240919 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05fb09-622b-45ba-971a-576ec449b56c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:35.253726 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05fb09-622b-45ba-971a-576ec449b56c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:35.260377 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05fb09-622b-45ba-971a-576ec449b56c service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:35.267790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1382/2755] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:50:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:50:35.269167 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086a24d-0f3a-49dc-88c5-861a431ca2ea service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:35.271637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c086a24d-0f3a-49dc-88c5-861a431ca2ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:35.292436 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086a24d-0f3a-49dc-88c5-861a431ca2ea service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:35.299270 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1b622-fbe1-4b66-b989-fcff0f8a6762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:35.300529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1b622-fbe1-4b66-b989-fcff0f8a6762 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:35.301047 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1b622-fbe1-4b66-b989-fcff0f8a6762 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:35.301560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1b622-fbe1-4b66-b989-fcff0f8a6762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:35.306365 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0fc1b622-fbe1-4b66-b989-fcff0f8a6762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:35.333445 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1b622-fbe1-4b66-b989-fcff0f8a6762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:35.336862 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1b622-fbe1-4b66-b989-fcff0f8a6762 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:35.352057 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1374/2756] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:50:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:50:45.262600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=55 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:45.344834 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=32 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:03.970862 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05fb09-622b-45ba-971a-576ec449b56c service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:04.045707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05fb09-622b-45ba-971a-576ec449b56c service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:04.051143 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea95c7-bfa5-421b-97a9-e97361b33c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:04.052067 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea95c7-bfa5-421b-97a9-e97361b33c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:04.052505 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea95c7-bfa5-421b-97a9-e97361b33c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:04.052811 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea95c7-bfa5-421b-97a9-e97361b33c7b admin admin] PATH_INFO: `/v3/users/100b7a8fab984d95939011b177465de8` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:04.054069 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea95c7-bfa5-421b-97a9-e97361b33c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=100b7a8fab984d95939011b177465de8)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:04.056728 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea95c7-bfa5-421b-97a9-e97361b33c7b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:04.387853 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b1ea95c7-bfa5-421b-97a9-e97361b33c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100b7a8fab984d95939011b177465de8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:04.493030 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b1ea95c7-bfa5-421b-97a9-e97361b33c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100b7a8fab984d95939011b177465de8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:04.501571 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b1ea95c7-bfa5-421b-97a9-e97361b33c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100b7a8fab984d95939011b177465de8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:04.502298 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b1ea95c7-bfa5-421b-97a9-e97361b33c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100b7a8fab984d95939011b177465de8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:04.517175 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b1ea95c7-bfa5-421b-97a9-e97361b33c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100b7a8fab984d95939011b177465de8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:04.524126 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1383/2757] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:51:03 2022] DELETE /identity/v3/users/100b7a8fab984d95939011b177465de8 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:51:04.864251 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1b622-fbe1-4b66-b989-fcff0f8a6762 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:04.880324 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1b622-fbe1-4b66-b989-fcff0f8a6762 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:04.967427 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:04.968311 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:04.968598 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:04.968877 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d admin admin] PATH_INFO: `/v3/projects/70ca8a5e439c464db942457f1b716758` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:04.970093 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ca8a5e439c464db942457f1b716758)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:04.972152 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:05.180312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ca8a5e439c464db942457f1b716758', 'request_id': 'req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:05.187795 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ca8a5e439c464db942457f1b716758', 'request_id': 'req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:05.194091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ca8a5e439c464db942457f1b716758', 'request_id': 'req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:05.323189 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d admin admin] The token cache is being invalidate because project 70ca8a5e439c464db942457f1b716758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:51:05.323531 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:05.324280 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:05.326340 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1375/2758] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:51:04 2022] DELETE /identity/v3/projects/70ca8a5e439c464db942457f1b716758 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:51:05.330980 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea95c7-bfa5-421b-97a9-e97361b33c7b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:05.337179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b1ea95c7-bfa5-421b-97a9-e97361b33c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:05.346077 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea95c7-bfa5-421b-97a9-e97361b33c7b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:05.410012 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197247a3-4066-4c5f-884d-22794b17b727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:05.410918 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197247a3-4066-4c5f-884d-22794b17b727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:05.411201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197247a3-4066-4c5f-884d-22794b17b727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:05.411548 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197247a3-4066-4c5f-884d-22794b17b727 admin admin] PATH_INFO: `/v3/users/e8a6aa42059246d0a3bacf482891b548` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:05.412687 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197247a3-4066-4c5f-884d-22794b17b727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a6aa42059246d0a3bacf482891b548)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:05.414636 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197247a3-4066-4c5f-884d-22794b17b727 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:05.438939 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:05.702834 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-197247a3-4066-4c5f-884d-22794b17b727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a6aa42059246d0a3bacf482891b548'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:05.818725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-197247a3-4066-4c5f-884d-22794b17b727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a6aa42059246d0a3bacf482891b548'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:05.827774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-197247a3-4066-4c5f-884d-22794b17b727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a6aa42059246d0a3bacf482891b548'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:05.828634 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-197247a3-4066-4c5f-884d-22794b17b727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a6aa42059246d0a3bacf482891b548'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:05.842300 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-197247a3-4066-4c5f-884d-22794b17b727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a6aa42059246d0a3bacf482891b548'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:05.848813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1384/2759] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:51:05 2022] DELETE /identity/v3/users/e8a6aa42059246d0a3bacf482891b548 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:51:06.221312 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:06.222911 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:06.237966 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d619c7-6476-4f30-b066-7a8eb4cfe63d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:06.304371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c5b6d-9a34-4cc7-abff-187b56640ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:06.305242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5b6d-9a34-4cc7-abff-187b56640ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:06.305525 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5b6d-9a34-4cc7-abff-187b56640ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:06.305922 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5b6d-9a34-4cc7-abff-187b56640ed0 admin admin] PATH_INFO: `/v3/projects/b2b60471ee5f4d8f8bb62c9dd2d7cdf2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:06.307236 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c5b6d-9a34-4cc7-abff-187b56640ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b60471ee5f4d8f8bb62c9dd2d7cdf2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:06.309229 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c5b6d-9a34-4cc7-abff-187b56640ed0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:06.477406 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:06.498626 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c73c5b6d-9a34-4cc7-abff-187b56640ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b60471ee5f4d8f8bb62c9dd2d7cdf2', 'request_id': 'req-c73c5b6d-9a34-4cc7-abff-187b56640ed0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:06.505785 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c73c5b6d-9a34-4cc7-abff-187b56640ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b60471ee5f4d8f8bb62c9dd2d7cdf2', 'request_id': 'req-c73c5b6d-9a34-4cc7-abff-187b56640ed0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:06.513958 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c73c5b6d-9a34-4cc7-abff-187b56640ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b60471ee5f4d8f8bb62c9dd2d7cdf2', 'request_id': 'req-c73c5b6d-9a34-4cc7-abff-187b56640ed0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:06.647451 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c73c5b6d-9a34-4cc7-abff-187b56640ed0 admin admin] The token cache is being invalidate because project b2b60471ee5f4d8f8bb62c9dd2d7cdf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:51:06.647718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c73c5b6d-9a34-4cc7-abff-187b56640ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:06.648399 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c73c5b6d-9a34-4cc7-abff-187b56640ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:06.650814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1376/2760] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:51:06 2022] DELETE /identity/v3/projects/b2b60471ee5f4d8f8bb62c9dd2d7cdf2 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:51:06.655873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be856b11-02e7-47fb-9229-8921ed076ffe None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:06.656422 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be856b11-02e7-47fb-9229-8921ed076ffe None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:06.656422 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be856b11-02e7-47fb-9229-8921ed076ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:06.676115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-be856b11-02e7-47fb-9229-8921ed076ffe None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:51:06.677319 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-be856b11-02e7-47fb-9229-8921ed076ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:06.746666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1385/2761] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:51:06.755123 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5161f-ace1-4706-9e1d-99448435b902 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:06.757075 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5161f-ace1-4706-9e1d-99448435b902 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:06.757075 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5161f-ace1-4706-9e1d-99448435b902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:06.777086 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f3c5161f-ace1-4706-9e1d-99448435b902 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:51:06.778378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f3c5161f-ace1-4706-9e1d-99448435b902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:06.788020 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1377/2762] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:51:06.797735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be856b11-02e7-47fb-9229-8921ed076ffe None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:06.809393 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be856b11-02e7-47fb-9229-8921ed076ffe None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:06.814712 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853b7f6-7718-433f-a2e8-dfd314a4d932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:06.815347 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853b7f6-7718-433f-a2e8-dfd314a4d932 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:06.815633 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853b7f6-7718-433f-a2e8-dfd314a4d932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:06.815909 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853b7f6-7718-433f-a2e8-dfd314a4d932 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:06.816648 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853b7f6-7718-433f-a2e8-dfd314a4d932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:51:06.816963 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853b7f6-7718-433f-a2e8-dfd314a4d932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:06.818886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853b7f6-7718-433f-a2e8-dfd314a4d932 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:06.832164 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1386/2763] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:51:06.836735 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5161f-ace1-4706-9e1d-99448435b902 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:06.847335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5161f-ace1-4706-9e1d-99448435b902 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:06.853331 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362e0e0-2c1e-4b1d-b2b9-d69e3fd739b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:06.854021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362e0e0-2c1e-4b1d-b2b9-d69e3fd739b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:06.854304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362e0e0-2c1e-4b1d-b2b9-d69e3fd739b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:06.854611 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362e0e0-2c1e-4b1d-b2b9-d69e3fd739b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:06.855338 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362e0e0-2c1e-4b1d-b2b9-d69e3fd739b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:06.857654 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362e0e0-2c1e-4b1d-b2b9-d69e3fd739b5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:07.003651 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1378/2764] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:51:06 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:51:07.008613 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853b7f6-7718-433f-a2e8-dfd314a4d932 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:07.025173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853b7f6-7718-433f-a2e8-dfd314a4d932 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:07.084487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3df0cd-68d6-4439-ac2b-44677fb7685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:07.085175 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3df0cd-68d6-4439-ac2b-44677fb7685d admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:07.085470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3df0cd-68d6-4439-ac2b-44677fb7685d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:07.085760 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3df0cd-68d6-4439-ac2b-44677fb7685d admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:07.086500 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3df0cd-68d6-4439-ac2b-44677fb7685d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:07.089288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3df0cd-68d6-4439-ac2b-44677fb7685d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:07.231864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1387/2765] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:51:07 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:51:07.236191 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362e0e0-2c1e-4b1d-b2b9-d69e3fd739b5 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:07.248099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362e0e0-2c1e-4b1d-b2b9-d69e3fd739b5 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:07.253193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00d395-b84c-4847-8f8e-16c84d59e30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:07.253919 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00d395-b84c-4847-8f8e-16c84d59e30b admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:07.254146 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00d395-b84c-4847-8f8e-16c84d59e30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:07.254461 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00d395-b84c-4847-8f8e-16c84d59e30b admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:07.255194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00d395-b84c-4847-8f8e-16c84d59e30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:07.256906 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00d395-b84c-4847-8f8e-16c84d59e30b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:07.268752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1379/2766] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:51:07.275051 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3df0cd-68d6-4439-ac2b-44677fb7685d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:07.285587 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3df0cd-68d6-4439-ac2b-44677fb7685d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:07.291423 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b31e5-c9aa-4ade-90d9-469d266fd2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:07.292110 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b31e5-c9aa-4ade-90d9-469d266fd2ba admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:07.292391 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b31e5-c9aa-4ade-90d9-469d266fd2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:07.292666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b31e5-c9aa-4ade-90d9-469d266fd2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:07.293430 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b31e5-c9aa-4ade-90d9-469d266fd2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:07.295120 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b31e5-c9aa-4ade-90d9-469d266fd2ba admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:07.306707 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1388/2767] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:51:07.311393 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00d395-b84c-4847-8f8e-16c84d59e30b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:07.322215 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00d395-b84c-4847-8f8e-16c84d59e30b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:07.326966 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa13a5-03e7-47f6-8425-acec87671268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:07.327851 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa13a5-03e7-47f6-8425-acec87671268 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:07.328131 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa13a5-03e7-47f6-8425-acec87671268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:07.328413 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa13a5-03e7-47f6-8425-acec87671268 admin admin] PATH_INFO: `/v3/projects/602ca91cd5ac4136a734774533225d72/users/4b0dd6bf29154142a00aa5e99f9caa25/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:07.347014 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa13a5-03e7-47f6-8425-acec87671268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602ca91cd5ac4136a734774533225d72, user_id=4b0dd6bf29154142a00aa5e99f9caa25, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:07.349787 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa13a5-03e7-47f6-8425-acec87671268 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:07.454554 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1380/2768] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:51:07 2022] PUT /identity/v3/projects/602ca91cd5ac4136a734774533225d72/users/4b0dd6bf29154142a00aa5e99f9caa25/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:51:07.471878 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44ee09-c76c-4b34-8509-af0ab5da3cf7 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:07.472159 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44ee09-c76c-4b34-8509-af0ab5da3cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:07.472436 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44ee09-c76c-4b34-8509-af0ab5da3cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:07.479591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:07.501070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0d44ee09-c76c-4b34-8509-af0ab5da3cf7 None None] MFA Rules not processed for user `4b0dd6bf29154142a00aa5e99f9caa25`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:51:07.502390 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0d44ee09-c76c-4b34-8509-af0ab5da3cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:07.570738 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1389/2769] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:51:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:51:07.575984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa13a5-03e7-47f6-8425-acec87671268 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:07.640944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa13a5-03e7-47f6-8425-acec87671268 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:07.645542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad210ffb-d560-4c6b-b9de-c99b13e08050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:07.646194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad210ffb-d560-4c6b-b9de-c99b13e08050 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:07.646507 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad210ffb-d560-4c6b-b9de-c99b13e08050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:07.646786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad210ffb-d560-4c6b-b9de-c99b13e08050 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:07.647471 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad210ffb-d560-4c6b-b9de-c99b13e08050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:07.649411 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad210ffb-d560-4c6b-b9de-c99b13e08050 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:07.740467 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1381/2770] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:51:07 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:51:07.745480 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44ee09-c76c-4b34-8509-af0ab5da3cf7 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:07.757117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44ee09-c76c-4b34-8509-af0ab5da3cf7 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:07.818836 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f57a7-6fac-4af0-80c3-238473ab4441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:07.819630 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f57a7-6fac-4af0-80c3-238473ab4441 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:07.819916 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f57a7-6fac-4af0-80c3-238473ab4441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:07.820194 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f57a7-6fac-4af0-80c3-238473ab4441 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:07.820984 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f57a7-6fac-4af0-80c3-238473ab4441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:07.823464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f57a7-6fac-4af0-80c3-238473ab4441 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:07.957284 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1390/2771] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:51:07 2022] POST /identity/v3/users => generated 299 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:51:07.961823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad210ffb-d560-4c6b-b9de-c99b13e08050 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:07.976708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad210ffb-d560-4c6b-b9de-c99b13e08050 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:07.982786 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839ffa8-ce55-47ae-b567-a3e7aeb39dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:07.983473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ffa8-ce55-47ae-b567-a3e7aeb39dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:07.983756 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ffa8-ce55-47ae-b567-a3e7aeb39dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:07.984036 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ffa8-ce55-47ae-b567-a3e7aeb39dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:07.984775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839ffa8-ce55-47ae-b567-a3e7aeb39dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:07.986559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839ffa8-ce55-47ae-b567-a3e7aeb39dd7 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:07.999383 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1382/2772] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:51:08.003831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f57a7-6fac-4af0-80c3-238473ab4441 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:08.015618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f57a7-6fac-4af0-80c3-238473ab4441 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:08.020684 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9799e-dd3f-4e30-8269-345bfcba6f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:08.022257 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9799e-dd3f-4e30-8269-345bfcba6f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:08.022585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9799e-dd3f-4e30-8269-345bfcba6f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:08.023025 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9799e-dd3f-4e30-8269-345bfcba6f64 admin admin] PATH_INFO: `/v3/projects/8bcb2f4de6684a34abf85e6f1e3a55f5/users/039992f59345463e8929d9ecdbd7bd05/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:08.042482 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9799e-dd3f-4e30-8269-345bfcba6f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bcb2f4de6684a34abf85e6f1e3a55f5, user_id=039992f59345463e8929d9ecdbd7bd05, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:08.045279 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9799e-dd3f-4e30-8269-345bfcba6f64 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:08.161645 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1391/2773] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:51:08 2022] PUT /identity/v3/projects/8bcb2f4de6684a34abf85e6f1e3a55f5/users/039992f59345463e8929d9ecdbd7bd05/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:51:08.166513 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839ffa8-ce55-47ae-b567-a3e7aeb39dd7 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:08.177550 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839ffa8-ce55-47ae-b567-a3e7aeb39dd7 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:08.197733 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:08.240501 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c83f35-1a84-4a86-872f-3f1b2686202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:08.241199 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c83f35-1a84-4a86-872f-3f1b2686202d admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:08.241465 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c83f35-1a84-4a86-872f-3f1b2686202d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:08.241744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c83f35-1a84-4a86-872f-3f1b2686202d admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:08.242530 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c83f35-1a84-4a86-872f-3f1b2686202d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:08.244421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c83f35-1a84-4a86-872f-3f1b2686202d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:08.255474 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1383/2774] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:51:08.260007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9799e-dd3f-4e30-8269-345bfcba6f64 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:08.270978 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9799e-dd3f-4e30-8269-345bfcba6f64 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:08.276557 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9535f27-dde0-4ab8-a8c4-0db81b2faabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:08.277452 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9535f27-dde0-4ab8-a8c4-0db81b2faabe admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:08.277741 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9535f27-dde0-4ab8-a8c4-0db81b2faabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:08.278109 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9535f27-dde0-4ab8-a8c4-0db81b2faabe admin admin] PATH_INFO: `/v3/projects/8bcb2f4de6684a34abf85e6f1e3a55f5/users/039992f59345463e8929d9ecdbd7bd05/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:08.280284 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9535f27-dde0-4ab8-a8c4-0db81b2faabe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bcb2f4de6684a34abf85e6f1e3a55f5, user_id=039992f59345463e8929d9ecdbd7bd05, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:08.283033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9535f27-dde0-4ab8-a8c4-0db81b2faabe admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:08.295528 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1392/2775] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:51:08 2022] PUT /identity/v3/projects/8bcb2f4de6684a34abf85e6f1e3a55f5/users/039992f59345463e8929d9ecdbd7bd05/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:51:08.306918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05baf8b-74cb-4924-b7b5-519acca9871f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:08.307209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05baf8b-74cb-4924-b7b5-519acca9871f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:08.307488 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05baf8b-74cb-4924-b7b5-519acca9871f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:08.342639 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c05baf8b-74cb-4924-b7b5-519acca9871f None None] MFA Rules not processed for user `039992f59345463e8929d9ecdbd7bd05`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:51:08.344034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c05baf8b-74cb-4924-b7b5-519acca9871f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:08.423432 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1384/2776] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:51:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:51:08.434718 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9535f27-dde0-4ab8-a8c4-0db81b2faabe admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:08.436618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a9535f27-dde0-4ab8-a8c4-0db81b2faabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:08.496605 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:08.503516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9535f27-dde0-4ab8-a8c4-0db81b2faabe admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:08.507354 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb14358-35b7-40b4-9eee-6db59458e626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:08.508007 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb14358-35b7-40b4-9eee-6db59458e626 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:08.508290 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb14358-35b7-40b4-9eee-6db59458e626 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:08.508566 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb14358-35b7-40b4-9eee-6db59458e626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:08.577967 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb14358-35b7-40b4-9eee-6db59458e626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:08.579512 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb14358-35b7-40b4-9eee-6db59458e626 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:08.590637 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1393/2777] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:51:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:51:14.632893 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05baf8b-74cb-4924-b7b5-519acca9871f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:14.634605 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c05baf8b-74cb-4924-b7b5-519acca9871f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:14.647325 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05baf8b-74cb-4924-b7b5-519acca9871f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:14.651405 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8be32f-93b2-4674-ae20-486d25084009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:14.655483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8be32f-93b2-4674-ae20-486d25084009 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:14.655483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8be32f-93b2-4674-ae20-486d25084009 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:14.655483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8be32f-93b2-4674-ae20-486d25084009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:14.670604 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8be32f-93b2-4674-ae20-486d25084009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:14.673460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8be32f-93b2-4674-ae20-486d25084009 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:14.693812 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1385/2778] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:51:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:51:18.591784 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=27 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:21.502358 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb14358-35b7-40b4-9eee-6db59458e626 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:21.572533 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb14358-35b7-40b4-9eee-6db59458e626 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:21.577288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77143fc-7d13-4ad7-81df-4704e96ec013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:21.578150 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77143fc-7d13-4ad7-81df-4704e96ec013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:21.578460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77143fc-7d13-4ad7-81df-4704e96ec013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:21.578735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77143fc-7d13-4ad7-81df-4704e96ec013 admin admin] PATH_INFO: `/v3/users/4b0dd6bf29154142a00aa5e99f9caa25` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:21.579949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77143fc-7d13-4ad7-81df-4704e96ec013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0dd6bf29154142a00aa5e99f9caa25)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:21.581989 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77143fc-7d13-4ad7-81df-4704e96ec013 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:21.875514 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b77143fc-7d13-4ad7-81df-4704e96ec013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0dd6bf29154142a00aa5e99f9caa25'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:21.979132 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b77143fc-7d13-4ad7-81df-4704e96ec013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0dd6bf29154142a00aa5e99f9caa25'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:21.987774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b77143fc-7d13-4ad7-81df-4704e96ec013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0dd6bf29154142a00aa5e99f9caa25'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:21.988599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b77143fc-7d13-4ad7-81df-4704e96ec013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0dd6bf29154142a00aa5e99f9caa25'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:22.003185 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b77143fc-7d13-4ad7-81df-4704e96ec013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0dd6bf29154142a00aa5e99f9caa25'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:22.011370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1394/2779] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:51:21 2022] DELETE /identity/v3/users/4b0dd6bf29154142a00aa5e99f9caa25 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:51:22.016053 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b3b16-c635-4155-9096-4ef6cb0677ac None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:22.016912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b3b16-c635-4155-9096-4ef6cb0677ac None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:22.016912 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b3b16-c635-4155-9096-4ef6cb0677ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:22.035871 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c69b3b16-c635-4155-9096-4ef6cb0677ac None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:51:22.037128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c69b3b16-c635-4155-9096-4ef6cb0677ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:22.101149 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1386/2780] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:51:22.114421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77143fc-7d13-4ad7-81df-4704e96ec013 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:22.115976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b77143fc-7d13-4ad7-81df-4704e96ec013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:22.191467 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77143fc-7d13-4ad7-81df-4704e96ec013 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:22.195646 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bca7b-fd9e-4f83-b3c8-0ef1ad95f8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:22.199940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bca7b-fd9e-4f83-b3c8-0ef1ad95f8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:22.199940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bca7b-fd9e-4f83-b3c8-0ef1ad95f8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:22.199940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bca7b-fd9e-4f83-b3c8-0ef1ad95f8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:22.208026 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bca7b-fd9e-4f83-b3c8-0ef1ad95f8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:22.209494 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bca7b-fd9e-4f83-b3c8-0ef1ad95f8b1 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:22.221135 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1395/2781] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:51:22.763353 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b3b16-c635-4155-9096-4ef6cb0677ac None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:22.764997 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c69b3b16-c635-4155-9096-4ef6cb0677ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:22.778239 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b3b16-c635-4155-9096-4ef6cb0677ac None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:22.784026 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8df27b-1acb-4342-9045-5e7c58eb5644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:22.784892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8df27b-1acb-4342-9045-5e7c58eb5644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:22.785176 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8df27b-1acb-4342-9045-5e7c58eb5644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:22.785457 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8df27b-1acb-4342-9045-5e7c58eb5644 admin admin] PATH_INFO: `/v3/projects/602ca91cd5ac4136a734774533225d72` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:22.786719 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8df27b-1acb-4342-9045-5e7c58eb5644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=602ca91cd5ac4136a734774533225d72)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:22.788666 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8df27b-1acb-4342-9045-5e7c58eb5644 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:22.986250 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:23.014265 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3a8df27b-1acb-4342-9045-5e7c58eb5644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602ca91cd5ac4136a734774533225d72', 'request_id': 'req-3a8df27b-1acb-4342-9045-5e7c58eb5644'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:23.021556 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3a8df27b-1acb-4342-9045-5e7c58eb5644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602ca91cd5ac4136a734774533225d72', 'request_id': 'req-3a8df27b-1acb-4342-9045-5e7c58eb5644'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:23.028842 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3a8df27b-1acb-4342-9045-5e7c58eb5644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602ca91cd5ac4136a734774533225d72', 'request_id': 'req-3a8df27b-1acb-4342-9045-5e7c58eb5644'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:23.145524 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3a8df27b-1acb-4342-9045-5e7c58eb5644 admin admin] The token cache is being invalidate because project 602ca91cd5ac4136a734774533225d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:51:23.145928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3a8df27b-1acb-4342-9045-5e7c58eb5644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:23.146670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3a8df27b-1acb-4342-9045-5e7c58eb5644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:23.150870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1387/2782] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:51:22 2022] DELETE /identity/v3/projects/602ca91cd5ac4136a734774533225d72 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:51:23.153599 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bca7b-fd9e-4f83-b3c8-0ef1ad95f8b1 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:23.166015 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bca7b-fd9e-4f83-b3c8-0ef1ad95f8b1 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:23.195295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:23.239409 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d059b-4dae-418e-aa82-89bcc1beab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:23.240326 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d059b-4dae-418e-aa82-89bcc1beab1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:23.240620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d059b-4dae-418e-aa82-89bcc1beab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:23.240899 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d059b-4dae-418e-aa82-89bcc1beab1d admin admin] PATH_INFO: `/v3/users/039992f59345463e8929d9ecdbd7bd05` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:23.242352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d059b-4dae-418e-aa82-89bcc1beab1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=039992f59345463e8929d9ecdbd7bd05)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:23.250675 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d059b-4dae-418e-aa82-89bcc1beab1d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:23.549154 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-491d059b-4dae-418e-aa82-89bcc1beab1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '039992f59345463e8929d9ecdbd7bd05'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:23.692692 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-491d059b-4dae-418e-aa82-89bcc1beab1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '039992f59345463e8929d9ecdbd7bd05'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:23.703163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-491d059b-4dae-418e-aa82-89bcc1beab1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '039992f59345463e8929d9ecdbd7bd05'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:23.704097 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-491d059b-4dae-418e-aa82-89bcc1beab1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '039992f59345463e8929d9ecdbd7bd05'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:23.722283 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-491d059b-4dae-418e-aa82-89bcc1beab1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '039992f59345463e8929d9ecdbd7bd05'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:23.729977 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1396/2783] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:51:23 2022] DELETE /identity/v3/users/039992f59345463e8929d9ecdbd7bd05 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:51:24.391649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8df27b-1acb-4342-9045-5e7c58eb5644 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:24.391649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3a8df27b-1acb-4342-9045-5e7c58eb5644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:24.406866 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8df27b-1acb-4342-9045-5e7c58eb5644 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:24.476755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d56c9b-9028-4f42-84cc-de3e0595ea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:24.477723 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d56c9b-9028-4f42-84cc-de3e0595ea6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:24.478004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d56c9b-9028-4f42-84cc-de3e0595ea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:24.478303 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d56c9b-9028-4f42-84cc-de3e0595ea6d admin admin] PATH_INFO: `/v3/projects/8bcb2f4de6684a34abf85e6f1e3a55f5` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:24.479586 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d56c9b-9028-4f42-84cc-de3e0595ea6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bcb2f4de6684a34abf85e6f1e3a55f5)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:24.481821 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d56c9b-9028-4f42-84cc-de3e0595ea6d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:24.650646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d0d56c9b-9028-4f42-84cc-de3e0595ea6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bcb2f4de6684a34abf85e6f1e3a55f5', 'request_id': 'req-d0d56c9b-9028-4f42-84cc-de3e0595ea6d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:24.656182 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d0d56c9b-9028-4f42-84cc-de3e0595ea6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bcb2f4de6684a34abf85e6f1e3a55f5', 'request_id': 'req-d0d56c9b-9028-4f42-84cc-de3e0595ea6d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:24.664082 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d0d56c9b-9028-4f42-84cc-de3e0595ea6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bcb2f4de6684a34abf85e6f1e3a55f5', 'request_id': 'req-d0d56c9b-9028-4f42-84cc-de3e0595ea6d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:24.784483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d0d56c9b-9028-4f42-84cc-de3e0595ea6d admin admin] The token cache is being invalidate because project 8bcb2f4de6684a34abf85e6f1e3a55f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:51:24.784823 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d0d56c9b-9028-4f42-84cc-de3e0595ea6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:24.788240 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d0d56c9b-9028-4f42-84cc-de3e0595ea6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:24.788240 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1388/2784] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:51:24 2022] DELETE /identity/v3/projects/8bcb2f4de6684a34abf85e6f1e3a55f5 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:51:24.793517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764ccf6-29b9-461f-b2ad-667363ea4cb7 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:24.794145 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764ccf6-29b9-461f-b2ad-667363ea4cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:24.794296 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764ccf6-29b9-461f-b2ad-667363ea4cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:24.813984 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e764ccf6-29b9-461f-b2ad-667363ea4cb7 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:51:24.815375 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e764ccf6-29b9-461f-b2ad-667363ea4cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:24.884093 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1397/2785] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:51:24.892928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c734d1-d78f-4077-bdbb-06bbaf0a0b66 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:24.893216 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c734d1-d78f-4077-bdbb-06bbaf0a0b66 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:24.893523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c734d1-d78f-4077-bdbb-06bbaf0a0b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:24.913940 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e7c734d1-d78f-4077-bdbb-06bbaf0a0b66 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:51:24.915091 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e7c734d1-d78f-4077-bdbb-06bbaf0a0b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:24.924154 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1389/2786] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:51:24.929275 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764ccf6-29b9-461f-b2ad-667363ea4cb7 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:24.943079 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764ccf6-29b9-461f-b2ad-667363ea4cb7 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:24.948654 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903f5e8-e083-48cb-84dd-73341b9f92cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:24.949363 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f5e8-e083-48cb-84dd-73341b9f92cc admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:24.949651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f5e8-e083-48cb-84dd-73341b9f92cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:24.949938 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f5e8-e083-48cb-84dd-73341b9f92cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:24.950733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903f5e8-e083-48cb-84dd-73341b9f92cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:51:24.951040 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903f5e8-e083-48cb-84dd-73341b9f92cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:24.952777 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903f5e8-e083-48cb-84dd-73341b9f92cc admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:24.968050 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1398/2787] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:51:24.972878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c734d1-d78f-4077-bdbb-06bbaf0a0b66 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:24.984643 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c734d1-d78f-4077-bdbb-06bbaf0a0b66 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:24.990173 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42500c3b-3a9f-489e-9db4-abbbf0346104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:24.990890 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42500c3b-3a9f-489e-9db4-abbbf0346104 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:24.991175 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42500c3b-3a9f-489e-9db4-abbbf0346104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:24.991450 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42500c3b-3a9f-489e-9db4-abbbf0346104 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:24.992144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42500c3b-3a9f-489e-9db4-abbbf0346104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:24.994976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42500c3b-3a9f-489e-9db4-abbbf0346104 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:25.141152 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1390/2788] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:51:24 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:51:25.141303 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903f5e8-e083-48cb-84dd-73341b9f92cc admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:25.163073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903f5e8-e083-48cb-84dd-73341b9f92cc admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:25.195199 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:25.249265 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84114e1b-75bc-4a52-8e98-63df9dce5c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:25.249968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84114e1b-75bc-4a52-8e98-63df9dce5c41 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:25.250248 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84114e1b-75bc-4a52-8e98-63df9dce5c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:25.250607 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84114e1b-75bc-4a52-8e98-63df9dce5c41 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:25.251463 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84114e1b-75bc-4a52-8e98-63df9dce5c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:25.253539 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84114e1b-75bc-4a52-8e98-63df9dce5c41 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:25.384933 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1399/2789] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:51:25 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:51:25.397586 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42500c3b-3a9f-489e-9db4-abbbf0346104 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:25.419469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42500c3b-3a9f-489e-9db4-abbbf0346104 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:25.424968 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc0e2e-e3e4-45e5-8e27-9cece7591124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:25.434318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc0e2e-e3e4-45e5-8e27-9cece7591124 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:25.434318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc0e2e-e3e4-45e5-8e27-9cece7591124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:25.434318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc0e2e-e3e4-45e5-8e27-9cece7591124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:25.434318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc0e2e-e3e4-45e5-8e27-9cece7591124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:25.434318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc0e2e-e3e4-45e5-8e27-9cece7591124 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:25.444049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1391/2790] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:51:25.448845 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84114e1b-75bc-4a52-8e98-63df9dce5c41 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:25.459315 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84114e1b-75bc-4a52-8e98-63df9dce5c41 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:25.469451 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124d35b-d932-450e-9e29-0e603ce26a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:25.470666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124d35b-d932-450e-9e29-0e603ce26a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:25.471179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124d35b-d932-450e-9e29-0e603ce26a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:25.471793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124d35b-d932-450e-9e29-0e603ce26a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:25.473074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124d35b-d932-450e-9e29-0e603ce26a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:25.476274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124d35b-d932-450e-9e29-0e603ce26a54 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:25.498094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1400/2791] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:51:25.502998 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc0e2e-e3e4-45e5-8e27-9cece7591124 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:25.511018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:25.515795 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc0e2e-e3e4-45e5-8e27-9cece7591124 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:25.521027 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335cd2-8e9a-4aca-85ba-3530c0d2d5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:25.522723 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335cd2-8e9a-4aca-85ba-3530c0d2d5b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:25.523004 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335cd2-8e9a-4aca-85ba-3530c0d2d5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:25.523283 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335cd2-8e9a-4aca-85ba-3530c0d2d5b7 admin admin] PATH_INFO: `/v3/projects/327eeba9458941a5b4433530eeef871f/users/4314d1b1a8ff4bd69ea371a5080dc130/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:25.542151 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335cd2-8e9a-4aca-85ba-3530c0d2d5b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=327eeba9458941a5b4433530eeef871f, user_id=4314d1b1a8ff4bd69ea371a5080dc130, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:25.544910 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335cd2-8e9a-4aca-85ba-3530c0d2d5b7 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:25.705186 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1392/2792] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:51:25 2022] PUT /identity/v3/projects/327eeba9458941a5b4433530eeef871f/users/4314d1b1a8ff4bd69ea371a5080dc130/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:51:25.718184 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a783a-fa62-46ff-bead-018cf08d8c34 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:25.718545 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a783a-fa62-46ff-bead-018cf08d8c34 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:25.718827 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a783a-fa62-46ff-bead-018cf08d8c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:25.752361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-331a783a-fa62-46ff-bead-018cf08d8c34 None None] MFA Rules not processed for user `4314d1b1a8ff4bd69ea371a5080dc130`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:51:25.753626 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-331a783a-fa62-46ff-bead-018cf08d8c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:25.828873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1401/2793] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:51:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:51:25.841032 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335cd2-8e9a-4aca-85ba-3530c0d2d5b7 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:25.844031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0b335cd2-8e9a-4aca-85ba-3530c0d2d5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:25.907653 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335cd2-8e9a-4aca-85ba-3530c0d2d5b7 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:25.915318 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03367e5-65ea-4163-9d0f-3ec83f21cac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:25.916583 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03367e5-65ea-4163-9d0f-3ec83f21cac3 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:25.916583 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03367e5-65ea-4163-9d0f-3ec83f21cac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:25.916804 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03367e5-65ea-4163-9d0f-3ec83f21cac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:25.927290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03367e5-65ea-4163-9d0f-3ec83f21cac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:25.928795 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03367e5-65ea-4163-9d0f-3ec83f21cac3 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:25.944965 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1393/2794] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:51:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:51:30.137971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a783a-fa62-46ff-bead-018cf08d8c34 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:30.139744 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-331a783a-fa62-46ff-bead-018cf08d8c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:30.245896 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a783a-fa62-46ff-bead-018cf08d8c34 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:30.252429 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09540fe5-e76d-4fc1-9b10-d6c49dc70e01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:30.253276 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09540fe5-e76d-4fc1-9b10-d6c49dc70e01 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:30.253668 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09540fe5-e76d-4fc1-9b10-d6c49dc70e01 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:30.254039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09540fe5-e76d-4fc1-9b10-d6c49dc70e01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:30.257027 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-09540fe5-e76d-4fc1-9b10-d6c49dc70e01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:30.272682 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09540fe5-e76d-4fc1-9b10-d6c49dc70e01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:30.276825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09540fe5-e76d-4fc1-9b10-d6c49dc70e01 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:30.295212 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1402/2795] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:51:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:51:35.940361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:36.158466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922a7b6-922f-432d-a972-e8244f73f756 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:36.158781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922a7b6-922f-432d-a972-e8244f73f756 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:36.159088 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922a7b6-922f-432d-a972-e8244f73f756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:36.176670 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a922a7b6-922f-432d-a972-e8244f73f756 None None] MFA Rules not processed for user `6ab418830d774189899baaf615001e47`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:51:36.177875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a922a7b6-922f-432d-a972-e8244f73f756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:36.235856 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1394/2796] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:51:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:51:37.024412 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09540fe5-e76d-4fc1-9b10-d6c49dc70e01 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:37.025802 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-09540fe5-e76d-4fc1-9b10-d6c49dc70e01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:37.062905 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:37.118193 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09540fe5-e76d-4fc1-9b10-d6c49dc70e01 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:37.123941 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1c8c0-37f5-40cb-908d-fff46c89bca5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fd088faaba4d5c9745638c14f1a7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:37.124615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c8c0-37f5-40cb-908d-fff46c89bca5 service placement] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:37.124906 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c8c0-37f5-40cb-908d-fff46c89bca5 service placement] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:37.125186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c8c0-37f5-40cb-908d-fff46c89bca5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:37.127168 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-26a1c8c0-37f5-40cb-908d-fff46c89bca5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:37.142119 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1c8c0-37f5-40cb-908d-fff46c89bca5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:37.143949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1c8c0-37f5-40cb-908d-fff46c89bca5 service placement] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:37.155788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1403/2797] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:51:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:51:40.964017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922a7b6-922f-432d-a972-e8244f73f756 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:40.965942 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a922a7b6-922f-432d-a972-e8244f73f756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:41.033380 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922a7b6-922f-432d-a972-e8244f73f756 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:41.036878 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dbc7e-10f2-413e-b2a3-d62ec37f46a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:41.037574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dbc7e-10f2-413e-b2a3-d62ec37f46a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:41.037802 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dbc7e-10f2-413e-b2a3-d62ec37f46a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:41.038080 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dbc7e-10f2-413e-b2a3-d62ec37f46a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:41.040496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5d7dbc7e-10f2-413e-b2a3-d62ec37f46a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:41.053660 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7dbc7e-10f2-413e-b2a3-d62ec37f46a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:41.055229 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7dbc7e-10f2-413e-b2a3-d62ec37f46a8 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:41.068447 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1395/2798] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:51:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:51:42.760510 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1c8c0-37f5-40cb-908d-fff46c89bca5 service placement] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:42.828117 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1c8c0-37f5-40cb-908d-fff46c89bca5 service placement] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:42.832766 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2ff3a-9f5e-475b-8f9f-9af314fa1b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:42.833627 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2ff3a-9f5e-475b-8f9f-9af314fa1b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:42.833966 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2ff3a-9f5e-475b-8f9f-9af314fa1b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:42.834238 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2ff3a-9f5e-475b-8f9f-9af314fa1b30 admin admin] PATH_INFO: `/v3/users/4314d1b1a8ff4bd69ea371a5080dc130` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:42.835443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2ff3a-9f5e-475b-8f9f-9af314fa1b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4314d1b1a8ff4bd69ea371a5080dc130)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:42.838116 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2ff3a-9f5e-475b-8f9f-9af314fa1b30 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:43.055331 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6dd2ff3a-9f5e-475b-8f9f-9af314fa1b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4314d1b1a8ff4bd69ea371a5080dc130'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:43.150292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6dd2ff3a-9f5e-475b-8f9f-9af314fa1b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4314d1b1a8ff4bd69ea371a5080dc130'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:43.158283 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6dd2ff3a-9f5e-475b-8f9f-9af314fa1b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4314d1b1a8ff4bd69ea371a5080dc130'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:43.159006 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6dd2ff3a-9f5e-475b-8f9f-9af314fa1b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4314d1b1a8ff4bd69ea371a5080dc130'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:43.172243 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6dd2ff3a-9f5e-475b-8f9f-9af314fa1b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4314d1b1a8ff4bd69ea371a5080dc130'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:43.179146 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1404/2799] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:51:42 2022] DELETE /identity/v3/users/4314d1b1a8ff4bd69ea371a5080dc130 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:51:43.183948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a92cc9-b23d-4108-99bf-0b6281b2a9da None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:43.184452 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a92cc9-b23d-4108-99bf-0b6281b2a9da None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:43.184590 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a92cc9-b23d-4108-99bf-0b6281b2a9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:43.202962 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-29a92cc9-b23d-4108-99bf-0b6281b2a9da None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:51:43.204168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-29a92cc9-b23d-4108-99bf-0b6281b2a9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:43.265430 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1396/2800] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:51:43.279739 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2ff3a-9f5e-475b-8f9f-9af314fa1b30 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:43.281157 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6dd2ff3a-9f5e-475b-8f9f-9af314fa1b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:43.316695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:43.341864 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2ff3a-9f5e-475b-8f9f-9af314fa1b30 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:43.345492 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb11d41-45f0-44a6-9df0-a7cc9bce1e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:43.346145 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb11d41-45f0-44a6-9df0-a7cc9bce1e47 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:43.346464 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb11d41-45f0-44a6-9df0-a7cc9bce1e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:43.346743 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb11d41-45f0-44a6-9df0-a7cc9bce1e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:43.357032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb11d41-45f0-44a6-9df0-a7cc9bce1e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:43.358517 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb11d41-45f0-44a6-9df0-a7cc9bce1e47 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:43.369329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1405/2801] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:51:43.918040 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a92cc9-b23d-4108-99bf-0b6281b2a9da None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:43.919667 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-29a92cc9-b23d-4108-99bf-0b6281b2a9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:43.945973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a92cc9-b23d-4108-99bf-0b6281b2a9da None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:43.960018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587b7f0-62e7-4934-be79-4ba7f0894adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:43.960018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587b7f0-62e7-4934-be79-4ba7f0894adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:43.960018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587b7f0-62e7-4934-be79-4ba7f0894adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:43.960018 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587b7f0-62e7-4934-be79-4ba7f0894adb admin admin] PATH_INFO: `/v3/projects/327eeba9458941a5b4433530eeef871f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:43.960431 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587b7f0-62e7-4934-be79-4ba7f0894adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=327eeba9458941a5b4433530eeef871f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:43.962095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587b7f0-62e7-4934-be79-4ba7f0894adb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:44.080025 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:44.084594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c587b7f0-62e7-4934-be79-4ba7f0894adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '327eeba9458941a5b4433530eeef871f', 'request_id': 'req-c587b7f0-62e7-4934-be79-4ba7f0894adb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:44.092440 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c587b7f0-62e7-4934-be79-4ba7f0894adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '327eeba9458941a5b4433530eeef871f', 'request_id': 'req-c587b7f0-62e7-4934-be79-4ba7f0894adb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:44.099415 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c587b7f0-62e7-4934-be79-4ba7f0894adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '327eeba9458941a5b4433530eeef871f', 'request_id': 'req-c587b7f0-62e7-4934-be79-4ba7f0894adb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:44.213226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c587b7f0-62e7-4934-be79-4ba7f0894adb admin admin] The token cache is being invalidate because project 327eeba9458941a5b4433530eeef871f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:51:44.213957 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c587b7f0-62e7-4934-be79-4ba7f0894adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:44.214251 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c587b7f0-62e7-4934-be79-4ba7f0894adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:44.215935 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1397/2802] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:51:43 2022] DELETE /identity/v3/projects/327eeba9458941a5b4433530eeef871f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:51:47.791597 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb11d41-45f0-44a6-9df0-a7cc9bce1e47 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:47.793118 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-aeb11d41-45f0-44a6-9df0-a7cc9bce1e47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:47.876226 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb11d41-45f0-44a6-9df0-a7cc9bce1e47 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:47.958754 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30595c-dc9f-4f22-892e-94cb42207852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:47.959535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30595c-dc9f-4f22-892e-94cb42207852 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:47.959820 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30595c-dc9f-4f22-892e-94cb42207852 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:47.960098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30595c-dc9f-4f22-892e-94cb42207852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:47.962851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1c30595c-dc9f-4f22-892e-94cb42207852 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:47.976126 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30595c-dc9f-4f22-892e-94cb42207852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:47.977855 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30595c-dc9f-4f22-892e-94cb42207852 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:47.989590 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1406/2803] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:51:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:51:54.223672 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:57.984725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=74 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:43.547586 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587b7f0-62e7-4934-be79-4ba7f0894adb admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:43.549414 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c587b7f0-62e7-4934-be79-4ba7f0894adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:43.629047 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587b7f0-62e7-4934-be79-4ba7f0894adb admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:43.640074 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd556d11-452c-4af4-bcf2-cab96a6ea05d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:43.643335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd556d11-452c-4af4-bcf2-cab96a6ea05d service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:43.643335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd556d11-452c-4af4-bcf2-cab96a6ea05d service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:43.643335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd556d11-452c-4af4-bcf2-cab96a6ea05d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:43.643335 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-fd556d11-452c-4af4-bcf2-cab96a6ea05d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:43.726202 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd556d11-452c-4af4-bcf2-cab96a6ea05d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:43.726202 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd556d11-452c-4af4-bcf2-cab96a6ea05d service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:43.727164 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1398/2804] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:52:48.335371 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30595c-dc9f-4f22-892e-94cb42207852 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:48.337211 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1c30595c-dc9f-4f22-892e-94cb42207852 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:48.421103 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30595c-dc9f-4f22-892e-94cb42207852 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:48.426490 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe59bb-688d-4200-9ebd-02caa67a9ca7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fd088faaba4d5c9745638c14f1a7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:48.427208 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe59bb-688d-4200-9ebd-02caa67a9ca7 service placement] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:48.427500 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe59bb-688d-4200-9ebd-02caa67a9ca7 service placement] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:48.427775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe59bb-688d-4200-9ebd-02caa67a9ca7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:48.429782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dffe59bb-688d-4200-9ebd-02caa67a9ca7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:48.442563 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe59bb-688d-4200-9ebd-02caa67a9ca7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:48.444887 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe59bb-688d-4200-9ebd-02caa67a9ca7 service placement] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:48.458286 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1407/2805] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:52:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:52:48.495416 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd556d11-452c-4af4-bcf2-cab96a6ea05d service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:48.497336 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-fd556d11-452c-4af4-bcf2-cab96a6ea05d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:48.516713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd556d11-452c-4af4-bcf2-cab96a6ea05d service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:48.522288 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af7c1e-1061-4bfc-9cc7-aed34d1240f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:48.523285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af7c1e-1061-4bfc-9cc7-aed34d1240f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:48.523577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af7c1e-1061-4bfc-9cc7-aed34d1240f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:48.523857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af7c1e-1061-4bfc-9cc7-aed34d1240f3 admin admin] PATH_INFO: `/v3/users/6ab418830d774189899baaf615001e47` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:48.525204 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af7c1e-1061-4bfc-9cc7-aed34d1240f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab418830d774189899baaf615001e47)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:48.527188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af7c1e-1061-4bfc-9cc7-aed34d1240f3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:48.781862 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-45af7c1e-1061-4bfc-9cc7-aed34d1240f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab418830d774189899baaf615001e47'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:48.903873 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-45af7c1e-1061-4bfc-9cc7-aed34d1240f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab418830d774189899baaf615001e47'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:48.917508 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-45af7c1e-1061-4bfc-9cc7-aed34d1240f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab418830d774189899baaf615001e47'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:48.918383 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-45af7c1e-1061-4bfc-9cc7-aed34d1240f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab418830d774189899baaf615001e47'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:48.937213 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-45af7c1e-1061-4bfc-9cc7-aed34d1240f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab418830d774189899baaf615001e47'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:48.945231 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1399/2806] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:52:48 2022] DELETE /identity/v3/users/6ab418830d774189899baaf615001e47 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:52:49.309813 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe59bb-688d-4200-9ebd-02caa67a9ca7 service placement] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:49.330800 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe59bb-688d-4200-9ebd-02caa67a9ca7 service placement] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:49.434021 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d7f67-5c31-4a6b-8b7e-29845874654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:49.435625 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d7f67-5c31-4a6b-8b7e-29845874654b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:49.436126 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d7f67-5c31-4a6b-8b7e-29845874654b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:49.436634 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d7f67-5c31-4a6b-8b7e-29845874654b admin admin] PATH_INFO: `/v3/projects/f307af71df174a3d8855902b68cb565e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:49.439133 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d7f67-5c31-4a6b-8b7e-29845874654b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f307af71df174a3d8855902b68cb565e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:49.443288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d7f67-5c31-4a6b-8b7e-29845874654b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:49.582472 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2b0d7f67-5c31-4a6b-8b7e-29845874654b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f307af71df174a3d8855902b68cb565e', 'request_id': 'req-2b0d7f67-5c31-4a6b-8b7e-29845874654b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:49.592317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2b0d7f67-5c31-4a6b-8b7e-29845874654b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f307af71df174a3d8855902b68cb565e', 'request_id': 'req-2b0d7f67-5c31-4a6b-8b7e-29845874654b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:49.600278 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2b0d7f67-5c31-4a6b-8b7e-29845874654b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f307af71df174a3d8855902b68cb565e', 'request_id': 'req-2b0d7f67-5c31-4a6b-8b7e-29845874654b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:49.692060 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2b0d7f67-5c31-4a6b-8b7e-29845874654b admin admin] The token cache is being invalidate because project f307af71df174a3d8855902b68cb565e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:52:49.692600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2b0d7f67-5c31-4a6b-8b7e-29845874654b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:49.694673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2b0d7f67-5c31-4a6b-8b7e-29845874654b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:49.697608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1408/2807] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:52:49 2022] DELETE /identity/v3/projects/f307af71df174a3d8855902b68cb565e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:52:49.706112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0caea-cdcb-41bd-ab81-b15a47109195 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:49.706814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0caea-cdcb-41bd-ab81-b15a47109195 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:49.707336 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0caea-cdcb-41bd-ab81-b15a47109195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:49.739640 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-7eb0caea-cdcb-41bd-ab81-b15a47109195 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:52:49.741937 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7eb0caea-cdcb-41bd-ab81-b15a47109195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:49.763066 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:49.817103 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1400/2808] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:52:49.827332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26513b-163d-4d5e-a782-01798761044c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:49.827771 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26513b-163d-4d5e-a782-01798761044c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:49.834542 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26513b-163d-4d5e-a782-01798761044c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:49.848888 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-fa26513b-163d-4d5e-a782-01798761044c None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:52:49.851105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fa26513b-163d-4d5e-a782-01798761044c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:49.859763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1409/2809] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:52:49.871993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0caea-cdcb-41bd-ab81-b15a47109195 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:49.886016 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0caea-cdcb-41bd-ab81-b15a47109195 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:49.893946 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd279271-cb99-458c-8f89-79823060344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:49.895070 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd279271-cb99-458c-8f89-79823060344c admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:49.895809 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd279271-cb99-458c-8f89-79823060344c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:49.896883 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd279271-cb99-458c-8f89-79823060344c admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:49.898188 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd279271-cb99-458c-8f89-79823060344c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:52:49.898889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd279271-cb99-458c-8f89-79823060344c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:49.901715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd279271-cb99-458c-8f89-79823060344c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:49.922843 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1401/2810] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:52:49.928822 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26513b-163d-4d5e-a782-01798761044c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:49.945128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26513b-163d-4d5e-a782-01798761044c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:49.952908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03aad82-7eff-45fa-916d-f4822f89c8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:49.952908 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aad82-7eff-45fa-916d-f4822f89c8ff admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:49.953324 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aad82-7eff-45fa-916d-f4822f89c8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:49.953747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aad82-7eff-45fa-916d-f4822f89c8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:49.955088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03aad82-7eff-45fa-916d-f4822f89c8ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:49.960797 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03aad82-7eff-45fa-916d-f4822f89c8ff admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:49.979485 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:50.208600 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1410/2811] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:52:49 2022] POST /identity/v3/projects => generated 371 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:52:50.213491 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd279271-cb99-458c-8f89-79823060344c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:50.225285 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd279271-cb99-458c-8f89-79823060344c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:50.294729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f65fb0-d9bd-487a-99a9-5f38c31dd50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:50.295412 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f65fb0-d9bd-487a-99a9-5f38c31dd50c admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:50.295698 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f65fb0-d9bd-487a-99a9-5f38c31dd50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:50.295977 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f65fb0-d9bd-487a-99a9-5f38c31dd50c admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:50.296671 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f65fb0-d9bd-487a-99a9-5f38c31dd50c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:50.298637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f65fb0-d9bd-487a-99a9-5f38c31dd50c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:50.503442 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1402/2812] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:52:50 2022] POST /identity/v3/users => generated 286 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:52:50.508065 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03aad82-7eff-45fa-916d-f4822f89c8ff admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:50.519670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03aad82-7eff-45fa-916d-f4822f89c8ff admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:50.527094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2106c-2ba5-4e74-b4e6-4c66c68318ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:50.527094 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2106c-2ba5-4e74-b4e6-4c66c68318ab admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:50.528568 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2106c-2ba5-4e74-b4e6-4c66c68318ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:50.528934 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2106c-2ba5-4e74-b4e6-4c66c68318ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:50.529817 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2106c-2ba5-4e74-b4e6-4c66c68318ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:50.531611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2106c-2ba5-4e74-b4e6-4c66c68318ab admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:50.544746 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1411/2813] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:52:50.548848 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f65fb0-d9bd-487a-99a9-5f38c31dd50c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:50.559994 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f65fb0-d9bd-487a-99a9-5f38c31dd50c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:50.564803 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097556c-e577-4f6c-aacd-58a9a20bf8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:50.565466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097556c-e577-4f6c-aacd-58a9a20bf8bb admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:50.565752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097556c-e577-4f6c-aacd-58a9a20bf8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:50.566031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097556c-e577-4f6c-aacd-58a9a20bf8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:50.567034 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097556c-e577-4f6c-aacd-58a9a20bf8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:50.569532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097556c-e577-4f6c-aacd-58a9a20bf8bb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:50.581772 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1403/2814] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:52:50.586419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2106c-2ba5-4e74-b4e6-4c66c68318ab admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:50.598989 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2106c-2ba5-4e74-b4e6-4c66c68318ab admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:50.605421 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1e996-5c41-4036-b1d8-c1cf5e0f6cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:50.606349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1e996-5c41-4036-b1d8-c1cf5e0f6cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:50.606648 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1e996-5c41-4036-b1d8-c1cf5e0f6cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:50.606915 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1e996-5c41-4036-b1d8-c1cf5e0f6cc9 admin admin] PATH_INFO: `/v3/projects/61a3b26b723a4cb6ad9386f4f1455675/users/59ababd2992247f3888ce134072be09c/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:50.625045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1e996-5c41-4036-b1d8-c1cf5e0f6cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a3b26b723a4cb6ad9386f4f1455675, user_id=59ababd2992247f3888ce134072be09c, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:50.627831 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1e996-5c41-4036-b1d8-c1cf5e0f6cc9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:50.707330 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1412/2815] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:52:50 2022] PUT /identity/v3/projects/61a3b26b723a4cb6ad9386f4f1455675/users/59ababd2992247f3888ce134072be09c/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:52:50.726429 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00301c1-9513-4499-9180-df959228112f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:50.727073 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00301c1-9513-4499-9180-df959228112f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:50.727422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00301c1-9513-4499-9180-df959228112f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:50.769817 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d00301c1-9513-4499-9180-df959228112f None None] MFA Rules not processed for user `59ababd2992247f3888ce134072be09c`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:52:50.771149 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d00301c1-9513-4499-9180-df959228112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:50.864008 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1404/2816] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:52:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:52:50.882382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1e996-5c41-4036-b1d8-c1cf5e0f6cc9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:50.884663 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7ff1e996-5c41-4036-b1d8-c1cf5e0f6cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:50.972552 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1e996-5c41-4036-b1d8-c1cf5e0f6cc9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:50.978483 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195c1be-b7db-4533-93ee-5b0214fd6b99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7abf6b71ac3454ca547a750cef9220a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:50.979177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195c1be-b7db-4533-93ee-5b0214fd6b99 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:50.979459 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195c1be-b7db-4533-93ee-5b0214fd6b99 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:50.979733 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195c1be-b7db-4533-93ee-5b0214fd6b99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:50.988719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195c1be-b7db-4533-93ee-5b0214fd6b99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:50.990961 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195c1be-b7db-4533-93ee-5b0214fd6b99 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:51.001099 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1413/2817] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:52:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:52:54.472050 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00301c1-9513-4499-9180-df959228112f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:54.499571 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:54.551268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00301c1-9513-4499-9180-df959228112f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:54.556801 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f312d3c-5831-4bd1-bad1-e14458ba599d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:54.557672 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312d3c-5831-4bd1-bad1-e14458ba599d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:54.557950 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312d3c-5831-4bd1-bad1-e14458ba599d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:54.558219 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312d3c-5831-4bd1-bad1-e14458ba599d admin admin] PATH_INFO: `/v3/users/59ababd2992247f3888ce134072be09c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:54.559472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f312d3c-5831-4bd1-bad1-e14458ba599d admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ababd2992247f3888ce134072be09c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:54.561407 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f312d3c-5831-4bd1-bad1-e14458ba599d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:54.878634 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4f312d3c-5831-4bd1-bad1-e14458ba599d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ababd2992247f3888ce134072be09c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:55.006084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4f312d3c-5831-4bd1-bad1-e14458ba599d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ababd2992247f3888ce134072be09c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:55.018015 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4f312d3c-5831-4bd1-bad1-e14458ba599d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ababd2992247f3888ce134072be09c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:55.018968 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4f312d3c-5831-4bd1-bad1-e14458ba599d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ababd2992247f3888ce134072be09c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:55.040579 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4f312d3c-5831-4bd1-bad1-e14458ba599d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ababd2992247f3888ce134072be09c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:55.049304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1405/2818] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:52:54 2022] DELETE /identity/v3/users/59ababd2992247f3888ce134072be09c => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:52:55.056902 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7ae5-70d4-4554-8846-239812a1afe9 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:55.057448 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7ae5-70d4-4554-8846-239812a1afe9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:55.057900 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7ae5-70d4-4554-8846-239812a1afe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:55.077639 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1abb7ae5-70d4-4554-8846-239812a1afe9 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:52:55.078944 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1abb7ae5-70d4-4554-8846-239812a1afe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:55.157444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1414/2819] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:52:55.168191 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f312d3c-5831-4bd1-bad1-e14458ba599d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:55.169658 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4f312d3c-5831-4bd1-bad1-e14458ba599d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:55.238725 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f312d3c-5831-4bd1-bad1-e14458ba599d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:55.244466 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60d441-dbee-4805-8000-0a127cb30668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:55.245144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60d441-dbee-4805-8000-0a127cb30668 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:55.245422 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60d441-dbee-4805-8000-0a127cb30668 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:55.245704 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60d441-dbee-4805-8000-0a127cb30668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:55.258589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60d441-dbee-4805-8000-0a127cb30668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:55.259641 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60d441-dbee-4805-8000-0a127cb30668 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:55.270509 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1406/2820] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:52:55.857624 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb7ae5-70d4-4554-8846-239812a1afe9 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:55.857624 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1abb7ae5-70d4-4554-8846-239812a1afe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:55.874638 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb7ae5-70d4-4554-8846-239812a1afe9 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:55.879871 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789eb8c-deac-4ed9-b033-9f129554120a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:55.881506 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789eb8c-deac-4ed9-b033-9f129554120a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:55.881762 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789eb8c-deac-4ed9-b033-9f129554120a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:55.882134 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789eb8c-deac-4ed9-b033-9f129554120a admin admin] PATH_INFO: `/v3/projects/61a3b26b723a4cb6ad9386f4f1455675` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:55.883476 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789eb8c-deac-4ed9-b033-9f129554120a admin admin] RBAC: Authorizing `identity:delete_project(project_id=61a3b26b723a4cb6ad9386f4f1455675)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:55.885429 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789eb8c-deac-4ed9-b033-9f129554120a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:56.016100 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:56.026010 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f789eb8c-deac-4ed9-b033-9f129554120a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a3b26b723a4cb6ad9386f4f1455675', 'request_id': 'req-f789eb8c-deac-4ed9-b033-9f129554120a'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:56.032369 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f789eb8c-deac-4ed9-b033-9f129554120a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a3b26b723a4cb6ad9386f4f1455675', 'request_id': 'req-f789eb8c-deac-4ed9-b033-9f129554120a'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:56.038416 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f789eb8c-deac-4ed9-b033-9f129554120a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a3b26b723a4cb6ad9386f4f1455675', 'request_id': 'req-f789eb8c-deac-4ed9-b033-9f129554120a'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:56.120611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f789eb8c-deac-4ed9-b033-9f129554120a admin admin] The token cache is being invalidate because project 61a3b26b723a4cb6ad9386f4f1455675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:52:56.121332 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f789eb8c-deac-4ed9-b033-9f129554120a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:56.121479 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f789eb8c-deac-4ed9-b033-9f129554120a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:52:56.123075 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1415/2821] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:52:55 2022] DELETE /identity/v3/projects/61a3b26b723a4cb6ad9386f4f1455675 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:52:56.128010 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98897c24-ff40-4ec3-a1cc-354a5c7b2e55 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:56.128483 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98897c24-ff40-4ec3-a1cc-354a5c7b2e55 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:56.128589 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98897c24-ff40-4ec3-a1cc-354a5c7b2e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:56.147386 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-98897c24-ff40-4ec3-a1cc-354a5c7b2e55 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:52:56.148587 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-98897c24-ff40-4ec3-a1cc-354a5c7b2e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:56.186642 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:56.213535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1407/2822] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:52:56.221471 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc7a68-5204-427c-85ca-a1ee33b101c0 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:56.221788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc7a68-5204-427c-85ca-a1ee33b101c0 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:56.222137 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc7a68-5204-427c-85ca-a1ee33b101c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:56.242039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-99bc7a68-5204-427c-85ca-a1ee33b101c0 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:52:56.243274 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-99bc7a68-5204-427c-85ca-a1ee33b101c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:56.251327 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1416/2823] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:52:56.255676 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98897c24-ff40-4ec3-a1cc-354a5c7b2e55 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:56.265929 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98897c24-ff40-4ec3-a1cc-354a5c7b2e55 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:56.270635 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928dded-8fc2-4971-9735-4713702f60f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:56.271395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928dded-8fc2-4971-9735-4713702f60f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:56.271680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928dded-8fc2-4971-9735-4713702f60f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:56.271956 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928dded-8fc2-4971-9735-4713702f60f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:56.272679 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928dded-8fc2-4971-9735-4713702f60f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:52:56.272986 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928dded-8fc2-4971-9735-4713702f60f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:56.274612 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928dded-8fc2-4971-9735-4713702f60f6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:56.287022 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1408/2824] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:52:56.291562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc7a68-5204-427c-85ca-a1ee33b101c0 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:56.301582 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc7a68-5204-427c-85ca-a1ee33b101c0 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:56.306930 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d34aa-6a72-4d60-bbd4-ed50cd5106a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:56.307618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d34aa-6a72-4d60-bbd4-ed50cd5106a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:56.307949 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d34aa-6a72-4d60-bbd4-ed50cd5106a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:56.308224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d34aa-6a72-4d60-bbd4-ed50cd5106a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:56.308911 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d34aa-6a72-4d60-bbd4-ed50cd5106a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:56.310860 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d34aa-6a72-4d60-bbd4-ed50cd5106a6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:56.425337 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1417/2825] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:52:56 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:52:56.429559 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928dded-8fc2-4971-9735-4713702f60f6 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:56.440162 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928dded-8fc2-4971-9735-4713702f60f6 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:56.504092 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b49d06-9336-42bf-bdd7-883f7b62b9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:56.504771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b49d06-9336-42bf-bdd7-883f7b62b9cb admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:56.505054 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b49d06-9336-42bf-bdd7-883f7b62b9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:56.505329 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b49d06-9336-42bf-bdd7-883f7b62b9cb admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:56.506095 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b49d06-9336-42bf-bdd7-883f7b62b9cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:56.508148 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b49d06-9336-42bf-bdd7-883f7b62b9cb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:56.665495 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1409/2826] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:52:56 2022] POST /identity/v3/users => generated 284 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:52:56.674667 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d34aa-6a72-4d60-bbd4-ed50cd5106a6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:56.687351 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d34aa-6a72-4d60-bbd4-ed50cd5106a6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:56.693414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02d75b-4114-4f7b-ac2f-badbade941c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:56.694059 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02d75b-4114-4f7b-ac2f-badbade941c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:56.694370 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02d75b-4114-4f7b-ac2f-badbade941c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:56.694650 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02d75b-4114-4f7b-ac2f-badbade941c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:56.695379 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02d75b-4114-4f7b-ac2f-badbade941c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:56.697247 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02d75b-4114-4f7b-ac2f-badbade941c9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:56.711947 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1418/2827] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:52:56.716291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b49d06-9336-42bf-bdd7-883f7b62b9cb admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:56.726671 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b49d06-9336-42bf-bdd7-883f7b62b9cb admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:56.732771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9123e25-4f8e-48d9-bcbe-f5b07b64e968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:56.733469 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9123e25-4f8e-48d9-bcbe-f5b07b64e968 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:56.733781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9123e25-4f8e-48d9-bcbe-f5b07b64e968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:56.734084 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9123e25-4f8e-48d9-bcbe-f5b07b64e968 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:56.734875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9123e25-4f8e-48d9-bcbe-f5b07b64e968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:56.736676 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9123e25-4f8e-48d9-bcbe-f5b07b64e968 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:56.747825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1410/2828] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:52:56.756984 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02d75b-4114-4f7b-ac2f-badbade941c9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:56.766968 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02d75b-4114-4f7b-ac2f-badbade941c9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:56.772353 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83e5d5-5642-4d06-837d-0f5b59dda4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:56.773235 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83e5d5-5642-4d06-837d-0f5b59dda4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:56.773513 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83e5d5-5642-4d06-837d-0f5b59dda4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:56.773788 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83e5d5-5642-4d06-837d-0f5b59dda4e4 admin admin] PATH_INFO: `/v3/projects/ddaa6698356c4086aa156b60b40c2052/users/5970f48db43347f3a1ddf9fb08dedad7/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:56.789028 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83e5d5-5642-4d06-837d-0f5b59dda4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddaa6698356c4086aa156b60b40c2052, user_id=5970f48db43347f3a1ddf9fb08dedad7, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:56.791774 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83e5d5-5642-4d06-837d-0f5b59dda4e4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:56.938617 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1419/2829] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:52:56 2022] PUT /identity/v3/projects/ddaa6698356c4086aa156b60b40c2052/users/5970f48db43347f3a1ddf9fb08dedad7/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:52:56.951039 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebef18-915c-4f81-ab67-d2f829b2d029 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:56.951490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebef18-915c-4f81-ab67-d2f829b2d029 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:56.951891 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebef18-915c-4f81-ab67-d2f829b2d029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:56.980656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-54ebef18-915c-4f81-ab67-d2f829b2d029 None None] MFA Rules not processed for user `5970f48db43347f3a1ddf9fb08dedad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:52:56.981918 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-54ebef18-915c-4f81-ab67-d2f829b2d029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:57.054665 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1411/2830] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:52:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:52:57.065619 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83e5d5-5642-4d06-837d-0f5b59dda4e4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:57.067336 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7e83e5d5-5642-4d06-837d-0f5b59dda4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:57.125825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83e5d5-5642-4d06-837d-0f5b59dda4e4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:57.129553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7acb9-d02c-488d-930f-e0b514d1c185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:57.130202 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7acb9-d02c-488d-930f-e0b514d1c185 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:57.131190 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7acb9-d02c-488d-930f-e0b514d1c185 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:57.131383 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7acb9-d02c-488d-930f-e0b514d1c185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:57.139827 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7acb9-d02c-488d-930f-e0b514d1c185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:57.141251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7acb9-d02c-488d-930f-e0b514d1c185 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:57.150356 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1420/2831] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:52:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:53:07.050779 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:07.146125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=64,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:07.483984 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebef18-915c-4f81-ab67-d2f829b2d029 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:07.555718 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebef18-915c-4f81-ab67-d2f829b2d029 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:07.560378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef40ca4-c5b5-4e97-8ac0-7eb8ec1d17c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:07.561255 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef40ca4-c5b5-4e97-8ac0-7eb8ec1d17c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:07.561540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef40ca4-c5b5-4e97-8ac0-7eb8ec1d17c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:07.561814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef40ca4-c5b5-4e97-8ac0-7eb8ec1d17c9 admin admin] PATH_INFO: `/v3/users/5970f48db43347f3a1ddf9fb08dedad7` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:07.563060 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef40ca4-c5b5-4e97-8ac0-7eb8ec1d17c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5970f48db43347f3a1ddf9fb08dedad7)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:07.565066 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef40ca4-c5b5-4e97-8ac0-7eb8ec1d17c9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:07.886494 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6ef40ca4-c5b5-4e97-8ac0-7eb8ec1d17c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5970f48db43347f3a1ddf9fb08dedad7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:07.971540 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6ef40ca4-c5b5-4e97-8ac0-7eb8ec1d17c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5970f48db43347f3a1ddf9fb08dedad7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:07.981925 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6ef40ca4-c5b5-4e97-8ac0-7eb8ec1d17c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5970f48db43347f3a1ddf9fb08dedad7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:07.982740 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6ef40ca4-c5b5-4e97-8ac0-7eb8ec1d17c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5970f48db43347f3a1ddf9fb08dedad7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:07.998097 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6ef40ca4-c5b5-4e97-8ac0-7eb8ec1d17c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5970f48db43347f3a1ddf9fb08dedad7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:08.005826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1412/2832] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:53:07 2022] DELETE /identity/v3/users/5970f48db43347f3a1ddf9fb08dedad7 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:08.010747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec6bff-16b8-41d1-ba57-5abf472964a8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:08.011032 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec6bff-16b8-41d1-ba57-5abf472964a8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:08.011312 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec6bff-16b8-41d1-ba57-5abf472964a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:08.030408 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-dcec6bff-16b8-41d1-ba57-5abf472964a8 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:08.031620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dcec6bff-16b8-41d1-ba57-5abf472964a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:08.101260 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1421/2833] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:08.111611 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef40ca4-c5b5-4e97-8ac0-7eb8ec1d17c9 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:08.113085 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6ef40ca4-c5b5-4e97-8ac0-7eb8ec1d17c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:08.201314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef40ca4-c5b5-4e97-8ac0-7eb8ec1d17c9 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:08.204997 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d8c63-86c8-44b2-a8c5-2bd1c45161e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:08.205650 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d8c63-86c8-44b2-a8c5-2bd1c45161e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:08.205931 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d8c63-86c8-44b2-a8c5-2bd1c45161e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:08.206202 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d8c63-86c8-44b2-a8c5-2bd1c45161e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:08.217081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d8c63-86c8-44b2-a8c5-2bd1c45161e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:08.218560 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d8c63-86c8-44b2-a8c5-2bd1c45161e2 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:08.229608 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1413/2834] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:53:08.814672 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec6bff-16b8-41d1-ba57-5abf472964a8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:08.821143 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dcec6bff-16b8-41d1-ba57-5abf472964a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:08.839233 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec6bff-16b8-41d1-ba57-5abf472964a8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:08.847035 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64586e-20db-48d5-a8c8-4a9554bd5775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:08.848111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64586e-20db-48d5-a8c8-4a9554bd5775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:08.848501 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64586e-20db-48d5-a8c8-4a9554bd5775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:08.848878 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64586e-20db-48d5-a8c8-4a9554bd5775 admin admin] PATH_INFO: `/v3/projects/ddaa6698356c4086aa156b60b40c2052` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:08.850826 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64586e-20db-48d5-a8c8-4a9554bd5775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddaa6698356c4086aa156b60b40c2052)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:08.852787 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64586e-20db-48d5-a8c8-4a9554bd5775 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:09.013016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0f64586e-20db-48d5-a8c8-4a9554bd5775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddaa6698356c4086aa156b60b40c2052', 'request_id': 'req-0f64586e-20db-48d5-a8c8-4a9554bd5775'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:09.020163 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0f64586e-20db-48d5-a8c8-4a9554bd5775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddaa6698356c4086aa156b60b40c2052', 'request_id': 'req-0f64586e-20db-48d5-a8c8-4a9554bd5775'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:09.026530 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0f64586e-20db-48d5-a8c8-4a9554bd5775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddaa6698356c4086aa156b60b40c2052', 'request_id': 'req-0f64586e-20db-48d5-a8c8-4a9554bd5775'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:09.116655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0f64586e-20db-48d5-a8c8-4a9554bd5775 admin admin] The token cache is being invalidate because project ddaa6698356c4086aa156b60b40c2052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:53:09.116972 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0f64586e-20db-48d5-a8c8-4a9554bd5775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:09.117623 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0f64586e-20db-48d5-a8c8-4a9554bd5775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:09.120066 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1422/2835] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:53:08 2022] DELETE /identity/v3/projects/ddaa6698356c4086aa156b60b40c2052 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:09.126203 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf1714-6799-42bf-803f-6ac4cb483abb None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:09.126928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf1714-6799-42bf-803f-6ac4cb483abb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:09.126928 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf1714-6799-42bf-803f-6ac4cb483abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:09.147672 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6ddf1714-6799-42bf-803f-6ac4cb483abb None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:09.148892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6ddf1714-6799-42bf-803f-6ac4cb483abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:09.166807 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:09.217889 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1414/2836] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:09.227105 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc80c5-527c-45b4-9ba8-3b907d586353 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:09.227435 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc80c5-527c-45b4-9ba8-3b907d586353 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:09.227673 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc80c5-527c-45b4-9ba8-3b907d586353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:09.249231 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3dbc80c5-527c-45b4-9ba8-3b907d586353 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:09.252823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3dbc80c5-527c-45b4-9ba8-3b907d586353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:09.262136 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1423/2837] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:09.268693 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf1714-6799-42bf-803f-6ac4cb483abb None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:09.279089 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf1714-6799-42bf-803f-6ac4cb483abb None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:09.284039 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd7b5d-c7d8-4e7a-b8e4-9643a02d0579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:09.284714 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd7b5d-c7d8-4e7a-b8e4-9643a02d0579 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:09.284996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd7b5d-c7d8-4e7a-b8e4-9643a02d0579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:09.285270 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd7b5d-c7d8-4e7a-b8e4-9643a02d0579 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:09.286023 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd7b5d-c7d8-4e7a-b8e4-9643a02d0579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:53:09.286899 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd7b5d-c7d8-4e7a-b8e4-9643a02d0579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:09.288534 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd7b5d-c7d8-4e7a-b8e4-9643a02d0579 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:09.303101 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1415/2838] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:53:09.307527 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc80c5-527c-45b4-9ba8-3b907d586353 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:09.320890 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc80c5-527c-45b4-9ba8-3b907d586353 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:09.328826 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3060754-686f-4d23-bfc3-0aa0edae4332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:09.329932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3060754-686f-4d23-bfc3-0aa0edae4332 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:09.330475 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3060754-686f-4d23-bfc3-0aa0edae4332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:09.330923 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3060754-686f-4d23-bfc3-0aa0edae4332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:09.332128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3060754-686f-4d23-bfc3-0aa0edae4332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:09.336260 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3060754-686f-4d23-bfc3-0aa0edae4332 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:09.482775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1424/2839] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:53:09 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:53:09.487194 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd7b5d-c7d8-4e7a-b8e4-9643a02d0579 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:09.498863 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd7b5d-c7d8-4e7a-b8e4-9643a02d0579 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:09.569953 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4187e0b-be3a-482b-aa39-81e14d711a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:09.570680 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4187e0b-be3a-482b-aa39-81e14d711a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:09.570963 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4187e0b-be3a-482b-aa39-81e14d711a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:09.571286 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4187e0b-be3a-482b-aa39-81e14d711a96 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:09.572031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4187e0b-be3a-482b-aa39-81e14d711a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:09.574009 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4187e0b-be3a-482b-aa39-81e14d711a96 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:09.669940 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1416/2840] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:53:09 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:53:09.674279 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3060754-686f-4d23-bfc3-0aa0edae4332 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:09.686014 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3060754-686f-4d23-bfc3-0aa0edae4332 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:09.691210 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660fe6a-0f5c-479b-ad77-d768be8f7a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:09.691946 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660fe6a-0f5c-479b-ad77-d768be8f7a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:09.692251 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660fe6a-0f5c-479b-ad77-d768be8f7a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:09.692586 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660fe6a-0f5c-479b-ad77-d768be8f7a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:09.693401 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660fe6a-0f5c-479b-ad77-d768be8f7a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:09.695317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660fe6a-0f5c-479b-ad77-d768be8f7a88 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:09.707255 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1425/2841] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:09.713347 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4187e0b-be3a-482b-aa39-81e14d711a96 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:09.725260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4187e0b-be3a-482b-aa39-81e14d711a96 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:09.731081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107876a-407d-4864-beec-ab323a19a01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:09.731771 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107876a-407d-4864-beec-ab323a19a01d admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:09.732081 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107876a-407d-4864-beec-ab323a19a01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:09.732330 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107876a-407d-4864-beec-ab323a19a01d admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:09.733319 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107876a-407d-4864-beec-ab323a19a01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:09.734922 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107876a-407d-4864-beec-ab323a19a01d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:09.747174 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1417/2842] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:09.751798 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660fe6a-0f5c-479b-ad77-d768be8f7a88 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:09.763725 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660fe6a-0f5c-479b-ad77-d768be8f7a88 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:09.768850 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a067db-4c13-44e5-9ff0-e55debe0cf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:09.769861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a067db-4c13-44e5-9ff0-e55debe0cf75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:09.770143 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a067db-4c13-44e5-9ff0-e55debe0cf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:09.770493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a067db-4c13-44e5-9ff0-e55debe0cf75 admin admin] PATH_INFO: `/v3/projects/c6b6aaf756e04b9d8bbbe335b8c5050c/users/72e05400c6eb427bbcdd8a1ec39d6fd7/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:09.788849 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a067db-4c13-44e5-9ff0-e55debe0cf75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b6aaf756e04b9d8bbbe335b8c5050c, user_id=72e05400c6eb427bbcdd8a1ec39d6fd7, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:09.791771 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a067db-4c13-44e5-9ff0-e55debe0cf75 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:09.886895 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1426/2843] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:53:09 2022] PUT /identity/v3/projects/c6b6aaf756e04b9d8bbbe335b8c5050c/users/72e05400c6eb427bbcdd8a1ec39d6fd7/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:09.899140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6b1c3-29a3-4b6d-8dc2-99a04d3baddb None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:09.899474 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6b1c3-29a3-4b6d-8dc2-99a04d3baddb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:09.899732 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6b1c3-29a3-4b6d-8dc2-99a04d3baddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:09.931872 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-cac6b1c3-29a3-4b6d-8dc2-99a04d3baddb None None] MFA Rules not processed for user `72e05400c6eb427bbcdd8a1ec39d6fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:09.933168 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cac6b1c3-29a3-4b6d-8dc2-99a04d3baddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:10.013875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1418/2844] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:53:10.018586 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a067db-4c13-44e5-9ff0-e55debe0cf75 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:10.045291 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:10.090775 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a067db-4c13-44e5-9ff0-e55debe0cf75 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:10.096466 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7cbc6-1416-4cbf-a8e6-7eb13e603dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:10.097029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7cbc6-1416-4cbf-a8e6-7eb13e603dac admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:10.097309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7cbc6-1416-4cbf-a8e6-7eb13e603dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:10.097608 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7cbc6-1416-4cbf-a8e6-7eb13e603dac admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:10.098449 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7cbc6-1416-4cbf-a8e6-7eb13e603dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:10.101597 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7cbc6-1416-4cbf-a8e6-7eb13e603dac admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:10.225183 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1427/2845] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:53:10 2022] POST /identity/v3/projects => generated 371 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:53:10.231921 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6b1c3-29a3-4b6d-8dc2-99a04d3baddb None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:10.247212 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6b1c3-29a3-4b6d-8dc2-99a04d3baddb None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:10.264947 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:10.315966 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2b5ee-b512-4e93-9da1-738080b8190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:10.316720 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2b5ee-b512-4e93-9da1-738080b8190c admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:10.317002 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2b5ee-b512-4e93-9da1-738080b8190c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:10.317274 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2b5ee-b512-4e93-9da1-738080b8190c admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:10.318753 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2b5ee-b512-4e93-9da1-738080b8190c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:10.320997 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2b5ee-b512-4e93-9da1-738080b8190c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:10.482249 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1419/2846] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:53:10 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:53:10.487158 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7cbc6-1416-4cbf-a8e6-7eb13e603dac admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:10.499626 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7cbc6-1416-4cbf-a8e6-7eb13e603dac admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:10.505216 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aaa474-53bb-46c8-91cb-21a035cbf05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:10.505887 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aaa474-53bb-46c8-91cb-21a035cbf05b admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:10.506174 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aaa474-53bb-46c8-91cb-21a035cbf05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:10.506511 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aaa474-53bb-46c8-91cb-21a035cbf05b admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:10.507287 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aaa474-53bb-46c8-91cb-21a035cbf05b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:10.508938 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aaa474-53bb-46c8-91cb-21a035cbf05b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:10.523566 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1428/2847] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:10.530249 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2b5ee-b512-4e93-9da1-738080b8190c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:10.548200 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2b5ee-b512-4e93-9da1-738080b8190c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:10.553649 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b2665-f036-4a3f-aa0e-8d7551ad79b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:10.554674 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b2665-f036-4a3f-aa0e-8d7551ad79b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:10.555025 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b2665-f036-4a3f-aa0e-8d7551ad79b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:10.555349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b2665-f036-4a3f-aa0e-8d7551ad79b4 admin admin] PATH_INFO: `/v3/projects/b9cfdbd680044a0480be4e22e9c4c6e5/users/ac7600db3c2a44f4915324cdaeb7908c/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:10.574184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b2665-f036-4a3f-aa0e-8d7551ad79b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9cfdbd680044a0480be4e22e9c4c6e5, user_id=ac7600db3c2a44f4915324cdaeb7908c, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:10.576945 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b2665-f036-4a3f-aa0e-8d7551ad79b4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:10.671184 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1420/2848] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:53:10 2022] PUT /identity/v3/projects/b9cfdbd680044a0480be4e22e9c4c6e5/users/ac7600db3c2a44f4915324cdaeb7908c/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:10.676430 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aaa474-53bb-46c8-91cb-21a035cbf05b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:10.695666 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aaa474-53bb-46c8-91cb-21a035cbf05b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:10.790529 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e71c37-1979-45d1-ba18-e93dee6b9d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:10.791068 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e71c37-1979-45d1-ba18-e93dee6b9d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:10.791350 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e71c37-1979-45d1-ba18-e93dee6b9d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:10.791670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e71c37-1979-45d1-ba18-e93dee6b9d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:10.792418 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e71c37-1979-45d1-ba18-e93dee6b9d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:10.794199 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e71c37-1979-45d1-ba18-e93dee6b9d7c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:10.806780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1429/2849] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:10.811599 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b2665-f036-4a3f-aa0e-8d7551ad79b4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:10.825102 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b2665-f036-4a3f-aa0e-8d7551ad79b4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:10.830749 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86b5b7-8e45-496b-9612-e66f584c6bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:10.831826 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86b5b7-8e45-496b-9612-e66f584c6bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:10.832208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86b5b7-8e45-496b-9612-e66f584c6bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:10.832614 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86b5b7-8e45-496b-9612-e66f584c6bd9 admin admin] PATH_INFO: `/v3/projects/b9cfdbd680044a0480be4e22e9c4c6e5/users/ac7600db3c2a44f4915324cdaeb7908c/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:10.835710 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86b5b7-8e45-496b-9612-e66f584c6bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9cfdbd680044a0480be4e22e9c4c6e5, user_id=ac7600db3c2a44f4915324cdaeb7908c, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:10.838484 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86b5b7-8e45-496b-9612-e66f584c6bd9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:10.850514 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1421/2850] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:53:10 2022] PUT /identity/v3/projects/b9cfdbd680044a0480be4e22e9c4c6e5/users/ac7600db3c2a44f4915324cdaeb7908c/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:10.863230 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da67573-7756-4136-baaf-b7dabf09cdd8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:10.867073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da67573-7756-4136-baaf-b7dabf09cdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:10.867073 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da67573-7756-4136-baaf-b7dabf09cdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:10.897505 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5da67573-7756-4136-baaf-b7dabf09cdd8 None None] MFA Rules not processed for user `ac7600db3c2a44f4915324cdaeb7908c`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:10.904785 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5da67573-7756-4136-baaf-b7dabf09cdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:10.981241 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1430/2851] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:53:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:10.993614 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86b5b7-8e45-496b-9612-e66f584c6bd9 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:10.995460 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2c86b5b7-8e45-496b-9612-e66f584c6bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:11.067165 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86b5b7-8e45-496b-9612-e66f584c6bd9 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:11.071863 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7be7d-b391-448d-97c5-c9fe72c01610 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:11.072650 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7be7d-b391-448d-97c5-c9fe72c01610 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:11.072976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7be7d-b391-448d-97c5-c9fe72c01610 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:11.073252 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7be7d-b391-448d-97c5-c9fe72c01610 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:11.084857 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7be7d-b391-448d-97c5-c9fe72c01610 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:11.086356 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7be7d-b391-448d-97c5-c9fe72c01610 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:11.097691 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1422/2852] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:53:11.300011 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da67573-7756-4136-baaf-b7dabf09cdd8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:11.320480 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da67573-7756-4136-baaf-b7dabf09cdd8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:11.324764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8aa14-389d-4ba1-9134-64029770faf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:11.325431 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8aa14-389d-4ba1-9134-64029770faf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:11.325749 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8aa14-389d-4ba1-9134-64029770faf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:11.326054 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8aa14-389d-4ba1-9134-64029770faf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:11.343712 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:11.420173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8aa14-389d-4ba1-9134-64029770faf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:11.421643 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8aa14-389d-4ba1-9134-64029770faf5 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:11.432414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1431/2853] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:53:21.092547 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=62,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:21.427493 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=21 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:40.256343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7be7d-b391-448d-97c5-c9fe72c01610 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:40.256343 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-21f7be7d-b391-448d-97c5-c9fe72c01610 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:40.276883 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7be7d-b391-448d-97c5-c9fe72c01610 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:40.282908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c86ca-810f-40fe-a675-284433cf0fd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fd088faaba4d5c9745638c14f1a7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:40.283721 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c86ca-810f-40fe-a675-284433cf0fd3 service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:40.284011 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c86ca-810f-40fe-a675-284433cf0fd3 service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:40.284292 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c86ca-810f-40fe-a675-284433cf0fd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:40.287606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ac6c86ca-810f-40fe-a675-284433cf0fd3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:40.307121 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c86ca-810f-40fe-a675-284433cf0fd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:40.309996 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c86ca-810f-40fe-a675-284433cf0fd3 service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:40.326694 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1423/2854] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:53:50.321128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=32 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:52.804963 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8aa14-389d-4ba1-9134-64029770faf5 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:52.879992 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8aa14-389d-4ba1-9134-64029770faf5 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:52.885395 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0bf4b-a3ae-4844-80b9-a68f809c87f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:52.886635 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0bf4b-a3ae-4844-80b9-a68f809c87f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:52.887115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0bf4b-a3ae-4844-80b9-a68f809c87f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:52.887434 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0bf4b-a3ae-4844-80b9-a68f809c87f2 admin admin] PATH_INFO: `/v3/users/72e05400c6eb427bbcdd8a1ec39d6fd7` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:52.888755 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0bf4b-a3ae-4844-80b9-a68f809c87f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e05400c6eb427bbcdd8a1ec39d6fd7)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:52.896215 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0bf4b-a3ae-4844-80b9-a68f809c87f2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:53.166359 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c5d0bf4b-a3ae-4844-80b9-a68f809c87f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e05400c6eb427bbcdd8a1ec39d6fd7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:53.279765 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c5d0bf4b-a3ae-4844-80b9-a68f809c87f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e05400c6eb427bbcdd8a1ec39d6fd7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:53.288346 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c5d0bf4b-a3ae-4844-80b9-a68f809c87f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e05400c6eb427bbcdd8a1ec39d6fd7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:53.289851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c5d0bf4b-a3ae-4844-80b9-a68f809c87f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e05400c6eb427bbcdd8a1ec39d6fd7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:53.304620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c5d0bf4b-a3ae-4844-80b9-a68f809c87f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e05400c6eb427bbcdd8a1ec39d6fd7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:53.310993 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1432/2855] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:53:52 2022] DELETE /identity/v3/users/72e05400c6eb427bbcdd8a1ec39d6fd7 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:53.315583 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10744fb-c2ec-42ad-aeb1-1ef40ec5fcf0 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:53.316107 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10744fb-c2ec-42ad-aeb1-1ef40ec5fcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:53.316218 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10744fb-c2ec-42ad-aeb1-1ef40ec5fcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:53.336542 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a10744fb-c2ec-42ad-aeb1-1ef40ec5fcf0 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:53.337778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a10744fb-c2ec-42ad-aeb1-1ef40ec5fcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:53.403145 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1424/2856] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:53.413470 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0bf4b-a3ae-4844-80b9-a68f809c87f2 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:53.414926 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c5d0bf4b-a3ae-4844-80b9-a68f809c87f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:53.481306 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0bf4b-a3ae-4844-80b9-a68f809c87f2 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:53.485115 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfcb43-97dc-4f17-8d5c-1f3e996d32c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:53.485764 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfcb43-97dc-4f17-8d5c-1f3e996d32c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:53.486044 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfcb43-97dc-4f17-8d5c-1f3e996d32c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:53.486344 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfcb43-97dc-4f17-8d5c-1f3e996d32c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:53.496794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfcb43-97dc-4f17-8d5c-1f3e996d32c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:53.498615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfcb43-97dc-4f17-8d5c-1f3e996d32c1 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:53.508185 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1433/2857] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:53:54.327102 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10744fb-c2ec-42ad-aeb1-1ef40ec5fcf0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:54.330959 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a10744fb-c2ec-42ad-aeb1-1ef40ec5fcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:54.343462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10744fb-c2ec-42ad-aeb1-1ef40ec5fcf0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:54.349612 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b08dca-3b25-4136-9bf2-9bc99b57b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:54.350552 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b08dca-3b25-4136-9bf2-9bc99b57b157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:54.350839 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b08dca-3b25-4136-9bf2-9bc99b57b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:54.351141 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b08dca-3b25-4136-9bf2-9bc99b57b157 admin admin] PATH_INFO: `/v3/projects/c6b6aaf756e04b9d8bbbe335b8c5050c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:54.352420 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b08dca-3b25-4136-9bf2-9bc99b57b157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b6aaf756e04b9d8bbbe335b8c5050c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:54.354716 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b08dca-3b25-4136-9bf2-9bc99b57b157 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:54.493752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36b08dca-3b25-4136-9bf2-9bc99b57b157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b6aaf756e04b9d8bbbe335b8c5050c', 'request_id': 'req-36b08dca-3b25-4136-9bf2-9bc99b57b157'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:54.499790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36b08dca-3b25-4136-9bf2-9bc99b57b157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b6aaf756e04b9d8bbbe335b8c5050c', 'request_id': 'req-36b08dca-3b25-4136-9bf2-9bc99b57b157'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:54.506219 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36b08dca-3b25-4136-9bf2-9bc99b57b157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b6aaf756e04b9d8bbbe335b8c5050c', 'request_id': 'req-36b08dca-3b25-4136-9bf2-9bc99b57b157'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:54.633882 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36b08dca-3b25-4136-9bf2-9bc99b57b157 admin admin] The token cache is being invalidate because project c6b6aaf756e04b9d8bbbe335b8c5050c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:53:54.634140 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36b08dca-3b25-4136-9bf2-9bc99b57b157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:54.634790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-36b08dca-3b25-4136-9bf2-9bc99b57b157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:54.636417 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1425/2858] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:53:54 2022] DELETE /identity/v3/projects/c6b6aaf756e04b9d8bbbe335b8c5050c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:53:54.640654 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfcb43-97dc-4f17-8d5c-1f3e996d32c1 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:54.652179 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfcb43-97dc-4f17-8d5c-1f3e996d32c1 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:54.674141 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:54.716782 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a19a8e-db56-439d-aa62-35118fc5fe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:54.717790 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a19a8e-db56-439d-aa62-35118fc5fe91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:54.718002 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a19a8e-db56-439d-aa62-35118fc5fe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:54.718271 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a19a8e-db56-439d-aa62-35118fc5fe91 admin admin] PATH_INFO: `/v3/users/ac7600db3c2a44f4915324cdaeb7908c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:54.719526 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a19a8e-db56-439d-aa62-35118fc5fe91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7600db3c2a44f4915324cdaeb7908c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:54.721482 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a19a8e-db56-439d-aa62-35118fc5fe91 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:55.008701 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a6a19a8e-db56-439d-aa62-35118fc5fe91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7600db3c2a44f4915324cdaeb7908c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:55.137468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a6a19a8e-db56-439d-aa62-35118fc5fe91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7600db3c2a44f4915324cdaeb7908c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:55.146405 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a6a19a8e-db56-439d-aa62-35118fc5fe91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7600db3c2a44f4915324cdaeb7908c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:55.147111 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a6a19a8e-db56-439d-aa62-35118fc5fe91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7600db3c2a44f4915324cdaeb7908c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:55.160269 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a6a19a8e-db56-439d-aa62-35118fc5fe91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7600db3c2a44f4915324cdaeb7908c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:55.167412 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1434/2859] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:53:54 2022] DELETE /identity/v3/users/ac7600db3c2a44f4915324cdaeb7908c => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:55.681909 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b08dca-3b25-4136-9bf2-9bc99b57b157 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:55.683614 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-36b08dca-3b25-4136-9bf2-9bc99b57b157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:55.697983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b08dca-3b25-4136-9bf2-9bc99b57b157 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:55.759835 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b2fb8-bcad-448e-89fb-73b4dc5e23bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:55.760698 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2fb8-bcad-448e-89fb-73b4dc5e23bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:55.760989 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2fb8-bcad-448e-89fb-73b4dc5e23bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:55.761259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2fb8-bcad-448e-89fb-73b4dc5e23bf admin admin] PATH_INFO: `/v3/projects/b9cfdbd680044a0480be4e22e9c4c6e5` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:55.762504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b2fb8-bcad-448e-89fb-73b4dc5e23bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9cfdbd680044a0480be4e22e9c4c6e5)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:55.764620 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b2fb8-bcad-448e-89fb-73b4dc5e23bf admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:55.887128 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:55.904610 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aa1b2fb8-bcad-448e-89fb-73b4dc5e23bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9cfdbd680044a0480be4e22e9c4c6e5', 'request_id': 'req-aa1b2fb8-bcad-448e-89fb-73b4dc5e23bf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:55.912993 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aa1b2fb8-bcad-448e-89fb-73b4dc5e23bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9cfdbd680044a0480be4e22e9c4c6e5', 'request_id': 'req-aa1b2fb8-bcad-448e-89fb-73b4dc5e23bf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:55.919577 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aa1b2fb8-bcad-448e-89fb-73b4dc5e23bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9cfdbd680044a0480be4e22e9c4c6e5', 'request_id': 'req-aa1b2fb8-bcad-448e-89fb-73b4dc5e23bf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:56.021960 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aa1b2fb8-bcad-448e-89fb-73b4dc5e23bf admin admin] The token cache is being invalidate because project b9cfdbd680044a0480be4e22e9c4c6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:53:56.022232 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aa1b2fb8-bcad-448e-89fb-73b4dc5e23bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:56.022880 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aa1b2fb8-bcad-448e-89fb-73b4dc5e23bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:56.024488 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1426/2860] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:53:55 2022] DELETE /identity/v3/projects/b9cfdbd680044a0480be4e22e9c4c6e5 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:56.029819 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05aef2-ef1a-40b6-bf4f-a9a43590addb None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:56.030409 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05aef2-ef1a-40b6-bf4f-a9a43590addb None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:56.030409 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05aef2-ef1a-40b6-bf4f-a9a43590addb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:56.050045 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8b05aef2-ef1a-40b6-bf4f-a9a43590addb None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:56.051835 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8b05aef2-ef1a-40b6-bf4f-a9a43590addb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:56.118822 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1435/2861] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:56.127150 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfa8a4-307d-4625-a1fc-62328cbc8a9a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:56.127440 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfa8a4-307d-4625-a1fc-62328cbc8a9a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:56.127723 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfa8a4-307d-4625-a1fc-62328cbc8a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:56.148863 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b2cfa8a4-307d-4625-a1fc-62328cbc8a9a None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:56.150087 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b2cfa8a4-307d-4625-a1fc-62328cbc8a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:56.158982 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1427/2862] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:56.163821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05aef2-ef1a-40b6-bf4f-a9a43590addb None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:56.174317 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05aef2-ef1a-40b6-bf4f-a9a43590addb None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:56.179273 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387a63-dd2d-48ee-ad1f-596a2613ece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:56.179940 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387a63-dd2d-48ee-ad1f-596a2613ece3 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:56.180341 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387a63-dd2d-48ee-ad1f-596a2613ece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:56.180620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387a63-dd2d-48ee-ad1f-596a2613ece3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:56.181357 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56387a63-dd2d-48ee-ad1f-596a2613ece3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:53:56.181662 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56387a63-dd2d-48ee-ad1f-596a2613ece3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:56.183336 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56387a63-dd2d-48ee-ad1f-596a2613ece3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:56.196081 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1436/2863] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:53:56.200732 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfa8a4-307d-4625-a1fc-62328cbc8a9a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:56.216273 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfa8a4-307d-4625-a1fc-62328cbc8a9a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:56.216548 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ea3a6-b26b-42da-a33c-04f0296a511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:56.217031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ea3a6-b26b-42da-a33c-04f0296a511e admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:56.217314 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ea3a6-b26b-42da-a33c-04f0296a511e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:56.217616 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ea3a6-b26b-42da-a33c-04f0296a511e admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:56.218352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ea3a6-b26b-42da-a33c-04f0296a511e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:56.220284 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ea3a6-b26b-42da-a33c-04f0296a511e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:56.331111 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1428/2864] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:53:56 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:53:56.336286 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387a63-dd2d-48ee-ad1f-596a2613ece3 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:56.347955 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387a63-dd2d-48ee-ad1f-596a2613ece3 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:56.376857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:56.410803 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ecc07-4bbd-4703-b7aa-53cb6e0c37c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:56.411793 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ecc07-4bbd-4703-b7aa-53cb6e0c37c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:56.412074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ecc07-4bbd-4703-b7aa-53cb6e0c37c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:56.412349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ecc07-4bbd-4703-b7aa-53cb6e0c37c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:56.413057 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ecc07-4bbd-4703-b7aa-53cb6e0c37c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:56.415033 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ecc07-4bbd-4703-b7aa-53cb6e0c37c9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:56.720403 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1437/2865] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:53:56 2022] POST /identity/v3/users => generated 284 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:53:56.725630 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ea3a6-b26b-42da-a33c-04f0296a511e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:56.737870 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ea3a6-b26b-42da-a33c-04f0296a511e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:56.743504 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00100fdc-5f5f-46e3-807f-d607bc986959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:56.744226 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00100fdc-5f5f-46e3-807f-d607bc986959 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:56.744622 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00100fdc-5f5f-46e3-807f-d607bc986959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:56.744784 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00100fdc-5f5f-46e3-807f-d607bc986959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:56.745519 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00100fdc-5f5f-46e3-807f-d607bc986959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:56.747729 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00100fdc-5f5f-46e3-807f-d607bc986959 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:56.760946 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1429/2866] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:56.765205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ecc07-4bbd-4703-b7aa-53cb6e0c37c9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:56.777916 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ecc07-4bbd-4703-b7aa-53cb6e0c37c9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:56.783031 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e66f07-58f2-4b80-b4bb-bd226c607545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:56.783704 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e66f07-58f2-4b80-b4bb-bd226c607545 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:56.783983 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e66f07-58f2-4b80-b4bb-bd226c607545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:56.784255 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e66f07-58f2-4b80-b4bb-bd226c607545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:56.785039 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e66f07-58f2-4b80-b4bb-bd226c607545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:56.787747 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e66f07-58f2-4b80-b4bb-bd226c607545 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:56.799584 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1438/2867] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:56.806684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00100fdc-5f5f-46e3-807f-d607bc986959 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:56.819830 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00100fdc-5f5f-46e3-807f-d607bc986959 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:56.824744 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7571b2a-9fd9-4115-801b-3221cdbf085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:56.825713 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7571b2a-9fd9-4115-801b-3221cdbf085c admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:56.826125 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7571b2a-9fd9-4115-801b-3221cdbf085c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:56.826243 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7571b2a-9fd9-4115-801b-3221cdbf085c admin admin] PATH_INFO: `/v3/projects/0e2db29ca6b2403ca59d1ccf368f0b73/users/10b7a1672e2543d4ba056c3150dafa9f/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:56.847750 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7571b2a-9fd9-4115-801b-3221cdbf085c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2db29ca6b2403ca59d1ccf368f0b73, user_id=10b7a1672e2543d4ba056c3150dafa9f, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:56.850558 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7571b2a-9fd9-4115-801b-3221cdbf085c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:56.971710 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1430/2868] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:53:56 2022] PUT /identity/v3/projects/0e2db29ca6b2403ca59d1ccf368f0b73/users/10b7a1672e2543d4ba056c3150dafa9f/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:57.080079 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302b410-7252-4fe6-af28-569118a64c40 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:57.080628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302b410-7252-4fe6-af28-569118a64c40 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:57.080628 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302b410-7252-4fe6-af28-569118a64c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:57.124381 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8302b410-7252-4fe6-af28-569118a64c40 None None] MFA Rules not processed for user `10b7a1672e2543d4ba056c3150dafa9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:57.125643 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8302b410-7252-4fe6-af28-569118a64c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:57.208048 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1439/2869] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:53:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:57.214637 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7571b2a-9fd9-4115-801b-3221cdbf085c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:57.296349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7571b2a-9fd9-4115-801b-3221cdbf085c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:57.303352 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41205f-b208-4404-abde-3eec818f6e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:57.304462 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41205f-b208-4404-abde-3eec818f6e47 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:57.304781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41205f-b208-4404-abde-3eec818f6e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:57.305190 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41205f-b208-4404-abde-3eec818f6e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:57.305781 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41205f-b208-4404-abde-3eec818f6e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:57.307806 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41205f-b208-4404-abde-3eec818f6e47 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:57.437100 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1431/2870] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:53:57 2022] POST /identity/v3/projects => generated 369 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:53:57.442857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302b410-7252-4fe6-af28-569118a64c40 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:57.455919 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302b410-7252-4fe6-af28-569118a64c40 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:57.538287 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2f28c-d20e-4ec1-90c4-f6a68c926afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:57.539078 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2f28c-d20e-4ec1-90c4-f6a68c926afd admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:57.539382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2f28c-d20e-4ec1-90c4-f6a68c926afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:57.539650 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2f28c-d20e-4ec1-90c4-f6a68c926afd admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:57.540488 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2f28c-d20e-4ec1-90c4-f6a68c926afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:57.542562 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2f28c-d20e-4ec1-90c4-f6a68c926afd admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:57.678355 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1440/2871] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:53:57 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:53:57.682648 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41205f-b208-4404-abde-3eec818f6e47 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:57.694976 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41205f-b208-4404-abde-3eec818f6e47 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:57.704706 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e8d0e-94dd-4cd2-bbf2-e6619692e946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:57.705443 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e8d0e-94dd-4cd2-bbf2-e6619692e946 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:57.705767 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e8d0e-94dd-4cd2-bbf2-e6619692e946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:57.706102 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e8d0e-94dd-4cd2-bbf2-e6619692e946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:57.707071 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e8d0e-94dd-4cd2-bbf2-e6619692e946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:57.708840 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e8d0e-94dd-4cd2-bbf2-e6619692e946 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:57.720421 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1432/2872] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:57.725131 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2f28c-d20e-4ec1-90c4-f6a68c926afd admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:57.736442 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2f28c-d20e-4ec1-90c4-f6a68c926afd admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:57.742443 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42923f2d-4942-4227-a6a4-c6162aa122ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:57.743367 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42923f2d-4942-4227-a6a4-c6162aa122ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:57.743649 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42923f2d-4942-4227-a6a4-c6162aa122ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:57.743928 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42923f2d-4942-4227-a6a4-c6162aa122ef admin admin] PATH_INFO: `/v3/projects/5a89b1cca2704ffdb086dfb5265f43dc/users/1cae88824c304536a1376cb77b1e8e66/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:57.761715 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42923f2d-4942-4227-a6a4-c6162aa122ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a89b1cca2704ffdb086dfb5265f43dc, user_id=1cae88824c304536a1376cb77b1e8e66, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:57.764651 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42923f2d-4942-4227-a6a4-c6162aa122ef admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:57.916348 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1441/2873] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:53:57 2022] PUT /identity/v3/projects/5a89b1cca2704ffdb086dfb5265f43dc/users/1cae88824c304536a1376cb77b1e8e66/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:57.920818 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e8d0e-94dd-4cd2-bbf2-e6619692e946 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:57.935794 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e8d0e-94dd-4cd2-bbf2-e6619692e946 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:57.957701 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:57.997297 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a98bc8-1ebc-4c49-ad10-d84104722cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:57.998485 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a98bc8-1ebc-4c49-ad10-d84104722cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:57.999055 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a98bc8-1ebc-4c49-ad10-d84104722cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:57.999472 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a98bc8-1ebc-4c49-ad10-d84104722cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:58.000755 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a98bc8-1ebc-4c49-ad10-d84104722cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:58.002395 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a98bc8-1ebc-4c49-ad10-d84104722cb5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:58.012684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1433/2874] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:58.016877 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42923f2d-4942-4227-a6a4-c6162aa122ef admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:58.022589 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:58.028080 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42923f2d-4942-4227-a6a4-c6162aa122ef admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:58.033128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f270cb-d311-426c-ab55-27a54f8f8f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:58.034017 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f270cb-d311-426c-ab55-27a54f8f8f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:58.034294 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f270cb-d311-426c-ab55-27a54f8f8f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:58.034609 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f270cb-d311-426c-ab55-27a54f8f8f90 admin admin] PATH_INFO: `/v3/projects/5a89b1cca2704ffdb086dfb5265f43dc/users/1cae88824c304536a1376cb77b1e8e66/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:58.037203 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f270cb-d311-426c-ab55-27a54f8f8f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a89b1cca2704ffdb086dfb5265f43dc, user_id=1cae88824c304536a1376cb77b1e8e66, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:58.039914 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f270cb-d311-426c-ab55-27a54f8f8f90 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:58.052027 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1442/2875] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:53:58 2022] PUT /identity/v3/projects/5a89b1cca2704ffdb086dfb5265f43dc/users/1cae88824c304536a1376cb77b1e8e66/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:58.062782 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11595e37-f894-4a9e-802d-0c964f7a4171 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:58.063117 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11595e37-f894-4a9e-802d-0c964f7a4171 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:58.063349 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11595e37-f894-4a9e-802d-0c964f7a4171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:58.092662 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-11595e37-f894-4a9e-802d-0c964f7a4171 None None] MFA Rules not processed for user `1cae88824c304536a1376cb77b1e8e66`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:58.093947 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-11595e37-f894-4a9e-802d-0c964f7a4171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:58.169223 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1434/2876] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:53:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:58.181610 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f270cb-d311-426c-ab55-27a54f8f8f90 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:58.183392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b3f270cb-d311-426c-ab55-27a54f8f8f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:58.248778 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f270cb-d311-426c-ab55-27a54f8f8f90 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:58.252594 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77982f36-7c42-452d-b7c9-91effdec1053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:58.253252 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77982f36-7c42-452d-b7c9-91effdec1053 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:58.253579 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77982f36-7c42-452d-b7c9-91effdec1053 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:58.253860 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77982f36-7c42-452d-b7c9-91effdec1053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:58.264229 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77982f36-7c42-452d-b7c9-91effdec1053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:58.265703 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77982f36-7c42-452d-b7c9-91effdec1053 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:58.276329 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1443/2877] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:58 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:54:01.978822 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11595e37-f894-4a9e-802d-0c964f7a4171 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:02.054259 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11595e37-f894-4a9e-802d-0c964f7a4171 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:02.059193 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5f2cc-0a03-4c82-a2c7-11aa66a5e5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:02.060733 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f2cc-0a03-4c82-a2c7-11aa66a5e5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:02.060733 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f2cc-0a03-4c82-a2c7-11aa66a5e5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:02.060733 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f2cc-0a03-4c82-a2c7-11aa66a5e5f3 admin admin] PATH_INFO: `/v3/users/10b7a1672e2543d4ba056c3150dafa9f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:02.061908 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5f2cc-0a03-4c82-a2c7-11aa66a5e5f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b7a1672e2543d4ba056c3150dafa9f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:02.063896 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5f2cc-0a03-4c82-a2c7-11aa66a5e5f3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:02.327287 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a9a5f2cc-0a03-4c82-a2c7-11aa66a5e5f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b7a1672e2543d4ba056c3150dafa9f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:02.329378 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:02.485306 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a9a5f2cc-0a03-4c82-a2c7-11aa66a5e5f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b7a1672e2543d4ba056c3150dafa9f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:02.494814 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a9a5f2cc-0a03-4c82-a2c7-11aa66a5e5f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b7a1672e2543d4ba056c3150dafa9f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:02.495569 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a9a5f2cc-0a03-4c82-a2c7-11aa66a5e5f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b7a1672e2543d4ba056c3150dafa9f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:02.508883 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a9a5f2cc-0a03-4c82-a2c7-11aa66a5e5f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b7a1672e2543d4ba056c3150dafa9f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:02.514924 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1435/2878] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:54:01 2022] DELETE /identity/v3/users/10b7a1672e2543d4ba056c3150dafa9f => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:54:02.519719 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c55a7e-18ae-4165-a8c3-23ce1daf725e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:02.522618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c55a7e-18ae-4165-a8c3-23ce1daf725e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:02.522618 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c55a7e-18ae-4165-a8c3-23ce1daf725e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:02.539780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-50c55a7e-18ae-4165-a8c3-23ce1daf725e None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:54:02.540981 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-50c55a7e-18ae-4165-a8c3-23ce1daf725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:02.602756 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1444/2879] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:54:02.612632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5f2cc-0a03-4c82-a2c7-11aa66a5e5f3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:02.614900 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a9a5f2cc-0a03-4c82-a2c7-11aa66a5e5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:02.684640 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5f2cc-0a03-4c82-a2c7-11aa66a5e5f3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:02.688313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1f42-4e0c-46b6-b245-676814c93b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:02.689009 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1f42-4e0c-46b6-b245-676814c93b2a service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:02.689295 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1f42-4e0c-46b6-b245-676814c93b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:02.689586 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1f42-4e0c-46b6-b245-676814c93b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:02.699574 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca1f42-4e0c-46b6-b245-676814c93b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:02.701099 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca1f42-4e0c-46b6-b245-676814c93b2a service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:02.712235 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1436/2880] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:54:03.218597 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c55a7e-18ae-4165-a8c3-23ce1daf725e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:03.220143 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-50c55a7e-18ae-4165-a8c3-23ce1daf725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:03.233507 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c55a7e-18ae-4165-a8c3-23ce1daf725e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:03.242036 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2da692-060b-4705-9129-e18a1414f42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:03.243661 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2da692-060b-4705-9129-e18a1414f42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:03.244175 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2da692-060b-4705-9129-e18a1414f42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:03.244653 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2da692-060b-4705-9129-e18a1414f42a admin admin] PATH_INFO: `/v3/projects/0e2db29ca6b2403ca59d1ccf368f0b73` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:03.247070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2da692-060b-4705-9129-e18a1414f42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2db29ca6b2403ca59d1ccf368f0b73)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:03.252291 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2da692-060b-4705-9129-e18a1414f42a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:03.407201 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ab2da692-060b-4705-9129-e18a1414f42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2db29ca6b2403ca59d1ccf368f0b73', 'request_id': 'req-ab2da692-060b-4705-9129-e18a1414f42a'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:03.415670 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ab2da692-060b-4705-9129-e18a1414f42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2db29ca6b2403ca59d1ccf368f0b73', 'request_id': 'req-ab2da692-060b-4705-9129-e18a1414f42a'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:03.422169 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ab2da692-060b-4705-9129-e18a1414f42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2db29ca6b2403ca59d1ccf368f0b73', 'request_id': 'req-ab2da692-060b-4705-9129-e18a1414f42a'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:03.558965 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ab2da692-060b-4705-9129-e18a1414f42a admin admin] The token cache is being invalidate because project 0e2db29ca6b2403ca59d1ccf368f0b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:54:03.559720 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ab2da692-060b-4705-9129-e18a1414f42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:03.560551 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ab2da692-060b-4705-9129-e18a1414f42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:03.563177 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1445/2881] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:54:03 2022] DELETE /identity/v3/projects/0e2db29ca6b2403ca59d1ccf368f0b73 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:54:03.569971 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1f42-4e0c-46b6-b245-676814c93b2a service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:03.587731 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1f42-4e0c-46b6-b245-676814c93b2a service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:03.693683 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cdf69-23ba-4cb8-80b3-9d5490202df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:03.695290 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cdf69-23ba-4cb8-80b3-9d5490202df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:03.695790 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cdf69-23ba-4cb8-80b3-9d5490202df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:03.696291 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cdf69-23ba-4cb8-80b3-9d5490202df3 admin admin] PATH_INFO: `/v3/users/1cae88824c304536a1376cb77b1e8e66` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:03.698524 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cdf69-23ba-4cb8-80b3-9d5490202df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cae88824c304536a1376cb77b1e8e66)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:03.701844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cdf69-23ba-4cb8-80b3-9d5490202df3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:03.992606 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bf9cdf69-23ba-4cb8-80b3-9d5490202df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cae88824c304536a1376cb77b1e8e66'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:04.096553 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bf9cdf69-23ba-4cb8-80b3-9d5490202df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cae88824c304536a1376cb77b1e8e66'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:04.105208 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bf9cdf69-23ba-4cb8-80b3-9d5490202df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cae88824c304536a1376cb77b1e8e66'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:04.106049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bf9cdf69-23ba-4cb8-80b3-9d5490202df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cae88824c304536a1376cb77b1e8e66'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:04.111981 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:04.120265 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bf9cdf69-23ba-4cb8-80b3-9d5490202df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cae88824c304536a1376cb77b1e8e66'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:04.126715 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1437/2882] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:54:03 2022] DELETE /identity/v3/users/1cae88824c304536a1376cb77b1e8e66 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:54:04.710780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2da692-060b-4705-9129-e18a1414f42a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:04.712850 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ab2da692-060b-4705-9129-e18a1414f42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:04.737316 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2da692-060b-4705-9129-e18a1414f42a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:04.760361 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:04.828460 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89439bd7-e8db-4abb-89c2-4d62f980989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:04.829425 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89439bd7-e8db-4abb-89c2-4d62f980989f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:04.829763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89439bd7-e8db-4abb-89c2-4d62f980989f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:04.830102 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89439bd7-e8db-4abb-89c2-4d62f980989f admin admin] PATH_INFO: `/v3/projects/5a89b1cca2704ffdb086dfb5265f43dc` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:04.831705 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89439bd7-e8db-4abb-89c2-4d62f980989f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a89b1cca2704ffdb086dfb5265f43dc)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:04.833829 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89439bd7-e8db-4abb-89c2-4d62f980989f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:05.061025 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-89439bd7-e8db-4abb-89c2-4d62f980989f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a89b1cca2704ffdb086dfb5265f43dc', 'request_id': 'req-89439bd7-e8db-4abb-89c2-4d62f980989f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:05.074258 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-89439bd7-e8db-4abb-89c2-4d62f980989f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a89b1cca2704ffdb086dfb5265f43dc', 'request_id': 'req-89439bd7-e8db-4abb-89c2-4d62f980989f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:05.085714 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-89439bd7-e8db-4abb-89c2-4d62f980989f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a89b1cca2704ffdb086dfb5265f43dc', 'request_id': 'req-89439bd7-e8db-4abb-89c2-4d62f980989f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:05.205473 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-89439bd7-e8db-4abb-89c2-4d62f980989f admin admin] The token cache is being invalidate because project 5a89b1cca2704ffdb086dfb5265f43dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:54:05.205757 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-89439bd7-e8db-4abb-89c2-4d62f980989f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:05.206596 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-89439bd7-e8db-4abb-89c2-4d62f980989f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:05.208516 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1446/2883] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:54:04 2022] DELETE /identity/v3/projects/5a89b1cca2704ffdb086dfb5265f43dc => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:54:05.214646 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31a1f5-0fa7-4586-894e-f4ef28ac5d41 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:05.215532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31a1f5-0fa7-4586-894e-f4ef28ac5d41 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:05.215532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31a1f5-0fa7-4586-894e-f4ef28ac5d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:05.239012 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3e31a1f5-0fa7-4586-894e-f4ef28ac5d41 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:54:05.240428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3e31a1f5-0fa7-4586-894e-f4ef28ac5d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:05.340339 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1438/2884] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:54:05.353224 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ed176-1848-4403-abfb-06e3136d18a1 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:05.353664 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ed176-1848-4403-abfb-06e3136d18a1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:05.354402 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ed176-1848-4403-abfb-06e3136d18a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:05.386116 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7e4ed176-1848-4403-abfb-06e3136d18a1 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:54:05.388173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7e4ed176-1848-4403-abfb-06e3136d18a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:05.407861 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1447/2885] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:54:05.410761 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31a1f5-0fa7-4586-894e-f4ef28ac5d41 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:05.430019 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31a1f5-0fa7-4586-894e-f4ef28ac5d41 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:05.438040 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b16371-e2b9-417b-892b-fc8af4655578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:05.439271 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b16371-e2b9-417b-892b-fc8af4655578 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:05.439703 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b16371-e2b9-417b-892b-fc8af4655578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:05.440076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b16371-e2b9-417b-892b-fc8af4655578 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:05.442435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b16371-e2b9-417b-892b-fc8af4655578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:54:05.443052 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b16371-e2b9-417b-892b-fc8af4655578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:05.446490 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b16371-e2b9-417b-892b-fc8af4655578 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:05.470943 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1439/2886] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:54:05.479014 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ed176-1848-4403-abfb-06e3136d18a1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:05.495825 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ed176-1848-4403-abfb-06e3136d18a1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:05.504288 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826ce41-82ad-4c67-8316-0f721976c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:05.505410 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826ce41-82ad-4c67-8316-0f721976c55d admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:05.505823 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826ce41-82ad-4c67-8316-0f721976c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:05.506205 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826ce41-82ad-4c67-8316-0f721976c55d admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:05.507310 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826ce41-82ad-4c67-8316-0f721976c55d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:05.511320 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826ce41-82ad-4c67-8316-0f721976c55d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:05.982841 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1448/2887] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:54:05 2022] POST /identity/v3/projects => generated 385 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:54:05.987304 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b16371-e2b9-417b-892b-fc8af4655578 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:05.999951 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b16371-e2b9-417b-892b-fc8af4655578 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:06.071632 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917212d2-9d9a-47f8-939e-759ea959282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:06.072502 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917212d2-9d9a-47f8-939e-759ea959282d admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:06.072747 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917212d2-9d9a-47f8-939e-759ea959282d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:06.073157 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917212d2-9d9a-47f8-939e-759ea959282d admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:06.074031 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917212d2-9d9a-47f8-939e-759ea959282d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:06.076106 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917212d2-9d9a-47f8-939e-759ea959282d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:06.303248 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1440/2888] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:54:05 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:54:06.309085 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826ce41-82ad-4c67-8316-0f721976c55d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:06.328445 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826ce41-82ad-4c67-8316-0f721976c55d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:06.337518 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2dbb6-bd09-489e-872f-c22812827022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:06.338632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2dbb6-bd09-489e-872f-c22812827022 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:06.339100 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2dbb6-bd09-489e-872f-c22812827022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:06.339591 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2dbb6-bd09-489e-872f-c22812827022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:06.340969 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2dbb6-bd09-489e-872f-c22812827022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:06.344088 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2dbb6-bd09-489e-872f-c22812827022 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:06.365929 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1449/2889] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:54:06.371268 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917212d2-9d9a-47f8-939e-759ea959282d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:06.386935 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917212d2-9d9a-47f8-939e-759ea959282d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:06.395403 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4989d74-57ed-459e-bc1f-904d523efea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:06.396512 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4989d74-57ed-459e-bc1f-904d523efea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:06.397105 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4989d74-57ed-459e-bc1f-904d523efea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:06.397523 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4989d74-57ed-459e-bc1f-904d523efea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:06.398940 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4989d74-57ed-459e-bc1f-904d523efea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:06.403297 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4989d74-57ed-459e-bc1f-904d523efea7 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:06.418858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1441/2890] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:54:06.425261 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2dbb6-bd09-489e-872f-c22812827022 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:06.441735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2dbb6-bd09-489e-872f-c22812827022 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:06.447794 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70e3c1-e0ad-4fae-8bfe-c7b22887f328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:06.448786 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70e3c1-e0ad-4fae-8bfe-c7b22887f328 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:06.449092 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70e3c1-e0ad-4fae-8bfe-c7b22887f328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:06.449393 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70e3c1-e0ad-4fae-8bfe-c7b22887f328 admin admin] PATH_INFO: `/v3/projects/e5d64bdcf4d34262b0acba885fae2f6c/users/7286f94bd2334e88892d8ed73d97869e/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:06.467951 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70e3c1-e0ad-4fae-8bfe-c7b22887f328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d64bdcf4d34262b0acba885fae2f6c, user_id=7286f94bd2334e88892d8ed73d97869e, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:06.470681 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70e3c1-e0ad-4fae-8bfe-c7b22887f328 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:06.639780 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1450/2891] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:54:06 2022] PUT /identity/v3/projects/e5d64bdcf4d34262b0acba885fae2f6c/users/7286f94bd2334e88892d8ed73d97869e/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:54:06.652529 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f5c58-27f0-4117-98c2-66aff3f5d81d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:06.653021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f5c58-27f0-4117-98c2-66aff3f5d81d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:06.653546 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f5c58-27f0-4117-98c2-66aff3f5d81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:06.704049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-108f5c58-27f0-4117-98c2-66aff3f5d81d None None] MFA Rules not processed for user `7286f94bd2334e88892d8ed73d97869e`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:54:06.706293 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-108f5c58-27f0-4117-98c2-66aff3f5d81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:06.764423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:06.796244 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1442/2892] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:54:06.804999 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70e3c1-e0ad-4fae-8bfe-c7b22887f328 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:06.869455 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:06.890603 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70e3c1-e0ad-4fae-8bfe-c7b22887f328 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:06.897291 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97080e-d3cd-44de-8ac5-cd4ac192a97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:06.897585 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97080e-d3cd-44de-8ac5-cd4ac192a97f admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:06.897876 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97080e-d3cd-44de-8ac5-cd4ac192a97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:06.898164 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97080e-d3cd-44de-8ac5-cd4ac192a97f admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:06.898925 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97080e-d3cd-44de-8ac5-cd4ac192a97f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:06.900932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97080e-d3cd-44de-8ac5-cd4ac192a97f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:07.065734 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1451/2893] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:54:06 2022] POST /identity/v3/projects => generated 387 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:54:07.070229 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f5c58-27f0-4117-98c2-66aff3f5d81d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:07.085772 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f5c58-27f0-4117-98c2-66aff3f5d81d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:07.164590 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098d380-8b6c-41f2-b956-40024aa976dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:07.165257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098d380-8b6c-41f2-b956-40024aa976dc admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:07.165594 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098d380-8b6c-41f2-b956-40024aa976dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:07.165948 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098d380-8b6c-41f2-b956-40024aa976dc admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:07.166780 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098d380-8b6c-41f2-b956-40024aa976dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:07.168892 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098d380-8b6c-41f2-b956-40024aa976dc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:07.292656 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1443/2894] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:54:07 2022] POST /identity/v3/users => generated 300 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:54:07.297048 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97080e-d3cd-44de-8ac5-cd4ac192a97f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:07.308759 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97080e-d3cd-44de-8ac5-cd4ac192a97f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:07.313912 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfc7dc-7345-49a8-91bd-5f221d766b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:07.314640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfc7dc-7345-49a8-91bd-5f221d766b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:07.314932 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfc7dc-7345-49a8-91bd-5f221d766b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:07.315208 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfc7dc-7345-49a8-91bd-5f221d766b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:07.316773 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfc7dc-7345-49a8-91bd-5f221d766b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:07.318035 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfc7dc-7345-49a8-91bd-5f221d766b46 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:07.333750 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1452/2895] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:54:07.338756 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098d380-8b6c-41f2-b956-40024aa976dc admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:07.351902 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098d380-8b6c-41f2-b956-40024aa976dc admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:07.357331 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1a38a-501f-472c-88c0-6ca78703a51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:07.359392 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1a38a-501f-472c-88c0-6ca78703a51f admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:07.359392 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1a38a-501f-472c-88c0-6ca78703a51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:07.359392 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1a38a-501f-472c-88c0-6ca78703a51f admin admin] PATH_INFO: `/v3/projects/546a893a38c54c2c9eeba964ebb62821/users/0392ff87308b4ba88b6a95b1923ed9c7/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:07.386423 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1a38a-501f-472c-88c0-6ca78703a51f admin admin] RBAC: Authorizing `identity:create_grant(project_id=546a893a38c54c2c9eeba964ebb62821, user_id=0392ff87308b4ba88b6a95b1923ed9c7, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:07.389151 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1a38a-501f-472c-88c0-6ca78703a51f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:07.521024 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1444/2896] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:54:07 2022] PUT /identity/v3/projects/546a893a38c54c2c9eeba964ebb62821/users/0392ff87308b4ba88b6a95b1923ed9c7/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:54:07.527140 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfc7dc-7345-49a8-91bd-5f221d766b46 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:07.539598 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfc7dc-7345-49a8-91bd-5f221d766b46 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:07.618632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f4d71-2ef3-4cf7-b4bb-e052a831006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:07.619309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f4d71-2ef3-4cf7-b4bb-e052a831006d admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:07.619676 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f4d71-2ef3-4cf7-b4bb-e052a831006d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:07.619979 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f4d71-2ef3-4cf7-b4bb-e052a831006d admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:07.620617 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f4d71-2ef3-4cf7-b4bb-e052a831006d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:07.622253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f4d71-2ef3-4cf7-b4bb-e052a831006d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:07.635632 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1453/2897] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:54:07.640313 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1a38a-501f-472c-88c0-6ca78703a51f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:07.652143 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1a38a-501f-472c-88c0-6ca78703a51f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:07.657456 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad4ce3-fd65-4179-ad2e-3e569590e722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:07.658428 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad4ce3-fd65-4179-ad2e-3e569590e722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:07.658708 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad4ce3-fd65-4179-ad2e-3e569590e722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:07.659049 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad4ce3-fd65-4179-ad2e-3e569590e722 admin admin] PATH_INFO: `/v3/projects/546a893a38c54c2c9eeba964ebb62821/users/0392ff87308b4ba88b6a95b1923ed9c7/roles/549e89b4a1e94091aa20ea1b8e767f3c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:07.661809 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad4ce3-fd65-4179-ad2e-3e569590e722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=546a893a38c54c2c9eeba964ebb62821, user_id=0392ff87308b4ba88b6a95b1923ed9c7, role_id=549e89b4a1e94091aa20ea1b8e767f3c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:07.664553 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad4ce3-fd65-4179-ad2e-3e569590e722 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:07.678206 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1445/2898] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:54:07 2022] PUT /identity/v3/projects/546a893a38c54c2c9eeba964ebb62821/users/0392ff87308b4ba88b6a95b1923ed9c7/roles/549e89b4a1e94091aa20ea1b8e767f3c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:54:07.690048 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f486d7e-cc3f-421a-a2af-84c2209e6301 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:07.690372 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f486d7e-cc3f-421a-a2af-84c2209e6301 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:07.690843 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f486d7e-cc3f-421a-a2af-84c2209e6301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:07.724768 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2f486d7e-cc3f-421a-a2af-84c2209e6301 None None] MFA Rules not processed for user `0392ff87308b4ba88b6a95b1923ed9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:54:07.726074 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2f486d7e-cc3f-421a-a2af-84c2209e6301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:07.810903 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1454/2899] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:54:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:54:07.828712 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad4ce3-fd65-4179-ad2e-3e569590e722 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:07.830914 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d9ad4ce3-fd65-4179-ad2e-3e569590e722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:07.922496 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad4ce3-fd65-4179-ad2e-3e569590e722 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:07.927435 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc64cb8-38f5-4101-b0e9-24a22137170d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f27c6bc2744b9f92141a9c6906bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:07.928251 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc64cb8-38f5-4101-b0e9-24a22137170d service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:07.928650 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc64cb8-38f5-4101-b0e9-24a22137170d service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:07.929087 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc64cb8-38f5-4101-b0e9-24a22137170d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:07.941920 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc64cb8-38f5-4101-b0e9-24a22137170d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:07.943518 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc64cb8-38f5-4101-b0e9-24a22137170d service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:07.954765 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1446/2900] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:54:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:54:09.495199 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f486d7e-cc3f-421a-a2af-84c2209e6301 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:09.546851 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:09.572867 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f486d7e-cc3f-421a-a2af-84c2209e6301 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:09.578406 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0752d16-b517-4a44-a13a-b2ca1ac7def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:09.579307 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0752d16-b517-4a44-a13a-b2ca1ac7def4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:09.579592 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0752d16-b517-4a44-a13a-b2ca1ac7def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:09.579868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0752d16-b517-4a44-a13a-b2ca1ac7def4 admin admin] PATH_INFO: `/v3/users/7286f94bd2334e88892d8ed73d97869e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:09.582174 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0752d16-b517-4a44-a13a-b2ca1ac7def4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7286f94bd2334e88892d8ed73d97869e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:09.584436 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0752d16-b517-4a44-a13a-b2ca1ac7def4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:09.842352 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c0752d16-b517-4a44-a13a-b2ca1ac7def4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7286f94bd2334e88892d8ed73d97869e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:09.964873 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c0752d16-b517-4a44-a13a-b2ca1ac7def4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7286f94bd2334e88892d8ed73d97869e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:09.973465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c0752d16-b517-4a44-a13a-b2ca1ac7def4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7286f94bd2334e88892d8ed73d97869e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:09.974186 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c0752d16-b517-4a44-a13a-b2ca1ac7def4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7286f94bd2334e88892d8ed73d97869e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:09.989450 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c0752d16-b517-4a44-a13a-b2ca1ac7def4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7286f94bd2334e88892d8ed73d97869e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:09.996362 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1455/2901] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:54:09 2022] DELETE /identity/v3/users/7286f94bd2334e88892d8ed73d97869e => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:54:10.001498 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13b903-4f77-4d3f-a095-4ac86753e238 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:10.002042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13b903-4f77-4d3f-a095-4ac86753e238 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:10.002042 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13b903-4f77-4d3f-a095-4ac86753e238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:10.024457 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-db13b903-4f77-4d3f-a095-4ac86753e238 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:54:10.025752 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-db13b903-4f77-4d3f-a095-4ac86753e238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:10.068551 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:10.098974 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1447/2902] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:54:10.110070 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0752d16-b517-4a44-a13a-b2ca1ac7def4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:10.111942 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c0752d16-b517-4a44-a13a-b2ca1ac7def4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:10.188234 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0752d16-b517-4a44-a13a-b2ca1ac7def4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:10.193019 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f38445-c2be-4a34-9b87-8083a834d610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:10.193688 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f38445-c2be-4a34-9b87-8083a834d610 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:10.193976 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f38445-c2be-4a34-9b87-8083a834d610 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:10.194253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f38445-c2be-4a34-9b87-8083a834d610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:10.205305 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f38445-c2be-4a34-9b87-8083a834d610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:10.207729 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f38445-c2be-4a34-9b87-8083a834d610 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:10.224721 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1456/2903] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:54:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:54:10.847707 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13b903-4f77-4d3f-a095-4ac86753e238 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:10.849489 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-db13b903-4f77-4d3f-a095-4ac86753e238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:10.866698 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13b903-4f77-4d3f-a095-4ac86753e238 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:10.872983 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09201dd4-545a-4742-9121-a5062c6b1fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:10.874138 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09201dd4-545a-4742-9121-a5062c6b1fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:10.874373 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09201dd4-545a-4742-9121-a5062c6b1fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:10.874659 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09201dd4-545a-4742-9121-a5062c6b1fb9 admin admin] PATH_INFO: `/v3/projects/e5d64bdcf4d34262b0acba885fae2f6c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:10.876021 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09201dd4-545a-4742-9121-a5062c6b1fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d64bdcf4d34262b0acba885fae2f6c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:10.877986 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09201dd4-545a-4742-9121-a5062c6b1fb9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:11.017789 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-09201dd4-545a-4742-9121-a5062c6b1fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d64bdcf4d34262b0acba885fae2f6c', 'request_id': 'req-09201dd4-545a-4742-9121-a5062c6b1fb9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:11.023816 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-09201dd4-545a-4742-9121-a5062c6b1fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d64bdcf4d34262b0acba885fae2f6c', 'request_id': 'req-09201dd4-545a-4742-9121-a5062c6b1fb9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:11.030453 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-09201dd4-545a-4742-9121-a5062c6b1fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d64bdcf4d34262b0acba885fae2f6c', 'request_id': 'req-09201dd4-545a-4742-9121-a5062c6b1fb9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:11.149064 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-09201dd4-545a-4742-9121-a5062c6b1fb9 admin admin] The token cache is being invalidate because project e5d64bdcf4d34262b0acba885fae2f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:54:11.149360 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-09201dd4-545a-4742-9121-a5062c6b1fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:11.150076 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-09201dd4-545a-4742-9121-a5062c6b1fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:11.151711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1448/2904] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:54:10 2022] DELETE /identity/v3/projects/e5d64bdcf4d34262b0acba885fae2f6c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:54:11.155960 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f38445-c2be-4a34-9b87-8083a834d610 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:11.167114 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f38445-c2be-4a34-9b87-8083a834d610 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:11.231824 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc9c86-351c-40fd-86a1-61d8cc20b581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:11.232715 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc9c86-351c-40fd-86a1-61d8cc20b581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:11.233001 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc9c86-351c-40fd-86a1-61d8cc20b581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:11.233283 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc9c86-351c-40fd-86a1-61d8cc20b581 admin admin] PATH_INFO: `/v3/users/0392ff87308b4ba88b6a95b1923ed9c7` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:11.234535 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc9c86-351c-40fd-86a1-61d8cc20b581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0392ff87308b4ba88b6a95b1923ed9c7)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:11.236611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc9c86-351c-40fd-86a1-61d8cc20b581 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:11.238892 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:11.585121 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02bc9c86-351c-40fd-86a1-61d8cc20b581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0392ff87308b4ba88b6a95b1923ed9c7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:11.690343 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02bc9c86-351c-40fd-86a1-61d8cc20b581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0392ff87308b4ba88b6a95b1923ed9c7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:11.698655 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02bc9c86-351c-40fd-86a1-61d8cc20b581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0392ff87308b4ba88b6a95b1923ed9c7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:11.699392 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02bc9c86-351c-40fd-86a1-61d8cc20b581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0392ff87308b4ba88b6a95b1923ed9c7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:11.713090 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-02bc9c86-351c-40fd-86a1-61d8cc20b581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0392ff87308b4ba88b6a95b1923ed9c7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:11.720020 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1457/2905] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:54:11 2022] DELETE /identity/v3/users/0392ff87308b4ba88b6a95b1923ed9c7 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:54:12.196209 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09201dd4-545a-4742-9121-a5062c6b1fb9 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:12.197724 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-09201dd4-545a-4742-9121-a5062c6b1fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:12.211125 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09201dd4-545a-4742-9121-a5062c6b1fb9 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:12.273858 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c4e5e-5ab1-404f-917e-ed8bcd3dcd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:12.275046 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c4e5e-5ab1-404f-917e-ed8bcd3dcd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:12.275322 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c4e5e-5ab1-404f-917e-ed8bcd3dcd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:12.275595 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c4e5e-5ab1-404f-917e-ed8bcd3dcd46 admin admin] PATH_INFO: `/v3/projects/546a893a38c54c2c9eeba964ebb62821` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:12.276796 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c4e5e-5ab1-404f-917e-ed8bcd3dcd46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=546a893a38c54c2c9eeba964ebb62821)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:12.278760 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c4e5e-5ab1-404f-917e-ed8bcd3dcd46 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:12.436778 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d31c4e5e-5ab1-404f-917e-ed8bcd3dcd46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546a893a38c54c2c9eeba964ebb62821', 'request_id': 'req-d31c4e5e-5ab1-404f-917e-ed8bcd3dcd46'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:12.444390 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d31c4e5e-5ab1-404f-917e-ed8bcd3dcd46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546a893a38c54c2c9eeba964ebb62821', 'request_id': 'req-d31c4e5e-5ab1-404f-917e-ed8bcd3dcd46'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:12.452124 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d31c4e5e-5ab1-404f-917e-ed8bcd3dcd46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546a893a38c54c2c9eeba964ebb62821', 'request_id': 'req-d31c4e5e-5ab1-404f-917e-ed8bcd3dcd46'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:12.453986 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:12.576112 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d31c4e5e-5ab1-404f-917e-ed8bcd3dcd46 admin admin] The token cache is being invalidate because project 546a893a38c54c2c9eeba964ebb62821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:54:12.576407 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d31c4e5e-5ab1-404f-917e-ed8bcd3dcd46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:12.577077 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d31c4e5e-5ab1-404f-917e-ed8bcd3dcd46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:12.578687 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1449/2906] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:54:12 2022] DELETE /identity/v3/projects/546a893a38c54c2c9eeba964ebb62821 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:54:12.585091 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7471236-fe80-4820-85fc-89b06a25b8be None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:12.585640 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7471236-fe80-4820-85fc-89b06a25b8be None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:12.585752 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7471236-fe80-4820-85fc-89b06a25b8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:12.605763 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b7471236-fe80-4820-85fc-89b06a25b8be None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:54:12.607023 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b7471236-fe80-4820-85fc-89b06a25b8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:12.672487 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1458/2907] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:54:12.682227 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57881b03-8d2d-479d-883a-0adad51f8bca None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:12.682568 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57881b03-8d2d-479d-883a-0adad51f8bca None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:12.682850 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57881b03-8d2d-479d-883a-0adad51f8bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:12.702441 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-57881b03-8d2d-479d-883a-0adad51f8bca None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:54:12.703536 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-57881b03-8d2d-479d-883a-0adad51f8bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:12.712811 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1450/2908] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:54:12.717194 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7471236-fe80-4820-85fc-89b06a25b8be None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:12.728209 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7471236-fe80-4820-85fc-89b06a25b8be None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:12.733292 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05b519-f5a3-4c60-bf22-a34700628eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:12.733957 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05b519-f5a3-4c60-bf22-a34700628eba admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:12.734297 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05b519-f5a3-4c60-bf22-a34700628eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:12.734654 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05b519-f5a3-4c60-bf22-a34700628eba admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:12.735382 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05b519-f5a3-4c60-bf22-a34700628eba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:54:12.735688 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05b519-f5a3-4c60-bf22-a34700628eba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:12.737299 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05b519-f5a3-4c60-bf22-a34700628eba admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:12.754700 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1459/2909] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 18 10:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:54:12.755711 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57881b03-8d2d-479d-883a-0adad51f8bca None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:12.765276 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57881b03-8d2d-479d-883a-0adad51f8bca None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:12.771926 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed4149-42c1-4809-9ee3-f40ed1814474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:12.772576 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed4149-42c1-4809-9ee3-f40ed1814474 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:12.773098 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed4149-42c1-4809-9ee3-f40ed1814474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:12.773532 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed4149-42c1-4809-9ee3-f40ed1814474 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:12.774256 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed4149-42c1-4809-9ee3-f40ed1814474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:12.776775 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed4149-42c1-4809-9ee3-f40ed1814474 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:12.881944 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1451/2910] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 18 10:54:12 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:54:12.886465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05b519-f5a3-4c60-bf22-a34700628eba admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:12.898291 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05b519-f5a3-4c60-bf22-a34700628eba admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:12.969718 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb7da2-7174-4f49-9322-49be3e1440c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:12.970468 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb7da2-7174-4f49-9322-49be3e1440c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:12.970753 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb7da2-7174-4f49-9322-49be3e1440c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:12.971029 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb7da2-7174-4f49-9322-49be3e1440c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:12.971735 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb7da2-7174-4f49-9322-49be3e1440c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:12.974611 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb7da2-7174-4f49-9322-49be3e1440c5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:12.985215 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:13.113821 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1460/2911] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 18 10:54:12 2022] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:54:13.118387 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed4149-42c1-4809-9ee3-f40ed1814474 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:13.132936 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed4149-42c1-4809-9ee3-f40ed1814474 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:13.137886 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34b2c8-660e-4dff-a707-9cf7b3674483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:13.138591 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34b2c8-660e-4dff-a707-9cf7b3674483 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:13.138875 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34b2c8-660e-4dff-a707-9cf7b3674483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:13.139144 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34b2c8-660e-4dff-a707-9cf7b3674483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:13.139877 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34b2c8-660e-4dff-a707-9cf7b3674483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:13.141535 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34b2c8-660e-4dff-a707-9cf7b3674483 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:13.155043 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1452/2912] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:54:13.159349 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb7da2-7174-4f49-9322-49be3e1440c5 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:13.169979 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb7da2-7174-4f49-9322-49be3e1440c5 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:13.175886 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37465c5-1015-4eb3-a2df-34e7f5aaca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:13.176564 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37465c5-1015-4eb3-a2df-34e7f5aaca29 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:13.176850 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37465c5-1015-4eb3-a2df-34e7f5aaca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:13.177125 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37465c5-1015-4eb3-a2df-34e7f5aaca29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:13.177857 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37465c5-1015-4eb3-a2df-34e7f5aaca29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:13.179804 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37465c5-1015-4eb3-a2df-34e7f5aaca29 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:13.192098 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1461/2913] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 18 10:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:54:13.196576 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34b2c8-660e-4dff-a707-9cf7b3674483 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:13.208363 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34b2c8-660e-4dff-a707-9cf7b3674483 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:13.213468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00217205-eb7e-4a3d-a370-c7aeb59103bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:13.214473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217205-eb7e-4a3d-a370-c7aeb59103bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:13.214763 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217205-eb7e-4a3d-a370-c7aeb59103bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:13.215043 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217205-eb7e-4a3d-a370-c7aeb59103bd admin admin] PATH_INFO: `/v3/projects/cb5a0d1191d74a259e8861be14a277f2/users/024ea8f690b54ae2aca57e2cc1d42a69/roles/4b6ddd50803f4f9bbf171c5c7cb9af63` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:13.231684 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00217205-eb7e-4a3d-a370-c7aeb59103bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5a0d1191d74a259e8861be14a277f2, user_id=024ea8f690b54ae2aca57e2cc1d42a69, role_id=4b6ddd50803f4f9bbf171c5c7cb9af63)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:13.234394 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00217205-eb7e-4a3d-a370-c7aeb59103bd admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:13.366101 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1453/2914] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 18 10:54:13 2022] PUT /identity/v3/projects/cb5a0d1191d74a259e8861be14a277f2/users/024ea8f690b54ae2aca57e2cc1d42a69/roles/4b6ddd50803f4f9bbf171c5c7cb9af63 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:54:13.377016 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ccacf-542a-4644-b32c-a9d9891b79ce None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:13.377309 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ccacf-542a-4644-b32c-a9d9891b79ce None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:13.377572 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ccacf-542a-4644-b32c-a9d9891b79ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:13.406173 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3b2ccacf-542a-4644-b32c-a9d9891b79ce None None] MFA Rules not processed for user `024ea8f690b54ae2aca57e2cc1d42a69`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:54:13.407461 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3b2ccacf-542a-4644-b32c-a9d9891b79ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:13.483253 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1462/2915] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:54:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:54:13.496371 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00217205-eb7e-4a3d-a370-c7aeb59103bd admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:13.498104 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-00217205-eb7e-4a3d-a370-c7aeb59103bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:13.588844 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00217205-eb7e-4a3d-a370-c7aeb59103bd admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:13.592754 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45a49e-d364-4037-9870-03a8ed7e0018 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f93de99555742ca9bd99d707d1cdbee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:13.593413 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45a49e-d364-4037-9870-03a8ed7e0018 service glance] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:13.593697 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45a49e-d364-4037-9870-03a8ed7e0018 service glance] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:13.593978 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45a49e-d364-4037-9870-03a8ed7e0018 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:13.604528 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45a49e-d364-4037-9870-03a8ed7e0018 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:13.606019 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45a49e-d364-4037-9870-03a8ed7e0018 service glance] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:13.616361 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1454/2916] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:54:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:54:23.479620 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=39 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:23.611471 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=64 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:40.412453 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ccacf-542a-4644-b32c-a9d9891b79ce None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:40.481998 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ccacf-542a-4644-b32c-a9d9891b79ce None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:40.487660 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb25f81-8542-4d20-a2ae-3c286cc88b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:40.488615 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb25f81-8542-4d20-a2ae-3c286cc88b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:40.488948 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb25f81-8542-4d20-a2ae-3c286cc88b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:40.489223 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb25f81-8542-4d20-a2ae-3c286cc88b12 admin admin] PATH_INFO: `/v3/users/024ea8f690b54ae2aca57e2cc1d42a69` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:40.491314 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb25f81-8542-4d20-a2ae-3c286cc88b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=024ea8f690b54ae2aca57e2cc1d42a69)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:40.495144 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb25f81-8542-4d20-a2ae-3c286cc88b12 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:40.753798 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bcb25f81-8542-4d20-a2ae-3c286cc88b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024ea8f690b54ae2aca57e2cc1d42a69'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:40.862465 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bcb25f81-8542-4d20-a2ae-3c286cc88b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024ea8f690b54ae2aca57e2cc1d42a69'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:40.871553 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bcb25f81-8542-4d20-a2ae-3c286cc88b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024ea8f690b54ae2aca57e2cc1d42a69'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:40.872302 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bcb25f81-8542-4d20-a2ae-3c286cc88b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024ea8f690b54ae2aca57e2cc1d42a69'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:40.885419 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bcb25f81-8542-4d20-a2ae-3c286cc88b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024ea8f690b54ae2aca57e2cc1d42a69'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:40.891872 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1463/2917] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 18 10:54:40 2022] DELETE /identity/v3/users/024ea8f690b54ae2aca57e2cc1d42a69 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:54:40.896690 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fd9fd-318e-4901-8791-e548beef0ad2 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:40.897242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fd9fd-318e-4901-8791-e548beef0ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:40.897242 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fd9fd-318e-4901-8791-e548beef0ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:40.916495 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b33fd9fd-318e-4901-8791-e548beef0ad2 None None] MFA Rules not processed for user `7af289109e3a4eaf8ae29a4b13dcfb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:54:40.922519 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b33fd9fd-318e-4901-8791-e548beef0ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:40.980973 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1455/2918] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 18 10:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:54:40.991770 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb25f81-8542-4d20-a2ae-3c286cc88b12 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:40.993220 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-bcb25f81-8542-4d20-a2ae-3c286cc88b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:41.057451 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb25f81-8542-4d20-a2ae-3c286cc88b12 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:41.061185 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aff63-0f95-488c-ac6e-979599b2d6d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f9385dec85a4e0cba21c2a840124f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:41.061843 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aff63-0f95-488c-ac6e-979599b2d6d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:41.062128 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aff63-0f95-488c-ac6e-979599b2d6d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:41.062444 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aff63-0f95-488c-ac6e-979599b2d6d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:41.072414 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189aff63-0f95-488c-ac6e-979599b2d6d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:41.073888 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189aff63-0f95-488c-ac6e-979599b2d6d1 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:41.084524 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1464/2919] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:54:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:54:41.561772 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fd9fd-318e-4901-8791-e548beef0ad2 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:41.563619 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b33fd9fd-318e-4901-8791-e548beef0ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:41.577260 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fd9fd-318e-4901-8791-e548beef0ad2 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:41.583136 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfebac2-bc2d-499b-8ab9-0295f492abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7af289109e3a4eaf8ae29a4b13dcfb4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd97299e4fa148ce8ed40c106d7096bc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:41.584527 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfebac2-bc2d-499b-8ab9-0295f492abff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:41.584903 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfebac2-bc2d-499b-8ab9-0295f492abff admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:41.585189 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfebac2-bc2d-499b-8ab9-0295f492abff admin admin] PATH_INFO: `/v3/projects/cb5a0d1191d74a259e8861be14a277f2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:41.586750 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfebac2-bc2d-499b-8ab9-0295f492abff admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb5a0d1191d74a259e8861be14a277f2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:41.588774 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfebac2-bc2d-499b-8ab9-0295f492abff admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:41.722480 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-abfebac2-bc2d-499b-8ab9-0295f492abff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb5a0d1191d74a259e8861be14a277f2', 'request_id': 'req-abfebac2-bc2d-499b-8ab9-0295f492abff'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:41.728257 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-abfebac2-bc2d-499b-8ab9-0295f492abff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb5a0d1191d74a259e8861be14a277f2', 'request_id': 'req-abfebac2-bc2d-499b-8ab9-0295f492abff'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:41.734791 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-abfebac2-bc2d-499b-8ab9-0295f492abff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb5a0d1191d74a259e8861be14a277f2', 'request_id': 'req-abfebac2-bc2d-499b-8ab9-0295f492abff'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:41.838596 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-abfebac2-bc2d-499b-8ab9-0295f492abff admin admin] The token cache is being invalidate because project cb5a0d1191d74a259e8861be14a277f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:54:41.838825 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-abfebac2-bc2d-499b-8ab9-0295f492abff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:41.839468 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-abfebac2-bc2d-499b-8ab9-0295f492abff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:41.841017 dv-cinder-849498-1-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1456/2920] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 18 10:54:41 2022] DELETE /identity/v3/projects/cb5a0d1191d74a259e8861be14a277f2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:54:51.079295 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:51.835473 dv-cinder-849498-1-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:58:42.222868 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aff63-0f95-488c-ac6e-979599b2d6d1 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:58:42.224360 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-189aff63-0f95-488c-ac6e-979599b2d6d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:58:42.382816 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aff63-0f95-488c-ac6e-979599b2d6d1 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:58:42.452755 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb8bf5-fd29-4293-ab2f-5dd23790add0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fd088faaba4d5c9745638c14f1a7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e0b5ee15df481cbc01333131f3def0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:58:42.453416 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb8bf5-fd29-4293-ab2f-5dd23790add0 service placement] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:58:42.453695 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb8bf5-fd29-4293-ab2f-5dd23790add0 service placement] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:58:42.453971 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb8bf5-fd29-4293-ab2f-5dd23790add0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:58:42.455931 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-51bb8bf5-fd29-4293-ab2f-5dd23790add0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:58:42.468282 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb8bf5-fd29-4293-ab2f-5dd23790add0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:58:42.469819 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb8bf5-fd29-4293-ab2f-5dd23790add0 service placement] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:58:42.482344 dv-cinder-849498-1-smb devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1465/2921] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 18 10:58:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:58:52.476162 dv-cinder-849498-1-smb devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}